00002000:00010000:0.0:1746143738.672037:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143735 -> 1746143738 00000100:00100000:0.0:1746143738.672055:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594069120:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143738.672072:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095614000/0xe984082ccd72b624 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d00 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.672083:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095614000/0xe984082ccd72b624 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d00 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.672092:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095614000, rc 0) 00000100:00100000:0.0:1746143738.672170:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963593422336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8388us (9096us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143738.672177:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11639 00000100:00100000:0.0:1746143738.672203:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594068736:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143738.672211:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143738.672225:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593421952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8815us (9213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143738.672231:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6104 00000100:00100000:0.0:1746143738.675516:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593422720 00000100:00100000:0.0:1746143738.675521:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593422720 00002000:00100000:0.0:1746143738.675551:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1167360->1171455) req@ffff88009ae71c00 x1830963593422720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.675559:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae71c00 with x1830963593422720 ext(1167360->1171455) 00002000:00010000:0.0:1746143738.675563:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae71c00 00000100:00100000:0.0:1746143738.675580:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5287 00000100:00100000:0.0:1746143738.675585:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1964:x1830963593422720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143738.675706:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1964:x1830963593422720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 121us (900us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143738.675716:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5287 00002000:00100000:0.0:1746143738.675720:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1167360->1171455) req@ffff88009ae71c00 x1830963593422720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746143749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.675727:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae71c00 with x1830963593422720 ext(1167360->1171455) 00002000:00010000:0.0:1746143738.675729:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae71c00 00000100:00100000:0.0:1746143738.680072:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593423104 00000100:00100000:0.0:1746143738.680080:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593423104 00002000:00100000:0.0:1746143738.680114:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ae70380 x1830963593423104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.680122:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae70380 with x1830963593423104 ext(0->1048575) 00002000:00010000:0.0:1746143738.680127:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae70380 00000100:00100000:0.0:1746143738.680158:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5288 00000100:00100000:0.0:1746143738.680163:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963593423104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143738.681407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.689616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.689643:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593423232 00000100:00100000:0.0:1746143738.689650:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593423232 00002000:00100000:0.0:1746143738.689684:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2080767) req@ffff88009c3fb800 x1830963593423232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.689692:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963593423232 ext(1048576->2080767) 00002000:00010000:0.0:1746143738.689697:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:0.0:1746143738.689714:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5289 00000100:00100000:0.0:1746143738.689720:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1964:x1830963593423232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143738.703736:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963593423104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23565us (27079us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143738.703746:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5288 00002000:00100000:0.0:1746143738.703755:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ae70380 x1830963593423104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/440 e 0 to 0 dl 1746143749 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.703763:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae70380 with x1830963593423104 ext(0->1048575) 00002000:00010000:0.0:1746143738.703768:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae70380 00000100:00100000:0.0:1746143738.708650:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594069504:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143738.708665:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72b639 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d15 expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.708673:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd72b639 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d15 expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.708685:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2d600, rc 0) 00000100:00100000:0.0:1746143738.708703:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963593423872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 11727us (12082us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143738.708708:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11642 00000100:00100000:0.0:1746143738.714879:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593424640 00000100:00100000:0.0:1746143738.714884:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593424640 00002000:00100000:0.0:1746143738.714918:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1171456->2097151) req@ffff88012b7cc700 x1830963593424640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.714927:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc700 with x1830963593424640 ext(1171456->2097151) 00002000:00010000:0.0:1746143738.714931:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cc700 00000100:00100000:0.0:1746143738.714963:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5290 00000100:00100000:0.0:1746143738.714969:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1964:x1830963593424640:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143738.716691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.717263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.717282:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593425152 00000100:00100000:0.0:1746143738.717286:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593425152 00002000:00100000:0.0:1746143738.717311:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1826816->1830911) req@ffff88009c3fad80 x1830963593425152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.717319:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830963593425152 ext(1826816->1830911) 00002000:00010000:0.0:1746143738.717323:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:0.0:1746143738.717335:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5291 00000100:00100000:0.0:1746143738.717341:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963593425152:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143738.717442:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963593425152:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 90us (168us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143738.717447:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5291 00002000:00100000:0.0:1746143738.717452:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1826816->1830911) req@ffff88009c3fad80 x1830963593425152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746143749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.717458:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830963593425152 ext(1826816->1830911) 00002000:00010000:0.0:1746143738.717460:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:0.0:1746143738.717812:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1964:x1830963593423232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28092us (28202us total) trans 0 rc 1032192/1032192 00000100:00100000:0.0:1746143738.717817:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5289 00002000:00100000:0.0:1746143738.717821:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2080767) req@ffff88009c3fb800 x1830963593423232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/440 e 0 to 0 dl 1746143749 ref 1 fl Complete:/200/0 rc 1032192/1032192 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.717835:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963593423232 ext(1048576->2080767) 00002000:00010000:0.0:1746143738.717838:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:0.0:1746143738.733240:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1964:x1830963593424640:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18263us (19174us total) trans 0 rc 925696/925696 00000100:00100000:0.0:1746143738.733249:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5290 00002000:00100000:0.0:1746143738.733259:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1171456->2097151) req@ffff88012b7cc700 x1830963593424640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/440 e 0 to 0 dl 1746143749 ref 1 fl Complete:/200/0 rc 925696/925696 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.733267:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc700 with x1830963593424640 ext(1171456->2097151) 00002000:00010000:0.0:1746143738.733272:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cc700 00000001:00080000:0.0:1746143738.750305:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872805 is committed 00000001:00080000:0.0:1746143738.750317:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872804 is committed 00000001:00080000:0.0:1746143738.750323:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872793 is committed 00000001:00080000:0.0:1746143738.750352:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872794 is committed 00000001:00080000:0.0:1746143738.750388:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872795 is committed 00000001:00080000:0.0:1746143738.750394:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872778 is committed 00000001:00080000:0.0:1746143738.750420:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872806 is committed 00000001:00080000:0.0:1746143738.750443:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872796 is committed 00000001:00080000:0.0:1746143738.750446:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872780 is committed 00000100:00100000:0.0:1746143738.750766:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593425536 00000100:00100000:0.0:1746143738.750773:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593425536 00010000:00010000:0.0:1746143738.750803:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff24a00/0xe984082ccd72b52f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c66 expref: 6 pid: 8497 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143738.750824:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593425792 00000100:00100000:0.0:1746143738.750826:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593425792 00010000:00010000:0.0:1746143738.750834:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0600/0xe984082ccd72b4f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c4a expref: 11 pid: 21542 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143738.750851:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593425664 00000100:00100000:0.0:1746143738.750853:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593425664 00010000:00010000:0.0:1746143738.750861:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f89c600/0xe984082ccd72b5fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4ccf expref: 20 pid: 4582 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746143738.750873:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6108 00000100:00100000:0.0:1746143738.750879:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593425536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143738.750888:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143738.750906:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff24a00/0xe984082ccd72b52f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c66 expref: 6 pid: 8497 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143738.750916:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff24a00/0xe984082ccd72b52f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c66 expref: 6 pid: 8497 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143738.750934:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff24a00/0xe984082ccd72b52f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c66 expref: 6 pid: 8497 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143738.750946:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143738.750980:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593425536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143738.750986:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6108 00000100:00100000:0.0:1746143738.750997:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6109 00000100:00100000:0.0:1746143738.751002:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963593425792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143738.751007:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143738.751018:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0600/0xe984082ccd72b4f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c4a expref: 11 pid: 21542 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143738.751026:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0600/0xe984082ccd72b4f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c4a expref: 11 pid: 21542 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143738.751036:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d0600/0xe984082ccd72b4f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c4a expref: 11 pid: 21542 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143738.751043:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143738.751055:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593425792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 54us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143738.751060:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6109 00000100:00100000:0.0:1746143738.751070:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6110 00000100:00100000:0.0:1746143738.751074:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963593425664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143738.751079:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143738.751085:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f89c600/0xe984082ccd72b5fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4ccf expref: 20 pid: 4582 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143738.751092:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f89c600/0xe984082ccd72b5fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4ccf expref: 20 pid: 4582 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143738.751101:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f89c600/0xe984082ccd72b5fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4ccf expref: 20 pid: 4582 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746143738.751108:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143738.751110:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143738.751120:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2120000/0xe984082ccd72b647 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d23 expref: 9 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.751128:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2120000/0xe984082ccd72b647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d23 expref: 9 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.751172:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2120000/0xe984082ccd72b647 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d23 expref: 9 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143738.751182:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594070656:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143738.752558:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143738.752644:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.752693:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593425920 00000100:00100000:0.0:1746143738.752697:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593425920 00002000:00100000:0.0:1746143738.752720:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1826816->2097151) req@ffff88009c3fb100 x1830963593425920/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.752729:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830963593425920 ext(1826816->2097151) 00010000:00010000:0.0:1746143738.752736:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72b640 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d1c expref: 10 pid: 8495 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143738.752948:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72b640 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d1c expref: 10 pid: 8495 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746143738.752956:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3fb100 00000100:00100000:0.0:1746143738.753309:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1525 00000100:00100000:0.0:1746143738.753315:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593425920:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143738.762084:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963593425920:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 8762us (9433us total) trans 21474840111 rc 0/0 00000100:00100000:0.0:1746143738.762093:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1525 00002000:00100000:0.0:1746143738.762100:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1826816->2097151) req@ffff88009c3fb100 x1830963593425920/t21474840111(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:134/0 lens 488/448 e 0 to 0 dl 1746143749 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.762108:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb100 with x1830963593425920 ext(1826816->2097151) 00010000:00010000:0.0:1746143738.762115:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72b640 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d1c expref: 12 pid: 8495 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746143738.762126:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f8f5800/0xe984082ccd72b640 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d1c expref: 12 pid: 8495 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746143738.762132:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c3fb100 00000100:00100000:0.0:1746143738.766206:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.771589:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.791957:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.796590:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.808190:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.821984:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.822026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.822232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.822264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.822286:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593427456 00000100:00100000:0.0:1746143738.822293:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593427456 00002000:00100000:0.0:1746143738.822328:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009c3f8000 x1830963593427456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.822346:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f8000 with x1830963593427456 ext(2097152->3145727) 00002000:00010000:0.0:1746143738.822351:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f8000 00000100:00100000:0.0:1746143738.822364:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593427712 00000100:00100000:0.0:1746143738.822367:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593427712 00002000:00100000:0.0:1746143738.822377:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094760a80 x1830963593427712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.822382:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760a80 with x1830963593427712 ext(3145728->4194303) 00002000:00010000:0.0:1746143738.822384:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094760a80 00000100:00100000:0.0:1746143738.824066:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593427968 00000100:00100000:0.0:1746143738.824073:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593427968 00002000:00100000:0.0:1746143738.824094:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094760700 x1830963593427968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.824100:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760700 with x1830963593427968 ext(2097152->3145727) 00002000:00010000:0.0:1746143738.824104:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760700 00000100:00100000:0.0:1746143738.856748:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.871030:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.871073:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.872907:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.872921:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593428864 00000100:00100000:0.0:1746143738.872924:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593428864 00000100:00100000:0.0:1746143738.872949:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11649 00000100:00100000:0.0:1746143738.872954:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963593428864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143738.872961:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143738.872970:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5792600/0xe984082ccd72b67f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4d4d expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.872994:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143738.872996:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143738.873002:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5792600/0xe984082ccd72b67f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d4d expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.873014:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792600/0xe984082ccd72b67f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d4d expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.873021:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792600, rc 0) 00000100:00100000:0.0:1746143738.873037:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963593428864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143738.873041:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11649 00000100:00100000:0.0:1746143738.873085:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.873093:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593428992 00000100:00100000:0.0:1746143738.873095:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593428992 00000100:00100000:0.0:1746143738.873107:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11650 00000100:00100000:0.0:1746143738.873111:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963593428992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143738.873117:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143738.873123:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd72b686 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4d54 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.873132:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143738.873133:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143738.873137:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd72b686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d54 expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.873162:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd72b686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d54 expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143738.873174:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792e00, rc 0) 00000100:00100000:0.0:1746143738.873188:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963593428992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 77us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143738.873193:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11650 00000100:00100000:0.0:1746143738.888828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.894964:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.911000:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.921332:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.921376:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.922382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143738.923926:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed39c00/0xe984082ccd72b694 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143738.923933:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed39c00/0xe984082ccd72b694 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143738.923950:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8929408 00010000:00010000:0.0:1746143738.924068:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed39e00/0xe984082ccd72b68d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d5b expref: 38 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.924083:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed39c00/0xe984082ccd72b694 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d5b expref: 37 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.924337:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143738.924341:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143738.924343:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed39c00, rc 0) 00000100:00100000:0.0:1746143738.927775:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:30431:x1830963593429760:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14950us (16774us total) trans 8589943042 rc 0/0 00000100:00100000:0.0:1746143738.927799:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8815 00000100:00100000:0.0:1746143738.928207:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593430272 00000100:00100000:0.0:1746143738.928213:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593430272 00000100:00100000:0.0:1746143738.928253:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11651 00000100:00100000:0.0:1746143738.928665:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:30429:x1830963593430272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143738.928684:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143738.928699:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800949b6800/0xe984082ccd72b6a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4d62 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.928723:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800951aa600/0xe984082ccd72b5de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4cac expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.928730:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143738.928731:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143738.928733:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800949b6800/0xe984082ccd72b6a2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d62 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.928756:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800951aa600/0xe984082ccd72b5de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4cac expref: 20 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143738.928767:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800951aa600/0xe984082ccd72b5de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2080768->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4cac expref: 20 pid: 8496 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746143738.928777:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594071808:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143738.928853:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143738.934011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.940048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.953650:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.962245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143738.965622:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593431936 00000100:00100000:0.0:1746143738.965627:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593431936 00002000:00100000:0.0:1746143738.965657:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x351:0x0] (946176->950271) req@ffff880093345f80 x1830963593431936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:134/0 lens 488/0 e 0 to 0 dl 1746143749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.965665:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093345f80 with x1830963593431936 ext(946176->950271) 00002000:00010000:0.0:1746143738.965669:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093345f80 00000100:00100000:0.0:1746143738.965684:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5302 00000100:00100000:0.0:1746143738.965690:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963593431936:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143738.965883:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963593431936:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 192us (543us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143738.965890:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5302 00002000:00100000:0.0:1746143738.965895:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x351:0x0] (946176->950271) req@ffff880093345f80 x1830963593431936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746143749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143738.965901:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093345f80 with x1830963593431936 ext(946176->950271) 00002000:00010000:0.0:1746143738.965904:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093345f80 00000100:00100000:0.0:1746143738.993682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.008315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.029702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.078915:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.079326:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.087246:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.087281:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.087309:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.115547:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.117907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.117946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.119486:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.122701:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593434496 00000100:00100000:0.0:1746143739.122706:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593434496 00010000:00010000:0.0:1746143739.122722:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800949b6800/0xe984082ccd72b6a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d62 expref: 11 pid: 12618 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746143739.122738:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6121 00000100:00100000:0.0:1746143739.122742:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1962:x1830963593434496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143739.122750:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143739.122763:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800949b6800/0xe984082ccd72b6a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d62 expref: 11 pid: 12618 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.122771:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800949b6800/0xe984082ccd72b6a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d62 expref: 11 pid: 12618 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.122785:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800949b6800/0xe984082ccd72b6a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d62 expref: 11 pid: 12618 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.122796:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.122798:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.122803:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093d62a00/0xe984082ccd72b6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d9a expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.122809:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093d62a00/0xe984082ccd72b6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d9a expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.122837:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093d62a00/0xe984082ccd72b6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d9a expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.122846:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fde300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594073344:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143739.122877:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.127184:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594073216:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143739.127208:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed39e00/0xe984082ccd72b6ef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4da1 expref: 17 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.127219:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed39e00/0xe984082ccd72b6ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4da1 expref: 17 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.127227:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed39e00, rc 0) 00000100:00100000:0.0:1746143739.127264:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963593434240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8538us (9316us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143739.127270:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11659 00000100:00100000:0.0:1746143739.127604:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593434752 00000100:00100000:0.0:1746143739.127610:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593434752 00002000:00100000:0.0:1746143739.127636:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1421312->1425407) req@ffff88012e17f100 x1830963593434752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:135/0 lens 488/0 e 0 to 0 dl 1746143750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.127644:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f100 with x1830963593434752 ext(1421312->1425407) 00002000:00010000:0.0:1746143739.127648:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17f100 00000100:00100000:0.0:1746143739.127672:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5307 00000100:00100000:0.0:1746143739.127679:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963593434752:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143739.127790:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963593434752:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 111us (397us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143739.127795:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5307 00002000:00100000:0.0:1746143739.127800:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1421312->1425407) req@ffff88012e17f100 x1830963593434752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746143750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.127807:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f100 with x1830963593434752 ext(1421312->1425407) 00002000:00010000:0.0:1746143739.127809:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17f100 00000100:00100000:0.0:1746143739.134953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.146444:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593435136 00000100:00100000:0.0:1746143739.146452:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593435136 00000100:00100000:0.0:1746143739.147645:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11660 00000100:00100000:0.0:1746143739.147654:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:30433:x1830963593435136:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143739.147669:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.147682:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2211000/0xe984082ccd72b6f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4da8 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.148354:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed39a00/0xe984082ccd72b6c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d77 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.148361:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cab8800/0xe984082ccd72b6da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d8c expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.148367:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.148369:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.148372:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2211000/0xe984082ccd72b6f6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->1253375] (req 1048576->1253375) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4da8 expref: 26 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.148409:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cab8800/0xe984082ccd72b6da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d8c expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.148418:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cab8800/0xe984082ccd72b6da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d8c expref: 26 pid: 12618 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746143739.148439:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594073472:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143739.148486:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed39a00/0xe984082ccd72b6c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d77 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.148494:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed39a00/0xe984082ccd72b6c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d77 expref: 9 pid: 12618 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746143739.148502:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594073600:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143739.148516:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.157677:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.158391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.158751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.158773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.158798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.164016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.165916:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.165946:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.165996:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.168195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.193682:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.216569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.223175:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.225063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.229754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.235809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.235847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.235871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.235892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.235905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.235931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.236830:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11671 00000100:00100000:0.0:1746143739.236841:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593438208:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143739.236855:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.236868:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009505fe00/0xe984082ccd72b75f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4de7 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.236908:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594074752:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.236952:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.238943:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594074752:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143739.238970:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009505fe00/0xe984082ccd72b75f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4de7 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.238980:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009505fe00/0xe984082ccd72b75f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4de7 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.239014:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009505fe00, rc 0) 00000100:00100000:0.0:1746143739.239047:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593438208:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2207us (3172us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143739.239053:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11671 00000100:00100000:0.0:1746143739.249028:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.254604:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.261616:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.270362:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.270402:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.271113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.276741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.276786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.279879:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593440256 00000100:00100000:0.0:1746143739.279885:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593440256 00010000:00010000:0.0:1746143739.279909:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f9800/0xe984082ccd72b536 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c74 expref: 10 pid: 21542 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746143739.280006:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6131 00000100:00100000:0.0:1746143739.280013:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593440256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143739.280024:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143739.280039:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f9800/0xe984082ccd72b536 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c74 expref: 10 pid: 21542 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.280050:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7f9800/0xe984082ccd72b536 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c74 expref: 10 pid: 21542 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.280078:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f9800/0xe984082ccd72b536 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4c74 expref: 10 pid: 21542 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.280092:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.280094:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.280099:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72b797 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e1f expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.280107:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72b797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e1f expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.280132:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72b797 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4055040->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e1f expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.280162:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594075776:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143739.280422:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.285395:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.289033:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.296860:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.296896:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.300262:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593441280 00000100:00100000:0.0:1746143739.300269:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593441280 00010000:00010000:0.0:1746143739.300293:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd72b686 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d54 expref: 17 pid: 15784 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746143739.300312:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6134 00000100:00100000:0.0:1746143739.300324:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963593441280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143739.300335:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143739.300351:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd72b686 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d54 expref: 17 pid: 15784 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746143739.300360:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd72b686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d54 expref: 17 pid: 15784 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746143739.300377:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5792e00/0xe984082ccd72b686 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4d54 expref: 17 pid: 15784 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746143739.300391:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.300393:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.300398:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13c00/0xe984082ccd72b7ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e2d expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.300405:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13c00/0xe984082ccd72b7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e2d expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.300444:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf13c00/0xe984082ccd72b7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e2d expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.300454:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594076288:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143739.300516:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.308622:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.313877:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593442048 00000100:00100000:0.0:1746143739.313883:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593442048 00000100:00100000:0.0:1746143739.313917:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3701 00000100:00100000:0.0:1746143739.313922:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:30442:x1830963593442048:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143739.314107:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:30442:x1830963593442048:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 185us (342us total) trans 8589943047 rc 0/0 00000100:00100000:0.0:1746143739.314112:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3701 00000100:00100000:0.0:1746143739.327932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.356382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.359632:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.374821:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.380285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.398778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.400390:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.403556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.403626:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.405753:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593443584 00000100:00100000:0.0:1746143739.405761:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593443584 00002000:00100000:0.0:1746143739.405795:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1253375) req@ffff8800a5c21f80 x1830963593443584/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:135/0 lens 488/0 e 0 to 0 dl 1746143750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.405804:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21f80 with x1830963593443584 ext(1048576->1253375) 00010000:00010000:0.0:1746143739.405811:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a2211000/0xe984082ccd72b6f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4da8 expref: 25 pid: 8495 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.405824:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a2211000/0xe984082ccd72b6f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4da8 expref: 25 pid: 8495 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746143739.405830:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c21f80 00000100:00100000:0.0:1746143739.405854:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1531 00000100:00100000:0.0:1746143739.405872:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963593443584:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143739.418679:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.425981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.431786:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.448784:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.453754:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593444480 00000100:00100000:0.0:1746143739.453759:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593444480 00002000:00100000:0.0:1746143739.453792:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (2056192->2060287) req@ffff8800a5d83100 x1830963593444480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:135/0 lens 488/0 e 0 to 0 dl 1746143750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.453801:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830963593444480 ext(2056192->2060287) 00002000:00010000:0.0:1746143739.453936:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:0.0:1746143739.453963:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5317 00000100:00100000:0.0:1746143739.453969:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963593444480:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143739.455625:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963593444480:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1651us (2068us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143739.455632:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5317 00002000:00100000:0.0:1746143739.455639:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (2056192->2060287) req@ffff8800a5d83100 x1830963593444480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746143750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.455646:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83100 with x1830963593444480 ext(2056192->2060287) 00002000:00010000:0.0:1746143739.455651:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83100 00000100:00100000:0.0:1746143739.456546:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.456576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.459296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.459325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.464695:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5321 00000100:00100000:0.0:1746143739.464717:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963593445248:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143739.472675:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.472761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.472781:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593445888 00000100:00100000:0.0:1746143739.472789:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593445888 00000100:00100000:0.0:1746143739.472825:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593445760 00000100:00100000:0.0:1746143739.472827:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593445760 00000100:00100000:0.0:1746143739.474769:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11682 00000100:00100000:0.0:1746143739.474781:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963593445888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143739.474797:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.474811:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2211000/0xe984082ccd72b7f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4e6c expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.475270:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594077952:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.475878:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.475930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.486013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.487116:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.494134:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594078208:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143739.494170:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143739.494212:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963593446400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6648us (7096us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143739.494221:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6141 00000100:00100000:0.0:1746143739.494933:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.514298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.515033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.519077:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5324 00000100:00100000:0.0:1746143739.519087:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963593446912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143739.542942:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.545650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.552801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.563312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.563695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.584519:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.585522:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.585538:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593448448 00000100:00100000:0.0:1746143739.585541:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593448448 00000100:00100000:0.0:1746143739.585572:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11688 00000100:00100000:0.0:1746143739.585577:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963593448448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143739.585585:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.585593:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7db800/0xe984082ccd72b831 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4e96 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.585616:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594078848:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.585631:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.585662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.591911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.601074:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593448960 00000100:00100000:0.0:1746143739.601080:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593448960 00000100:00100000:0.0:1746143739.601118:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11690 00000100:00100000:0.0:1746143739.601123:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963593448960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143739.601158:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.601177:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7db400/0xe984082ccd72b83f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4ea4 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.601202:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594079360:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.601220:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.602864:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593449472 00000100:00100000:0.0:1746143739.602869:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593449472 00000100:00100000:0.0:1746143739.602885:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593449728 00000100:00100000:0.0:1746143739.602887:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593449728 00000100:00100000:0.0:1746143739.602905:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11694 00000100:00100000:0.0:1746143739.602910:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963593449472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143739.602918:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.602924:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b7daa00/0xe984082ccd72b85b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4eb9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.602948:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594079872:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.602970:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.607712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.607751:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594079872:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143739.607767:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b7daa00/0xe984082ccd72b85b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4eb9 expref: 18 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.607775:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b7daa00/0xe984082ccd72b85b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4eb9 expref: 18 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.607785:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7daa00, rc 0) 00000100:00100000:0.0:1746143739.607802:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963593449472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4892us (5059us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143739.607817:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11694 00000100:00100000:0.0:1746143739.611852:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.616064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.617824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.625902:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.626054:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.635074:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.639330:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963593450624:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11134us (13268us total) trans 21474840114 rc 0/0 00000100:00100000:0.0:1746143739.639340:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1533 00002000:00100000:0.0:1746143739.639349:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4681727) req@ffff880093f01880 x1830963593450624/t21474840114(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:135/0 lens 488/448 e 0 to 0 dl 1746143750 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.639357:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01880 with x1830963593450624 ext(4194304->4681727) 00010000:00010000:0.0:1746143739.639365:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13c00/0xe984082ccd72b7ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e2d expref: 17 pid: 6929 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.640923:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf13c00/0xe984082ccd72b7ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4681727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4e2d expref: 17 pid: 6929 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746143739.640934:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f01880 00000100:00100000:0.0:1746143739.646584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.657387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.675407:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.679206:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.692061:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.701041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.707853:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593452160 00000100:00100000:0.0:1746143739.707861:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593452160 00002000:00100000:0.0:1746143739.707895:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009bfe2680 x1830963593452160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:135/0 lens 488/0 e 0 to 0 dl 1746143750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.707904:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830963593452160 ext(3145728->4194303) 00002000:00010000:0.0:1746143739.707909:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:0.0:1746143739.707923:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593452416 00000100:00100000:0.0:1746143739.707925:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593452416 00002000:00100000:0.0:1746143739.707935:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009bfe0700 x1830963593452416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:135/0 lens 488/0 e 0 to 0 dl 1746143750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.707940:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0700 with x1830963593452416 ext(3145728->4194303) 00002000:00010000:0.0:1746143739.707943:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0700 00000100:00100000:0.0:1746143739.707952:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5331 00000100:00100000:0.0:1746143739.707958:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963593452160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143739.729196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.729241:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.735602:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.746313:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.746917:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.747501:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11702 00000100:00100000:0.0:1746143739.747508:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963593453056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143739.747515:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.747528:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72b893 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4ef1 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.747560:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594081408:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.747666:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.756966:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.757114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.757564:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11704 00000100:00100000:0.0:1746143739.757571:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963593453440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143739.757578:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.757586:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2a00/0xe984082ccd72b8a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4f06 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.757609:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594081664:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.757632:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.844383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.844412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.844439:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.844474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.847586:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593453952 00000100:00100000:0.0:1746143739.847591:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593453952 00000100:00100000:0.0:1746143739.861763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.862096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.898384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.901695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.910798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.914586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.922711:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.930596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.930650:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.941366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.943888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.943907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.943929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.943941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.943967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.943986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.944630:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11714 00000100:00100000:0.0:1746143739.944636:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593456384:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143739.944641:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.944647:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2c00/0xe984082ccd72b911 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4f5a expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.944666:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594083072:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143739.944694:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.944706:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11715 00000100:00100000:0.0:1746143739.944710:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593456512:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143739.944714:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.944719:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2600/0xe984082ccd72b918 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4f61 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.944727:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.944729:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.944736:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2600/0xe984082ccd72b918 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f61 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.944757:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2600/0xe984082ccd72b918 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f61 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.944765:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5f2600, rc 0) 00000100:00100000:0.0:1746143739.944781:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593456512:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 71us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143739.944786:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11715 00000100:00100000:0.0:1746143739.944797:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11716 00000100:00100000:0.0:1746143739.944801:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593456640:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143739.944805:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143739.944810:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5f3a00/0xe984082ccd72b91f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4f68 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.944817:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.944818:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.944821:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5f3a00/0xe984082ccd72b91f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f68 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.944828:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d5f3a00/0xe984082ccd72b91f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f68 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.944834:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5f3a00, rc 0) 00000100:00100000:0.0:1746143739.944842:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593456640:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 41us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143739.944846:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11716 00000100:00100000:0.0:1746143739.945940:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594082816:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143739.945954:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd72b903 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f4c expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.945961:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd72b903 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f4c expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143739.945970:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511200, rc 0) 00000100:00100000:0.0:1746143739.945989:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593456128:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1579us (2080us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143739.945995:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11712 00000100:00100000:0.0:1746143739.947336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.947351:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593456896 00000100:00100000:0.0:1746143739.947355:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593456896 00010000:00010000:0.0:1746143739.947374:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff24e00/0xe984082ccd72b8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f37 expref: 17 pid: 21713 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746143739.947390:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6151 00000100:00100000:0.0:1746143739.947394:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:1965:x1830963593456896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143739.947402:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143739.947406:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff24e00/0xe984082ccd72b8e7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f37 expref: 17 pid: 21713 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.947412:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff24e00/0xe984082ccd72b8e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f37 expref: 17 pid: 21713 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.947433:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff24e00/0xe984082ccd72b8e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f37 expref: 17 pid: 21713 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.947451:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143739.947455:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd72b8f5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143739.947461:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd72b8f5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143739.947465:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd72b8f5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143739.947476:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143739.947493:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963593456896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143739.947498:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6151 00000100:00100000:0.0:1746143739.947528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.947538:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593456768 00000100:00100000:0.0:1746143739.947540:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593456768 00000100:00100000:0.0:1746143739.947556:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 689 00000100:00100000:0.0:1746143739.947560:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593456768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143739.947566:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143739.947568:0:7150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie e984082ccd72b7e4) 00010000:00010000:0.0:1746143739.947569:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143739.947580:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593456768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 20us (52us total) trans 0 rc 116/116 00000100:00100000:0.0:1746143739.947584:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 689 00000100:00100000:0.0:1746143739.951057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.953896:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.953947:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.954364:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.954828:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.960905:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.961577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.961591:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593458688 00000100:00100000:0.0:1746143739.961594:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593458688 00010000:00010000:0.0:1746143739.961607:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093326200/0xe984082ccd72b877 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4edc expref: 31 pid: 8497 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746143739.961633:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6155 00000100:00100000:0.0:1746143739.961639:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963593458688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143739.961646:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143739.961654:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093326200/0xe984082ccd72b877 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4edc expref: 31 pid: 8497 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.961663:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093326200/0xe984082ccd72b877 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4edc expref: 31 pid: 8497 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746143739.961675:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.961677:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143739.961683:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd72b92d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3428352->3514367) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f6f expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.961690:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd72b92d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3428352->3514367) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f6f expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143739.961713:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd72b92d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3428352->3514367) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f6f expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143739.961733:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594083840:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143739.961768:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143739.964856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.964875:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593458944 00000100:00100000:0.0:1746143739.964921:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593458944 00000100:00100000:0.0:1746143739.964959:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3703 00000100:00100000:0.0:1746143739.964966:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:30469:x1830963593458944:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143739.965649:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:30469:x1830963593458944:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 683us (793us total) trans 8589943053 rc 0/0 00000100:00100000:0.0:1746143739.965654:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3703 00000100:00100000:0.0:1746143739.971407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.971707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143739.971722:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593459840 00000100:00100000:0.0:1746143739.971724:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593459840 00002000:00100000:0.0:1746143739.971747:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880094304380 x1830963593459840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:135/0 lens 504/0 e 0 to 0 dl 1746143750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143739.971755:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830963593459840 ext(1048576->2097151) 00002000:00010000:0.0:1746143739.971759:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304380 00000100:00100000:0.0:1746143739.971783:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5340 00000100:00100000:0.0:1746143739.971788:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963593459840:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143739.973395:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593460096 00000100:00100000:0.0:1746143739.973400:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593460096 00000100:00100000:0.0:1746143739.973430:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3704 00000100:00100000:0.0:1746143739.973435:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+271:30472:x1830963593460096:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143739.973787:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+272:30472:x1830963593460096:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 350us (418us total) trans 8589943054 rc 0/0 00000100:00100000:0.0:1746143739.973793:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3704 00000100:00100000:0.0:1746143739.985938:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593460352 00000100:00100000:0.0:1746143739.985947:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593460352 00000100:00100000:0.0:1746143739.985996:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3705 00000100:00100000:0.0:1746143739.986003:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+19:30470:x1830963593460352:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143739.986182:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+20:30470:x1830963593460352:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 179us (330us total) trans 8589943055 rc 0/0 00000100:00100000:0.0:1746143739.986188:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3705 00000100:00100000:0.0:1746143739.997832:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.003744:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11720 00000100:00100000:0.0:1746143740.003753:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963593460864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.003760:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.003767:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095610e00/0xe984082ccd72b97a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4f92 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.003790:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594084224:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143740.003830:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.017362:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593461376 00000100:00100000:0.0:1746143740.017369:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593461376 00000100:00100000:0.0:1746143740.017749:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11723 00000100:00100000:0.0:1746143740.018668:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:30467:x1830963593461376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.018682:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.018778:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd72b98f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a4fae expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.018800:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd72b92d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3514367) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f6f expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.018807:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143740.018808:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143740.018811:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095610400/0xe984082ccd72b98f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4fae expref: 13 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.018833:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd72b92d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3514367) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f6f expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.018843:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d510600/0xe984082ccd72b92d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3428352->3514367) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f6f expref: 29 pid: 4581 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.018853:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594084608:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.019196:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.029786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.037096:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.039715:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.049749:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.051051:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.055027:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.063714:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.069103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.089072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.092240:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.098054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.105415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.105475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.105554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.105628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.136644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.156899:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.167280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.202111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.214870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.216685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.220881:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.228622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.237303:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.243171:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.246339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.259264:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.270831:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.270876:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.311995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.312026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.312136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.315930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.316586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.318890:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.328454:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.329049:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.339008:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.339912:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.347787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.355927:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.366392:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.366488:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.369448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.369486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.373527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.376349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.376367:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593470848 00000100:00100000:0.0:1746143740.376372:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593470848 00000100:00100000:0.0:1746143740.376424:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11735 00000100:00100000:0.0:1746143740.376431:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963593470848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.376443:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.376457:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b5c400/0xe984082ccd72ba0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5010 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.376498:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594087040:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143740.376550:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.376580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143740.384886:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143739 -> 1746143740 00002000:00010000:0.0:1746143740.384893:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143739 -> 1746143740 00002000:00010000:0.0:1746143740.384895:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143739 -> 1746143740 00000100:00100000:0.0:1746143740.384911:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594087040:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143740.384937:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093b5c400/0xe984082ccd72ba0d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5010 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.384960:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b5c400/0xe984082ccd72ba0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5010 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.385589:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093b5c400, rc 0) 00000100:00100000:0.0:1746143740.385645:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963593470848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9213us (9300us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143740.385652:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11735 00000100:00100000:0.0:1746143740.403751:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.406579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.423172:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963593471232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18208us (19428us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143740.423178:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5363 00002000:00100000:0.0:1746143740.423183:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f3caa00 x1830963593471232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/440 e 0 to 0 dl 1746143751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.423189:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3caa00 with x1830963593471232 ext(1048576->2097151) 00002000:00010000:0.0:1746143740.423192:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3caa00 00000100:00100000:0.0:1746143740.430694:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.434319:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.434363:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.436571:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.436598:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.438349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.439051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.439232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.439677:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11740 00000100:00100000:0.0:1746143740.439684:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593472640:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143740.439690:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.439698:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd72ba4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a503a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.439708:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.439709:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.439714:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd72ba4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a503a expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.439722:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd72ba4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a503a expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.439729:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336a200, rc 0) 00000100:00100000:0.0:1746143740.439873:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593472640:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 191us (3275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.440470:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11740 00000100:00100000:0.0:1746143740.448678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.450858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.453574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.467590:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.467663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.469507:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11747 00000100:00100000:0.0:1746143740.469515:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593474048:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143740.469523:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.469532:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336b800/0xe984082ccd72ba92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5072 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.469560:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e1e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594088448:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143740.469599:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.477271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.481597:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.483950:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.489339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.513683:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.517010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.526277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.543913:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.546602:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.546642:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.548107:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5367 00000100:00100000:0.0:1746143740.548114:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963593475584:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143740.549301:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5368 00000100:00100000:0.0:1746143740.549307:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593475968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143740.586761:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.587428:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.588827:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.601790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.601876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.605681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.606744:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593477248 00000100:00100000:0.0:1746143740.606748:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593477248 00002000:00100000:0.0:1746143740.606777:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3936256->3940351) req@ffff880094304e00 x1830963593477248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.606785:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963593477248 ext(3936256->3940351) 00010000:00010000:0.0:1746143740.606792:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955db800/0xe984082ccd72baae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5087 expref: 35 pid: 6929 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.606802:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955db800/0xe984082ccd72baae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5087 expref: 35 pid: 6929 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746143740.606808:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746143740.606821:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1544 00000100:00100000:0.0:1746143740.606826:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593477248:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143740.606996:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593477248:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 168us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143740.607001:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1544 00002000:00100000:0.0:1746143740.607006:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3936256->3940351) req@ffff880094304e00 x1830963593477248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746143751 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.607013:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963593477248 ext(3936256->3940351) 00010000:00010000:0.0:1746143740.607018:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800955db800/0xe984082ccd72baae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5087 expref: 35 pid: 6929 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.607026:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800955db800/0xe984082ccd72baae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5087 expref: 35 pid: 6929 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746143740.607031:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746143740.617707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.617759:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.641612:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.641661:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.643261:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.645022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.648870:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594089728:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143740.648888:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.648927:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593478400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3758us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.648936:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6176 00000100:00100000:0.0:1746143740.656482:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.656524:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.656568:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.657702:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5371 00000100:00100000:0.0:1746143740.657709:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963593478912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143740.684774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.687947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.703669:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593479552 00000100:00100000:0.0:1746143740.703681:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593479552 00010000:00010000:0.0:1746143740.703727:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72badf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50aa expref: 26 pid: 4582 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.704060:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6177 00000100:00100000:0.0:1746143740.704070:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593479552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.704086:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143740.704123:0:7150:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4735104 -> 4755392 00010000:00010000:0.0:1746143740.704130:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72badf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50aa expref: 26 pid: 4582 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.704163:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72badf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50aa expref: 26 pid: 4582 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.704187:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094456e00/0xe984082ccd72badf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50aa expref: 26 pid: 4582 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.704215:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.704217:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.704224:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955db400/0xe984082ccd72baed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50b8 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.704232:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800955db400/0xe984082ccd72baed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50b8 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.704265:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800955db400/0xe984082ccd72baed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50b8 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.704276:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc11500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594090112:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143740.704360:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.712530:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.712586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.728994:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.729052:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.733251:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.733285:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.733314:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.733328:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.733352:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593480576 00000100:00100000:0.0:1746143740.733360:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593480576 00010000:00010000:0.0:1746143740.733396:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd72ba4c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a503a expref: 7 pid: 6929 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143740.733429:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593480960 00000100:00100000:0.0:1746143740.733431:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593480960 00010000:00010000:0.0:1746143740.733444:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094677c00/0xe984082ccd72b996 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4fb5 expref: 35 pid: 21542 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.733779:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6178 00000100:00100000:0.0:1746143740.733786:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593480576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.733799:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143740.733820:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd72ba4c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a503a expref: 7 pid: 6929 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.733843:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd72ba4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a503a expref: 7 pid: 6929 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.734474:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.734521:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593480576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 735us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.734527:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6178 00000100:00100000:0.0:1746143740.737385:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.743809:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.750341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.751085:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.751941:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.751980:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6182 00000100:00100000:0.0:1746143740.751986:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963593481600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.751996:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143740.752006:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090744400/0xe984082ccd72b973 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f99 expref: 34 pid: 8495 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.752076:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090744400/0xe984082ccd72b973 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f99 expref: 34 pid: 8495 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.752539:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090744400/0xe984082ccd72b973 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4f99 expref: 34 pid: 8495 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.752559:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.752593:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963593481600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 607us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.752599:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6182 00000100:00100000:0.0:1746143740.756243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.802555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.822317:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.824548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.824585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.824623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.825724:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11760 00000100:00100000:0.0:1746143740.825769:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963593482624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.825786:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.825793:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ef9000/0xe984082ccd72bb2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a50e2 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.825845:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594091520:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143740.825909:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.825983:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.826038:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593482880 00000100:00100000:0.0:1746143740.826041:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593482880 00010000:00010000:0.0:1746143740.826061:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094768000/0xe984082ccd72bad1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50a3 expref: 44 pid: 14762 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.826079:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6184 00000100:00100000:0.0:1746143740.826085:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+44:1965:x1830963593482880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.826095:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143740.826101:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094768000/0xe984082ccd72bad1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50a3 expref: 44 pid: 14762 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.826111:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094768000/0xe984082ccd72bad1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50a3 expref: 44 pid: 14762 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.826130:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094768000/0xe984082ccd72bad1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50a3 expref: 44 pid: 14762 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.826182:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143740.826188:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5d800/0xe984082ccd72bb1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143740.826205:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5d800/0xe984082ccd72bb1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143740.826210:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5d800/0xe984082ccd72bb1e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143740.826232:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.829389:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+43:1965:x1830963593482880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3293us (3395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.829401:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6184 00002000:00010000:0.0:1746143740.830577:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143739 -> 1746143740 00002000:00010000:0.0:1746143740.830582:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143739 -> 1746143740 00002000:00010000:0.0:1746143740.830584:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143739 -> 1746143740 00000100:00100000:0.0:1746143740.830597:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594091520:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143740.830615:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ef9000/0xe984082ccd72bb2c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50e2 expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.830625:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ef9000/0xe984082ccd72bb2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50e2 expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.830633:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ef9000, rc 0) 00000100:00100000:0.0:1746143740.830668:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963593482624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4938us (6081us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143740.830674:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11760 00000100:00100000:0.0:1746143740.835569:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.835598:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593483520 00000100:00100000:0.0:1746143740.835606:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593483520 00000100:00100000:0.0:1746143740.835668:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11766 00000100:00100000:0.0:1746143740.835675:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:30510:x1830963593483520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.835693:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.835711:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e15ce00/0xe984082ccd72bb56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a510c expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.835741:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800955db800/0xe984082ccd72baf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50bf expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.835747:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143740.835749:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143740.835751:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e15ce00/0xe984082ccd72bb56 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a510c expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.835785:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800955db800/0xe984082ccd72baf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50bf expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.835797:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800955db800/0xe984082ccd72baf4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50bf expref: 16 pid: 6929 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.835810:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594092032:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.835891:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.839469:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.841224:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593483904 00000100:00100000:0.0:1746143740.841229:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593483904 00000100:00100000:0.0:1746143740.841260:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8835 00000100:00100000:0.0:1746143740.841266:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+23:30507:x1830963593483904:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143740.841291:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.841308:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72bb5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5113 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.841687:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72bb64 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143740.841701:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5d800/0xe984082ccd72bb1e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50d4 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.841707:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72bb64 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143740.841735:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5d800/0xe984082ccd72bb1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50d4 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.841744:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093b5d800/0xe984082ccd72bb1e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50d4 expref: 24 pid: 21713 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.841756:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594092160:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.841952:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.847270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.851955:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.855111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.859674:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.861573:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11769 00000100:00100000:0.0:1746143740.861581:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593485184:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143740.861600:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.861625:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd72bac3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a509c expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.861633:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093b5da00/0xe984082ccd72bb41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5105 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.861640:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd72bae6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50b1 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.861645:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.861646:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.861648:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.861665:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd72bae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50b1 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.861672:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094677e00/0xe984082ccd72bae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a50b1 expref: 17 pid: 4582 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.861680:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594092544:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143740.861712:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093b5da00/0xe984082ccd72bb41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5105 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.861718:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093b5da00/0xe984082ccd72bb41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5105 expref: 8 pid: 21542 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143740.861733:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594092672:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143740.861764:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd72bac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a509c expref: 33 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.861771:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd72bac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a509c expref: 33 pid: 4582 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.861777:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a71bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594092800:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.861793:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143740.861857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.867929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.868028:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594092544:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.868058:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594092672:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.868080:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a71bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594092800:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143740.869580:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.869691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.869728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.872784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.872833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.872848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.872872:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593485696 00000100:00100000:0.0:1746143740.872885:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593485696 00010000:00010000:0.0:1746143740.872921:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd72bac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a509c expref: 36 pid: 4582 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746143740.872944:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593486208 00000100:00100000:0.0:1746143740.872946:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593486208 00010000:00010000:0.0:1746143740.872955:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff600/0xe984082ccd72ba45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5033 expref: 11 pid: 8495 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143740.872966:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593485568 00000100:00100000:0.0:1746143740.872968:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593485568 00010000:00010000:0.0:1746143740.872978:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093b5da00/0xe984082ccd72bb41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5105 expref: 9 pid: 21542 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143740.872991:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6188 00000100:00100000:0.0:1746143740.872997:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963593485696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.873009:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143740.873031:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd72bac3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a509c expref: 36 pid: 4582 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.873041:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd72bac3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a509c expref: 36 pid: 4582 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.873063:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63fee00/0xe984082ccd72bac3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a509c expref: 36 pid: 4582 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746143740.873098:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.873134:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593485696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 136us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.873165:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6188 00000100:00100000:0.0:1746143740.873182:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6189 00000100:00100000:0.0:1746143740.873186:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593486208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.873195:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143740.873209:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff600/0xe984082ccd72ba45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5033 expref: 11 pid: 8495 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873217:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff600/0xe984082ccd72ba45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5033 expref: 11 pid: 8495 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873229:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63ff600/0xe984082ccd72ba45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5033 expref: 11 pid: 8495 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873238:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.873251:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593486208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.873257:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6189 00000100:00100000:0.0:1746143740.873287:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6190 00000100:00100000:0.0:1746143740.873292:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593485568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.873297:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143740.873304:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093b5da00/0xe984082ccd72bb41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5105 expref: 9 pid: 21542 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873311:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093b5da00/0xe984082ccd72bb41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5105 expref: 9 pid: 21542 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873330:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093b5da00/0xe984082ccd72bb41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5105 expref: 9 pid: 21542 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873340:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.873341:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.873346:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873354:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873375:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.873389:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593485568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.873395:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6190 00010000:00010000:0.0:1746143740.873425:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873434:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873454:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873462:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873477:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873484:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6164600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143740.873487:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873495:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873503:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.873508:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bb95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.873550:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593485184:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 11971us (13481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.873557:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11769 00000100:00100000:0.0:1746143740.873595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.873609:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593486080 00000100:00100000:0.0:1746143740.873611:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593486080 00010000:00010000:0.0:1746143740.873623:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72b99d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4fbc expref: 24 pid: 21542 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746143740.873633:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6191 00000100:00100000:0.0:1746143740.873641:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593486080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143740.873647:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143740.873653:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72b99d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4fbc expref: 24 pid: 21542 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873660:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72b99d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4fbc expref: 24 pid: 21542 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873668:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72b99d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4fbc expref: 24 pid: 21542 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746143740.873675:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143740.873687:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963593486080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.873692:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6191 00000100:00100000:0.0:1746143740.886768:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594093824:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.886778:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594093952:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143740.886785:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594094080:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143740.886806:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888069:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888076:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888097:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888103:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888107:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888111:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009336b200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143740.888113:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888118:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888125:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.888131:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009336b200/0xe984082ccd72bb8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.888188:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593484928:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 27391us (28141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.888195:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11768 00000100:00100000:0.0:1746143740.896763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.897124:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8837 00000100:00100000:0.0:1746143740.897134:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+43:30514:x1830963593487360:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143740.897175:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.897194:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b78a5c00/0xe984082ccd72bbb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5121 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.897281:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b78a4800/0xe984082ccd72bbc6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143740.897314:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b78a4800/0xe984082ccd72bbc6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143740.897321:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b78a4800/0xe984082ccd72bbc6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143740.897860:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.897925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.899528:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.904703:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593488384 00000100:00100000:0.0:1746143740.904708:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593488384 00002000:00100000:0.0:1746143740.904736:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009bfe0380 x1830963593488384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.904747:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963593488384 ext(1048576->2097151) 00002000:00010000:0.0:1746143740.904751:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746143740.904779:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5377 00000100:00100000:0.0:1746143740.904784:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963593488384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143740.914775:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593488896 00000100:00100000:0.0:1746143740.914785:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593488896 00000100:00100000:0.0:1746143740.914854:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3710 00000100:00100000:0.0:1746143740.914862:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+22:30507:x1830963593488896:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143740.915088:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+23:30507:x1830963593488896:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 227us (441us total) trans 8589943068 rc 0/0 00000100:00100000:0.0:1746143740.915095:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3710 00000100:00100000:0.0:1746143740.921109:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963593488384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16321us (17158us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143740.921121:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5377 00002000:00100000:0.0:1746143740.921133:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009bfe0380 x1830963593488384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/440 e 0 to 0 dl 1746143751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.921157:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0380 with x1830963593488384 ext(1048576->2097151) 00002000:00010000:0.0:1746143740.921163:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0380 00000100:00100000:0.0:1746143740.921191:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593489280 00000100:00100000:0.0:1746143740.921198:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593489280 00002000:00100000:0.0:1746143740.921227:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3440640->3444735) req@ffff88009ff6f480 x1830963593489280/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.921234:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963593489280 ext(3440640->3444735) 00002000:00010000:0.0:1746143740.921237:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6f480 00000100:00100000:0.0:1746143740.921252:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5378 00000100:00100000:0.0:1746143740.921257:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963593489280:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143740.921384:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963593489280:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 127us (1295us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143740.921389:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5378 00002000:00100000:0.0:1746143740.921393:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3440640->3444735) req@ffff88009ff6f480 x1830963593489280/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746143751 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.921420:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963593489280 ext(3440640->3444735) 00002000:00010000:0.0:1746143740.921423:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6f480 00000100:00100000:0.0:1746143740.928118:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.943528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.956460:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.972728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.972767:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.972813:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.972830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.972868:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.972884:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593490560 00000100:00100000:0.0:1746143740.972888:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593490560 00000100:00100000:0.0:1746143740.972906:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593490816 00000100:00100000:0.0:1746143740.972908:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593490816 00000100:00100000:0.0:1746143740.973244:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11777 00000100:00100000:0.0:1746143740.973250:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963593490432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.973257:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.973268:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6165e00/0xe984082ccd72bbf7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a514b expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143740.973285:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x681409fc, atime: 0x681409fc, ctime: 0x681409fc, blocks: 0x821 00010000:00010000:0.0:1746143740.973293:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973295:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973299:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6165e00/0xe984082ccd72bbf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a514b expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973309:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6165e00/0xe984082ccd72bbf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a514b expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973326:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6165e00, rc 0) 00000100:00100000:0.0:1746143740.973342:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963593490432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 93us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.973347:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11777 00000100:00100000:0.0:1746143740.973374:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11778 00000100:00100000:0.0:1746143740.973377:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963593490560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.973382:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.973388:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72bbfe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5152 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.973398:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973399:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973402:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72bbfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5152 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973418:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72bbfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5152 expref: 21 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973424:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6164a00, rc 0) 00000100:00100000:0.0:1746143740.973436:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963593490560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.973440:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11778 00000100:00100000:0.0:1746143740.973449:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11779 00000100:00100000:0.0:1746143740.973453:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593490688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.973465:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.973472:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6164c00/0xe984082ccd72bc05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5159 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.973481:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973482:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973486:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6164c00/0xe984082ccd72bc05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5159 expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973494:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6164c00/0xe984082ccd72bc05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5159 expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973501:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6164c00, rc 0) 00000100:00100000:0.0:1746143740.973514:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963593490688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 61us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.973519:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11779 00000100:00100000:0.0:1746143740.973529:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11780 00000100:00100000:0.0:1746143740.973532:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593490816:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.973537:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.973542:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938c0200/0xe984082ccd72bc0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5160 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143740.973553:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4755392, mtime: 0x681409fc, atime: 0x681409fc, ctime: 0x681409fc, blocks: 0x1467 00010000:00010000:0.0:1746143740.973560:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973561:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.973564:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938c0200/0xe984082ccd72bc0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5160 expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973582:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938c0200/0xe984082ccd72bc0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5160 expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.973589:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938c0200, rc 0) 00000100:00100000:0.0:1746143740.973602:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963593490816:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.973607:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11780 00000100:00100000:0.0:1746143740.975342:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.975372:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.976325:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.976730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.978220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.978272:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11782 00000100:00100000:0.0:1746143740.978278:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963593491072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.978291:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.978306:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bc13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a516e expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.978327:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.978329:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.978337:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bc13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a516e expref: 35 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.978351:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72bc13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a516e expref: 35 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.978373:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6164600, rc 0) 00000100:00100000:0.0:1746143740.978402:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963593491072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 124us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.978407:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11782 00000100:00100000:0.0:1746143740.978432:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11783 00000100:00100000:0.0:1746143740.978437:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963593491200:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.978443:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.978450:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72bc21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5175 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143740.978459:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.978460:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143740.978463:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72bc21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5175 expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.978473:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72bc21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5175 expref: 28 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143740.978479:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938c1e00, rc 0) 00000100:00100000:0.0:1746143740.978494:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963593491200:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143740.978499:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11783 00000100:00100000:0.0:1746143740.978512:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11785 00000100:00100000:0.0:1746143740.978517:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963593491456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143740.978528:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143740.978535:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093327000/0xe984082ccd72bc2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a517c expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143740.978560:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594094592:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143740.983540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.984128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.989217:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143740.990920:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593491968 00000100:00100000:0.0:1746143740.990930:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593491968 00002000:00100000:0.0:1746143740.990975:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f1ef100 x1830963593491968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.990985:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef100 with x1830963593491968 ext(2097152->3145727) 00002000:00010000:0.0:1746143740.990990:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ef100 00000100:00100000:0.0:1746143740.991014:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593492480 00000100:00100000:0.0:1746143740.991017:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593492480 00002000:00100000:0.0:1746143740.991031:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a5c20a80 x1830963593492480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.991037:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20a80 with x1830963593492480 ext(1048576->2097151) 00002000:00010000:0.0:1746143740.991041:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c20a80 00000100:00100000:0.0:1746143740.991050:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593492352 00000100:00100000:0.0:1746143740.991052:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593492352 00002000:00100000:0.0:1746143740.991061:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a5c23100 x1830963593492352/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.991067:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23100 with x1830963593492352 ext(1048576->2097151) 00002000:00010000:0.0:1746143740.991071:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c23100 00000100:00100000:0.0:1746143740.991102:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593492736 00000100:00100000:0.0:1746143740.991105:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593492736 00002000:00100000:0.0:1746143740.991119:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a5c23480 x1830963593492736/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.991126:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23480 with x1830963593492736 ext(0->1048575) 00002000:00010000:0.0:1746143740.991128:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c23480 00000100:00100000:0.0:1746143740.991158:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5381 00000100:00100000:0.0:1746143740.991166:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963593491968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143740.994177:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593492992 00000100:00100000:0.0:1746143740.994185:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593492992 00002000:00100000:0.0:1746143740.994225:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1859584->1863679) req@ffff8800a5c22680 x1830963593492992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/0 e 0 to 0 dl 1746143751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.994234:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22680 with x1830963593492992 ext(1859584->1863679) 00002000:00010000:0.0:1746143740.994239:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c22680 00000100:00100000:0.0:1746143740.994262:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5385 00000100:00100000:0.0:1746143740.994268:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963593492992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143740.994505:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963593492992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 236us (1427us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143740.994511:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5385 00002000:00100000:0.0:1746143740.994517:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1859584->1863679) req@ffff8800a5c22680 x1830963593492992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746143751 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143740.994524:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22680 with x1830963593492992 ext(1859584->1863679) 00002000:00010000:0.0:1746143740.994527:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c22680 00000100:00100000:0.0:1746143741.033641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.035708:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.037541:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.046053:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593493760 00000100:00100000:0.0:1746143741.046058:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593493760 00010000:00010000:0.0:1746143741.046078:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72bc21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5175 expref: 27 pid: 8496 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.046098:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6205 00000100:00100000:0.0:1746143741.046102:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963593493760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143741.046110:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143741.046133:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72bc21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5175 expref: 27 pid: 8496 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.046167:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72bc21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5175 expref: 27 pid: 8496 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.046185:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938c1e00/0xe984082ccd72bc21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5175 expref: 27 pid: 8496 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.046199:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.046200:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.046207:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f06ce00/0xe984082ccd72bc36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5191 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.046214:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f06ce00/0xe984082ccd72bc36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5191 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.046235:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f06ce00/0xe984082ccd72bc36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5191 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143741.046254:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594095488:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143741.046291:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143741.055646:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594095488:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143741.055666:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143741.055703:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593493760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9599us (10167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.055712:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6205 00000100:00100000:0.0:1746143741.055761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.055857:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.067860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.069061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.077224:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594095744:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143741.077253:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143741.077314:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963593494400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8121us (8253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.077326:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6207 00000100:00100000:0.0:1746143741.085537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.087808:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.089634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.089656:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593495168 00000100:00100000:0.0:1746143741.089661:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593495168 00002000:00100000:0.0:1746143741.089686:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009bf04380 x1830963593495168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:137/0 lens 488/0 e 0 to 0 dl 1746143752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143741.089695:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bf04380 with x1830963593495168 ext(2097152->3145727) 00002000:00010000:0.0:1746143741.089705:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bf04380 00000100:00100000:0.0:1746143741.089718:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593495296 00000100:00100000:0.0:1746143741.089721:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593495296 00002000:00100000:0.0:1746143741.089733:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009bf04700 x1830963593495296/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:137/0 lens 488/0 e 0 to 0 dl 1746143752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143741.089740:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bf04700 with x1830963593495296 ext(3145728->4194303) 00002000:00010000:0.0:1746143741.089742:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bf04700 00000100:00100000:0.0:1746143741.089753:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5389 00000100:00100000:0.0:1746143741.089758:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bf04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963593495168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143741.119806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.124843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.128392:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593495936 00000100:00100000:0.0:1746143741.128398:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593495936 00002000:00100000:0.0:1746143741.128438:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2465791) req@ffff88009bfe1c00 x1830963593495936/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:137/0 lens 488/0 e 0 to 0 dl 1746143752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143741.128447:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963593495936 ext(2097152->2465791) 00010000:00010000:0.0:1746143741.128453:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f06ce00/0xe984082ccd72bc36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5191 expref: 27 pid: 15784 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143741.128465:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f06ce00/0xe984082ccd72bc36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2465791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5191 expref: 27 pid: 15784 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746143741.128471:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe1c00 00000100:00100000:0.0:1746143741.128491:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1552 00000100:00100000:0.0:1746143741.128498:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963593495936:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143741.142349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.148822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.156467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.156504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.156536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.218651:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.285630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.291947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.295380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.300836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.310646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.319282:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.324566:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.332922:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.430901:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.432040:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.445931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.445987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.449698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.481797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.486073:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.486112:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.486161:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.486187:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.486266:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593501184 00000100:00100000:0.0:1746143741.486270:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593501184 00002000:00100000:0.0:1746143741.486287:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f00e00 x1830963593501184/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:137/0 lens 488/0 e 0 to 0 dl 1746143752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143741.486308:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00e00 with x1830963593501184 ext(2097152->3145727) 00002000:00010000:0.0:1746143741.486311:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f00e00 00000100:00100000:0.0:1746143741.486328:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5403 00000100:00100000:0.0:1746143741.486334:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963593501184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143741.515401:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.525287:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.531337:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.534069:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.535103:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.541279:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594098048:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.541313:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0aa1400/0xe984082ccd72bcad lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5201 expref: 27 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.541331:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0aa1400, rc 0) 00000100:00100000:0.0:1746143741.541382:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:30537:x1830963593502464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4416us (6278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.541391:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11803 00000100:00100000:0.0:1746143741.543199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.547359:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593503360 00000100:00100000:0.0:1746143741.547367:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593503360 00000100:00100000:0.0:1746143741.547419:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11804 00000100:00100000:0.0:1746143741.547427:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:30528:x1830963593503360:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143741.547443:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.547460:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0fc600/0xe984082ccd72bcb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5208 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.547491:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f06cc00/0xe984082ccd72bc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a51c9 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.547497:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143741.547498:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143741.547502:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0fc600/0xe984082ccd72bcb4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->3911679] (req 3145728->3911679) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5208 expref: 35 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.547545:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f06cc00/0xe984082ccd72bc75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a51c9 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.547555:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f06cc00/0xe984082ccd72bc75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a51c9 expref: 22 pid: 8497 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746143741.547568:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594098304:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143741.547653:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143741.555843:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594098304:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.555868:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0fc600/0xe984082ccd72bcb4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->3911679] (req 3145728->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5208 expref: 35 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.555882:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0fc600, rc 0) 00000100:00100000:0.0:1746143741.555916:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:30528:x1830963593503360:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8489us (8629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.555923:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11804 00000100:00100000:0.0:1746143741.555998:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.564696:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593503744 00000100:00100000:0.0:1746143741.564700:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593503744 00000100:00100000:0.0:1746143741.564734:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11805 00000100:00100000:0.0:1746143741.564738:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:30532:x1830963593503744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143741.564749:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.564764:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff91e00/0xe984082ccd72bcbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a520f expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.564778:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143741.564779:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143741.564782:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff91e00/0xe984082ccd72bcbb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a520f expref: 36 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.564790:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff91e00/0xe984082ccd72bcbb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a520f expref: 36 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.564797:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff91e00, rc 0) 00000100:00100000:0.0:1746143741.564818:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:30532:x1830963593503744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.564822:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11805 00000100:00100000:0.0:1746143741.571088:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.576929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.586632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.587346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.599922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.604963:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.611750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.635191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.638270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.647257:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.661628:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.665598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.725659:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.732758:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.733036:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.735350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.740836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.746615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.747948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.747977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.752095:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.761543:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.771474:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.771520:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.775455:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.776055:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.776355:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.776713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.776727:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593509248 00000100:00100000:0.0:1746143741.776729:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593509248 00000100:00100000:0.0:1746143741.777198:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593509760 00000100:00100000:0.0:1746143741.777202:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593509760 00000100:00100000:0.0:1746143741.777216:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11815 00000100:00100000:0.0:1746143741.777220:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593509248:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143741.777226:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.777232:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff91800/0xe984082ccd72bd1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5247 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.777252:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.777253:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.777257:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff91800/0xe984082ccd72bd1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5247 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.777266:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff91800/0xe984082ccd72bd1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5247 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.777271:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff91800, rc 0) 00000100:00100000:0.0:1746143741.777288:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593509248:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 68us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.777293:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11815 00000100:00100000:0.0:1746143741.777303:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11816 00000100:00100000:0.0:1746143741.777307:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593509760:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143741.777312:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.777317:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff91000/0xe984082ccd72bd24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5263 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.777326:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.777327:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.777330:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff91000/0xe984082ccd72bd24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5263 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.777338:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff91000/0xe984082ccd72bd24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5263 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.777353:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff91000, rc 0) 00000100:00100000:0.0:1746143741.777367:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593509760:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.777371:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11816 00000100:00100000:0.0:1746143741.786702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.791976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.796999:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.799943:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.803017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.803051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.803077:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.803101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.803114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.803134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.803172:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593510656 00000100:00100000:0.0:1746143741.803178:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593510656 00000100:00100000:0.0:1746143741.803201:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593510784 00000100:00100000:0.0:1746143741.803203:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593510784 00000100:00100000:0.0:1746143741.803214:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593510912 00000100:00100000:0.0:1746143741.803215:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593510912 00000100:00100000:0.0:1746143741.803223:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593511040 00000100:00100000:0.0:1746143741.803225:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593511040 00000100:00100000:0.0:1746143741.803231:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593511168 00000100:00100000:0.0:1746143741.803233:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593511168 00000100:00100000:0.0:1746143741.803239:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593511296 00000100:00100000:0.0:1746143741.803241:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593511296 00000100:00100000:0.0:1746143741.803250:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11817 00000100:00100000:0.0:1746143741.803255:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593510656:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143741.803300:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.803315:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72bbf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5144 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803322:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800955dba00/0xe984082ccd72bd01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5240 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803328:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e15b000/0xe984082ccd72bc1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5167 expref: 29 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803333:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.803335:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.803337:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.803359:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e15b000/0xe984082ccd72bc1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5167 expref: 29 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803370:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e15b000/0xe984082ccd72bc1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5167 expref: 29 pid: 15784 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.803380:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594100608:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.803453:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800955dba00/0xe984082ccd72bd01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5240 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803468:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800955dba00/0xe984082ccd72bd01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5240 expref: 8 pid: 15784 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.803475:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594100864:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.803495:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72bbf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5144 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803502:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72bbf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5144 expref: 25 pid: 6929 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.803509:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594101120:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143741.803520:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143741.803536:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11819 00000100:00100000:0.0:1746143741.803541:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593510912:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143741.803555:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b78a4800/0xe984082ccd72bd6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.803565:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd72bbcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a512f expref: 37 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.803571:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936cc800/0xe984082ccd72bd08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a524e expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803577:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72bbfe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5152 expref: 24 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803587:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.803588:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.803590:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b78a4800/0xe984082ccd72bd6a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.803603:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72bbfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5152 expref: 24 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803610:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72bbfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5152 expref: 24 pid: 8496 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.803617:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594101376:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.803639:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936cc800/0xe984082ccd72bd08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a524e expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.803646:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936cc800/0xe984082ccd72bd08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a524e expref: 10 pid: 8497 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.803653:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594101632:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.803668:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd72bbcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a512f expref: 37 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.803675:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd72bbcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a512f expref: 37 pid: 12618 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746143741.803690:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594101760:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143741.803702:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143741.807039:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.807091:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.811451:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594101248:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.811470:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143741.812651:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.813891:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594101120:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143741.813912:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143741.824236:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593512832 00000100:00100000:0.0:1746143741.824241:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593512832 00010000:00010000:0.0:1746143741.824262:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff91000/0xe984082ccd72bd24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5263 expref: 8 pid: 9527 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.824278:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593512960 00000100:00100000:0.0:1746143741.824280:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593512960 00010000:00010000:0.0:1746143741.824289:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72bbf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5144 expref: 30 pid: 6929 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746143741.824302:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6234 00000100:00100000:0.0:1746143741.824306:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593512832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143741.824320:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143741.824332:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff91000/0xe984082ccd72bd24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5263 expref: 8 pid: 9527 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.824339:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff91000/0xe984082ccd72bd24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5263 expref: 8 pid: 9527 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.824351:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff91000/0xe984082ccd72bd24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5263 expref: 8 pid: 9527 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.824370:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143741.824387:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593512832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.824393:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6234 00000100:00100000:0.0:1746143741.824414:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6235 00000100:00100000:0.0:1746143741.824419:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963593512960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143741.824424:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143741.824436:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72bbf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5144 expref: 30 pid: 6929 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.824443:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72bbf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5144 expref: 30 pid: 6929 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.824454:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72bbf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5144 expref: 30 pid: 6929 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746143741.824472:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.824474:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.824477:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824483:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824499:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143741.824513:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963593512960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.824519:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6235 00010000:00010000:0.0:1746143741.824541:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824547:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824562:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824569:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824574:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824588:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936cd000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143741.824591:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824596:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824605:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824610:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936cd000/0xe984082ccd72bd63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143741.824640:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593510784:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 21263us (21588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.824645:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11818 00010000:00010000:0.0:1746143741.824663:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824668:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824681:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824687:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824696:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824700:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff90400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143741.824702:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824708:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824715:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.824720:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff90400/0xe984082ccd72bd5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143741.824750:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593510656:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 21495us (21737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.824755:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11817 00000100:00100000:0.0:1746143741.830667:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.831470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.835844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.845356:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593514240 00000100:00100000:0.0:1746143741.845362:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593514240 00000100:00100000:0.0:1746143741.845393:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593514496 00000100:00100000:0.0:1746143741.845394:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593514496 00000100:00100000:0.0:1746143741.845432:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3714 00000100:00100000:0.0:1746143741.845438:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:15421:x1830963593514240:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143741.845609:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:15421:x1830963593514240:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 171us (328us total) trans 8589943074 rc 0/0 00000100:00100000:0.0:1746143741.845615:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3714 00000100:00100000:0.0:1746143741.845647:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.845662:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593514624 00000100:00100000:0.0:1746143741.845665:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593514624 00010000:00010000:0.0:1746143741.845674:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7c7400/0xe984082ccd72ae91 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4868 expref: 12 pid: 21713 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746143741.845687:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6242 00000100:00100000:0.0:1746143741.845691:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963593514624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143741.845697:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143741.845700:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7c7400/0xe984082ccd72ae91 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4868 expref: 12 pid: 21713 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143741.845715:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7c7400/0xe984082ccd72ae91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4868 expref: 12 pid: 21713 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143741.845726:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7c7400/0xe984082ccd72ae91 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a4868 expref: 12 pid: 21713 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143741.845735:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143741.845738:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c58fc00/0xe984082ccd72bd86 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143741.845743:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143741.845762:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963593514624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.845767:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6242 00000100:00100000:0.0:1746143741.845819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.848545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.848589:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00010000:0.0:1746143741.871321:0:14764:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f680a80 reply state ffff8800935abc00 transno 8589943076 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c58fc00/0xe984082ccd72bd86 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143741.871331:0:14764:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746143741.871423:0:14764:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746143741.871437:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30545:x1830963593513728:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 35388us (35594us total) trans 8589943076 rc 0/0 00000100:00100000:0.0:1746143741.871444:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8844 00000100:00100000:0.0:1746143741.873451:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11828 00000100:00100000:0.0:1746143741.873457:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963594104192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143741.873636:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963594104192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (335us total) trans 17179872828 rc 0/0 00000100:00100000:0.0:1746143741.873641:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11828 00000100:00100000:0.0:1746143741.874328:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11836 00000100:00100000:0.0:1746143741.874334:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594105088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143741.874373:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11837 00000100:00100000:0.0:1746143741.874377:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594105216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143741.874418:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11838 00000100:00100000:0.0:1746143741.874422:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594104704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143741.875474:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594105216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1095us (1400us total) trans 21474840133 rc 0/0 00000100:00100000:0.0:1746143741.875486:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11837 00000100:00100000:0.0:1746143741.875555:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594104704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1132us (1502us total) trans 21474840134 rc 0/0 00000100:00100000:0.0:1746143741.875560:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11838 00000100:00100000:0.0:1746143741.875965:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594105472 00000100:00100000:0.0:1746143741.875970:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594105472 00000100:00100000:0.0:1746143741.876387:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11839 00000100:00100000:0.0:1746143741.876395:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594105472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143741.876534:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594105472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (897us total) trans 21474840135 rc 0/0 00000100:00100000:0.0:1746143741.876540:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11839 00000100:00100000:0.0:1746143741.876557:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593515264 00000100:00100000:0.0:1746143741.876561:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593515264 00000100:00100000:0.0:1746143741.876968:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8845 00000100:00100000:0.0:1746143741.876974:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:30545:x1830963593515264:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143741.876987:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.877001:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093489a00/0xe984082ccd72bd8d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a527f expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.877040:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093489a00/0xe984082ccd72bd8d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a527f expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.877051:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093489a00/0xe984082ccd72bd8d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a527f expref: 8 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.877065:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143741.877067:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143741.877076:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093489a00, rc 0) 00000100:00100000:0.0:1746143741.877115:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30545:x1830963593515264:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 141us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.877121:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8845 00000100:00100000:0.0:1746143741.883918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.889104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.892751:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.906842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.907506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.911435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.911480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.912665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.913418:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11843 00000100:00100000:0.0:1746143741.913424:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963593517312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143741.913431:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.913436:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093488200/0xe984082ccd72bdfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a529b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.913453:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.913455:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.913461:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093488200/0xe984082ccd72bdfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a529b expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.913470:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093488200/0xe984082ccd72bdfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a529b expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.913477:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093488200, rc 0) 00000100:00100000:0.0:1746143741.913956:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963593517312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 531us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.913969:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11843 00000100:00100000:0.0:1746143741.913991:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11844 00000100:00100000:0.0:1746143741.913996:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963593517184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143741.914002:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.914008:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093488e00/0xe984082ccd72be04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a52b7 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143741.914019:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x681409fc, atime: 0x681409fb, ctime: 0x681409fc, blocks: 0x81f 00010000:00010000:0.0:1746143741.914027:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914028:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914031:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093488e00/0xe984082ccd72be04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b7 expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914038:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093488e00/0xe984082ccd72be04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b7 expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914044:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093488e00, rc 0) 00000100:00100000:0.0:1746143741.914065:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963593517184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.914069:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11844 00000100:00100000:0.0:1746143741.914079:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593517568 00000100:00100000:0.0:1746143741.914082:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593517568 00000100:00100000:0.0:1746143741.914091:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593517696 00000100:00100000:0.0:1746143741.914092:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593517696 00000100:00100000:0.0:1746143741.914098:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593517824 00000100:00100000:0.0:1746143741.914099:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593517824 00000100:00100000:0.0:1746143741.914106:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11845 00000100:00100000:0.0:1746143741.914114:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963593517440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143741.914120:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.914127:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093488a00/0xe984082ccd72be0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a52be expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143741.914158:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x681409fd, atime: 0x681409fb, ctime: 0x681409fd, blocks: 0x81f 00010000:00010000:0.0:1746143741.914167:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914168:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914172:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093488a00/0xe984082ccd72be0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52be expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914180:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093488a00/0xe984082ccd72be0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52be expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914186:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093488a00, rc 0) 00000100:00100000:0.0:1746143741.914206:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963593517440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.914211:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11845 00000100:00100000:0.0:1746143741.914222:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11847 00000100:00100000:0.0:1746143741.914227:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963593517696:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143741.914232:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.914237:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093488400/0xe984082ccd72be19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a52c5 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.914247:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914248:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914251:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093488400/0xe984082ccd72be19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52c5 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914265:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093488400/0xe984082ccd72be19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52c5 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914271:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093488400, rc 0) 00000100:00100000:0.0:1746143741.914286:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963593517696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.914291:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11847 00000100:00100000:0.0:1746143741.914301:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11849 00000100:00100000:0.0:1746143741.914305:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963593517952:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143741.914311:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.914316:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093489e00/0xe984082ccd72be27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a52da expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.914325:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914326:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914330:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093489e00/0xe984082ccd72be27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52da expref: 32 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914336:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093489e00/0xe984082ccd72be27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52da expref: 32 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914342:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093489e00, rc 0) 00000100:00100000:0.0:1746143741.914355:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963593517952:12345-192.168.202.48@tcp:101:cat.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.914359:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11849 00000100:00100000:0.0:1746143741.914375:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11851 00000100:00100000:0.0:1746143741.914379:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963593518208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143741.914385:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143741.914389:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093488800/0xe984082ccd72be35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a52e8 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.914399:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914411:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143741.914415:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093488800/0xe984082ccd72be35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52e8 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914423:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093488800/0xe984082ccd72be35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52e8 expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143741.914430:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093488800, rc 0) 00000100:00100000:0.0:1746143741.914446:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963593518208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 67us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143741.914451:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11851 00000100:00100000:0.0:1746143741.917606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.918013:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6247 00000100:00100000:0.0:1746143741.918043:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1965:x1830963593518336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143741.918055:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143741.918060:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081cc00/0xe984082ccd72bdcc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5286 expref: 244 pid: 14762 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143741.918069:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081cc00/0xe984082ccd72bdcc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5286 expref: 244 pid: 14762 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143741.918098:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081cc00/0xe984082ccd72bdcc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5286 expref: 244 pid: 14762 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746143741.918256:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143741.918261:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143741.918268:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143741.918273:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143741.918592:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.918894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.919281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143741.919332:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143741.919338:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143741.919352:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8929408 00010000:00010000:0.0:1746143741.919479:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd72bde8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b0 expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.919489:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b0 expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143741.919544:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143741.919547:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143741.919554:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081c200, rc 0) 00000100:00100000:0.0:1746143741.919573:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:30551:x1830963593517056:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6614us (6910us total) trans 8589943081 rc 0/0 00000100:00100000:0.0:1746143741.919578:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8848 00000100:00100000:0.0:1746143741.929412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.929467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.930803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.931665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.940876:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.940917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.940947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.940971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143741.941012:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593520640 00000100:00100000:0.0:1746143741.941015:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593520640 00002000:00100000:0.0:1746143741.941040:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a62f8000 x1830963593520640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:137/0 lens 488/0 e 0 to 0 dl 1746143752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143741.941049:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62f8000 with x1830963593520640 ext(1048576->2097151) 00002000:00010000:0.0:1746143741.941054:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62f8000 00000100:00100000:0.0:1746143741.941067:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593521152 00000100:00100000:0.0:1746143741.941069:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593521152 00002000:00100000:0.0:1746143741.941077:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009bfe3480 x1830963593521152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:137/0 lens 488/0 e 0 to 0 dl 1746143752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143741.941084:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830963593521152 ext(1048576->2097151) 00002000:00010000:0.0:1746143741.941087:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3480 00000100:00100000:0.0:1746143741.941097:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5418 00000100:00100000:0.0:1746143741.941102:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963593520640:12345-192.168.202.48@tcp:3:multiop.0 00000004:00080000:0.0:1746143741.986229:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093501f80/2, rc 0, transno 17179872833 00000100:00100000:0.0:1746143741.986233:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594107392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143741.986239:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093503b80/2, rc 0, transno 17179872834 00000100:00100000:0.0:1746143741.986242:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594107904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143741.986247:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093502a00/2, rc 0, transno 17179872832 00000100:00100000:0.0:1746143741.986249:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594108032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143741.986255:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093500000/2, rc 0, transno 17179872831 00000100:00100000:0.0:1746143741.986257:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594107520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143741.986281:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594107776 00000100:00100000:0.0:1746143741.986284:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594107776 00000100:00100000:0.0:1746143741.986297:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594108160 00000100:00100000:0.0:1746143741.986299:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594108160 00000100:00100000:0.0:1746143741.986434:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11866 00000100:00100000:0.0:1746143741.986439:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963594107776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143741.986509:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143741.986511:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143741.986513:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143741.986514:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143741.986516:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143741.986537:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963594107776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (338us total) trans 17179872836 rc 0/0 00000100:00100000:0.0:1746143741.986542:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11866 00000100:00100000:0.0:1746143741.986552:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11867 00000100:00100000:0.0:1746143741.986556:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963594107648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143741.986631:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143741.986634:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143741 -> 1746143741 00002000:00010000:0.0:1746143741.986635:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143741 -> 1746143741 00002000:00010000:0.0:1746143741.986637:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143741 -> 1746143741 00002000:00010000:0.0:1746143741.986639:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746143741.986657:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963594107648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (410us total) trans 17179872837 rc 0/0 00000100:00100000:0.0:1746143741.986662:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11867 00000100:00100000:0.0:1746143741.986707:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963594108160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (437us total) trans 17179872838 rc 0/0 00000100:00100000:0.0:1746143741.986712:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11868 00000100:00100000:0.0:1746143741.996347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.000045:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.003262:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594108416:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.003285:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594108544:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.003307:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72be89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [2076672->2097151] (req 2076672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5312 expref: 39 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.003318:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bedbe00, rc 0) 00000100:00100000:0.0:1746143742.003349:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:30551:x1830963593522048:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3037us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.003355:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11869 00000100:00100000:0.0:1746143742.016586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.017193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.018373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.019458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.023394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.041812:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.049463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.052693:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593523968 00000100:00100000:0.0:1746143742.052700:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593523968 00002000:00100000:0.0:1746143742.052744:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012e17d880 x1830963593523968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:138/0 lens 488/0 e 0 to 0 dl 1746143753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.052751:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17d880 with x1830963593523968 ext(1048576->2097151) 00002000:00010000:0.0:1746143742.052755:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17d880 00000100:00100000:0.0:1746143742.053093:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5427 00000100:00100000:0.0:1746143742.053099:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963593523968:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143742.054953:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963593523584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12955us (13147us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143742.054960:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5426 00002000:00100000:0.0:1746143742.054968:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880094c0f480 x1830963593523584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:138/0 lens 488/440 e 0 to 0 dl 1746143753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.054976:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f480 with x1830963593523584 ext(1048576->2097151) 00002000:00010000:0.0:1746143742.054979:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0f480 00000100:00100000:0.0:1746143742.057703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.069906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.069943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.069966:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.075530:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.087251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.087298:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.087322:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.087354:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.087372:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593525248 00000100:00100000:0.0:1746143742.087375:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593525248 00002000:00100000:0.0:1746143742.087392:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a8fdf480 x1830963593525248/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:138/0 lens 488/0 e 0 to 0 dl 1746143753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.087398:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fdf480 with x1830963593525248 ext(3145728->4194303) 00002000:00010000:0.0:1746143742.087411:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fdf480 00000100:00100000:0.0:1746143742.087422:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593525760 00000100:00100000:0.0:1746143742.087424:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593525760 00002000:00100000:0.0:1746143742.087434:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a8fde300 x1830963593525760/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:138/0 lens 488/0 e 0 to 0 dl 1746143753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.087440:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fde300 with x1830963593525760 ext(3145728->4194303) 00002000:00010000:0.0:1746143742.087442:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fde300 00000100:00100000:0.0:1746143742.087565:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5430 00000100:00100000:0.0:1746143742.087571:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963593525248:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143742.097562:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.097594:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.097615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.097634:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.098783:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5435 00000100:00100000:0.0:1746143742.098791:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963593526272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143742.113844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.122674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.128268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.138555:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.152172:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.152220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.152240:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593527552 00000100:00100000:0.0:1746143742.152247:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593527552 00000100:00100000:0.0:1746143742.153900:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593527680 00000100:00100000:0.0:1746143742.153904:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593527680 00000100:00100000:0.0:1746143742.161669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.167115:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.171951:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593528192 00000100:00100000:0.0:1746143742.171959:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593528192 00000100:00100000:0.0:1746143742.171990:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593528320 00000100:00100000:0.0:1746143742.171992:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593528320 00000100:00100000:0.0:1746143742.172006:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11877 00000100:00100000:0.0:1746143742.172012:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963593528192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.172028:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.172041:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd72bec1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a534a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143742.172086:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594110080:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143742.172167:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.173354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.173536:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594110080:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143742.173550:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd72bec1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a534a expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.173559:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd72bec1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a534a expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.173578:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1c00, rc 0) 00000100:00100000:0.0:1746143742.173598:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593528192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1585us (1810us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143742.173604:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11877 00000100:00100000:0.0:1746143742.173617:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593528448 00000100:00100000:0.0:1746143742.173620:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593528448 00000100:00100000:0.0:1746143742.174041:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11879 00000100:00100000:0.0:1746143742.174047:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:30557:x1830963593528448:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143742.174054:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.174062:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff47400/0xe984082ccd72becf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5358 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.174079:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b30e00/0xe984082ccd72be12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52cc expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.174086:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093489e00/0xe984082ccd72be27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52da expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.174092:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.174093:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.174095:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff47400/0xe984082ccd72becf lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->2514943] (req 2097152->2514943) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5358 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.174111:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093489e00/0xe984082ccd72be27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52da expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.174129:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093489e00/0xe984082ccd72be27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52da expref: 30 pid: 4582 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143742.174155:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594110336:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.174197:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b30e00/0xe984082ccd72be12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52cc expref: 31 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.174204:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b30e00/0xe984082ccd72be12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52cc expref: 31 pid: 6929 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143742.174211:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594110464:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.174223:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.179778:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594110336:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.179788:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594110464:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.179813:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff47400/0xe984082ccd72becf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->2514943] (req 2097152->2514943) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5358 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.179827:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff47400, rc 0) 00000100:00100000:0.0:1746143742.179874:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:30557:x1830963593528448:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5826us (6520us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.179883:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11879 00000100:00100000:0.0:1746143742.180077:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593528576 00000100:00100000:0.0:1746143742.180082:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593528576 00000100:00100000:0.0:1746143742.180121:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11880 00000100:00100000:0.0:1746143742.180127:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:30554:x1830963593528576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.180159:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.180171:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a081c800/0xe984082ccd72bed6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a535f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.180187:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.180189:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.180195:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a081c800/0xe984082ccd72bed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2514944->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a535f expref: 32 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.180206:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a081c800/0xe984082ccd72bed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2514944->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a535f expref: 32 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.180213:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081c800, rc 0) 00000100:00100000:0.0:1746143742.180230:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:30554:x1830963593528576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 104us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.180235:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11880 00000100:00100000:0.0:1746143742.184453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.184479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.184505:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.188609:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593529600 00000100:00100000:0.0:1746143742.188613:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593529600 00002000:00100000:0.0:1746143742.188637:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093347100 x1830963593529600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:138/0 lens 488/0 e 0 to 0 dl 1746143753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.188645:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093347100 with x1830963593529600 ext(4194304->4755455) 00002000:00010000:0.0:1746143742.188649:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093347100 00000100:00100000:0.0:1746143742.188770:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5439 00000100:00100000:0.0:1746143742.188776:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093347100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963593529600:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143742.193973:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594110720:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143742.194001:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800955dbe00/0xe984082ccd72beeb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5374 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.194013:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800955dbe00/0xe984082ccd72beeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5374 expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.194092:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800955dbe00, rc 0) 00000100:00100000:0.0:1746143742.194352:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593529216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6860us (9869us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143742.194361:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11883 00000100:00100000:0.0:1746143742.200265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.200998:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.202701:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.202839:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.204240:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593530624 00000100:00100000:0.0:1746143742.204245:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593530624 00000100:00100000:0.0:1746143742.204292:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3718 00000100:00100000:0.0:1746143742.204298:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:30557:x1830963593530624:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143742.204452:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:30557:x1830963593530624:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 155us (269us total) trans 8589943084 rc 0/0 00000100:00100000:0.0:1746143742.204458:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3718 00000100:00100000:0.0:1746143742.207844:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.211261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.211312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.212539:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11888 00000100:00100000:0.0:1746143742.212547:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963593531136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.212554:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.212561:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a081cc00/0xe984082ccd72bf0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5397 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.212579:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a081cc00/0xe984082ccd72bf0e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5397 expref: 34 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.212588:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a081cc00/0xe984082ccd72bf0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5397 expref: 34 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.212595:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081cc00, rc 0) 00000100:00100000:0.0:1746143742.212633:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963593531136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 87us (1320us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143742.212639:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11888 00000100:00100000:0.0:1746143742.220885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.225784:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593531904 00000100:00100000:0.0:1746143742.225790:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593531904 00000100:00100000:0.0:1746143742.225822:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3721 00000100:00100000:0.0:1746143742.225828:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:30561:x1830963593531904:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143742.226232:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:30561:x1830963593531904:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 403us (498us total) trans 8589943088 rc 0/0 00000100:00100000:0.0:1746143742.226238:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3721 00000100:00100000:0.0:1746143742.311453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.323249:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.326289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.334847:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.345248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.346067:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.357080:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.368214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.379435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.379460:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.379551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.404833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.404873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.406750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.431923:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.448518:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.448882:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.448903:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.448923:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593534976 00000100:00100000:0.0:1746143742.448929:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593534976 00000100:00100000:0.0:1746143742.448972:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593535104 00000100:00100000:0.0:1746143742.448974:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593535104 00000100:00100000:0.0:1746143742.448983:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593535232 00000100:00100000:0.0:1746143742.448984:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593535232 00000100:00100000:0.0:1746143742.449322:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11892 00000100:00100000:0.0:1746143742.449330:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963593534976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.449343:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.449355:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800955dbe00/0xe984082ccd72bfb6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a53cf expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143742.449420:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594111872:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143742.449482:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.449516:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.459121:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593535616 00000100:00100000:0.0:1746143742.459137:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593535616 00002000:00100000:0.0:1746143742.459761:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1765376->2097151) req@ffff88008f682a00 x1830963593535616/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:138/0 lens 488/0 e 0 to 0 dl 1746143753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.459769:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f682a00 with x1830963593535616 ext(1765376->2097151) 00010000:00010000:0.0:1746143742.459775:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd72bea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a532e expref: 30 pid: 9527 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.459786:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a581d000/0xe984082ccd72bea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a532e expref: 30 pid: 9527 timeout: 921 lvb_type: 0 00002000:00010000:0.0:1746143742.459792:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f682a00 00000100:00100000:0.0:1746143742.459810:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1565 00000100:00100000:0.0:1746143742.459816:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963593535616:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143742.475978:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.477745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.481976:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.510016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.510068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.510175:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593536896 00000100:00100000:0.0:1746143742.510179:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593536896 00010000:00010000:0.0:1746143742.510197:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72be89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5312 expref: 39 pid: 9527 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.510233:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6262 00000100:00100000:0.0:1746143742.510238:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963593536896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143742.510246:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143742.510263:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72be89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5312 expref: 39 pid: 9527 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.510349:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72be89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5312 expref: 39 pid: 9527 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.510365:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72be89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2076672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5312 expref: 39 pid: 9527 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.510385:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.510386:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.510391:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936cd400/0xe984082ccd72bfd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53f2 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.510407:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800936cd400/0xe984082ccd72bfd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53f2 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.510425:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800936cd400/0xe984082ccd72bfd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53f2 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143742.510433:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594112896:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143742.512312:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.519649:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.519687:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.519722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.526226:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.526246:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593537792 00000100:00100000:0.0:1746143742.526252:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593537792 00002000:00100000:0.0:1746143742.526285:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3350528->3354623) req@ffff880099c11c50 x1830963593537792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:138/0 lens 488/0 e 0 to 0 dl 1746143753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.526294:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c11c50 with x1830963593537792 ext(3350528->3354623) 00002000:00010000:0.0:1746143742.526299:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099c11c50 00000100:00100000:0.0:1746143742.526314:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5450 00000100:00100000:0.0:1746143742.526319:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963593537792:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143742.526449:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963593537792:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 129us (231us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143742.526455:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5450 00002000:00100000:0.0:1746143742.526460:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3350528->3354623) req@ffff880099c11c50 x1830963593537792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746143753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.526467:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c11c50 with x1830963593537792 ext(3350528->3354623) 00002000:00010000:0.0:1746143742.526470:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099c11c50 00000100:00100000:0.0:1746143742.542385:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.547266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.559642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.559679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.575362:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.575404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.575427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.575615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.575709:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6266 00000100:00100000:0.0:1746143742.575715:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963593538944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143742.575721:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143742.575730:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7600/0xe984082ccd72be2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52e1 expref: 27 pid: 6929 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143742.576750:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7600/0xe984082ccd72be2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52e1 expref: 26 pid: 6929 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143742.576956:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c7600/0xe984082ccd72be2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52e1 expref: 26 pid: 6929 timeout: 921 lvb_type: 1 00010000:00010000:0.0:1746143742.576969:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.576970:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.576974:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034ae00/0xe984082ccd72bfe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5400 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.576981:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034ae00/0xe984082ccd72bfe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5400 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.577004:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034ae00/0xe984082ccd72bfe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3182591) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5400 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143742.577015:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594113664:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143742.577064:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.583188:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594113664:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143742.583209:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143742.583247:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593538944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7531us (7630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.583255:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6266 00000100:00100000:0.0:1746143742.589777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.591508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.595531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.596133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.599219:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.621391:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593541120 00000100:00100000:0.0:1746143742.621406:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593541120 00000100:00100000:0.0:1746143742.621445:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11903 00000100:00100000:0.0:1746143742.621452:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:30573:x1830963593541120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.621463:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.621475:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093489400/0xe984082ccd72c026 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5423 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.621494:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.621495:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.621501:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093489400/0xe984082ccd72c026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5423 expref: 36 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.621513:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093489400/0xe984082ccd72c026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5423 expref: 36 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.621523:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093489400, rc 0) 00000100:00100000:0.0:1746143742.622131:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:30573:x1830963593541120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 678us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.622160:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11903 00000100:00100000:0.0:1746143742.623055:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.623085:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.624163:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.624321:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.626058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.627290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.634059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.641193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.658649:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.659586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.667231:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.667258:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.667316:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.670909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.670960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.675438:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.675463:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.677104:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.680269:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594114816:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143742.680288:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143742.680318:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963593544064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4727us (4853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.680327:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6272 00000100:00100000:0.0:1746143742.682750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.685129:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.695392:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.700837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.715972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.717540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.719912:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.724692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.725404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.726713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.726742:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593546496 00000100:00100000:0.0:1746143742.726745:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593546496 00002000:00100000:0.0:1746143742.726762:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a71be300 x1830963593546496/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:138/0 lens 488/0 e 0 to 0 dl 1746143753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143742.726770:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a71be300 with x1830963593546496 ext(3145728->4194303) 00002000:00010000:0.0:1746143742.726773:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a71be300 00000100:00100000:0.0:1746143742.726784:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5463 00000100:00100000:0.0:1746143742.726789:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1964:x1830963593546496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143742.730736:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593546624 00000100:00100000:0.0:1746143742.730744:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593546624 00010000:00010000:0.0:1746143742.730775:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b0 expref: 250 pid: 14762 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.730878:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6274 00000100:00100000:0.0:1746143742.730886:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1964:x1830963593546624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143742.730897:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143742.730902:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b0 expref: 250 pid: 14762 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.730924:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b0 expref: 250 pid: 14762 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.730944:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72bdef lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52b0 expref: 250 pid: 14762 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.731388:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143742.731404:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013519fa00/0xe984082ccd72c081 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.731413:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013519fa00/0xe984082ccd72c081 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.731417:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013519fa00/0xe984082ccd72c081 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.731524:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143742.733208:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093345180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963593546624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2322us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.733216:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6274 00000100:00100000:0.0:1746143742.737440:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.737611:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.739676:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.740964:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.743666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143742.744800:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ea00/0xe984082ccd72c0b9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.744809:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ea00/0xe984082ccd72c0b9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143742.744833:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8929408 00010000:00010000:0.0:1746143742.745076:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c0b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a549a expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.745096:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ea00/0xe984082ccd72c0b9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a549a expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.745102:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143742.745104:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143742.745566:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013519ea00, rc 0) 00000100:00100000:0.0:1746143742.745588:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30578:x1830963593547648:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5170us (5914us total) trans 8589943096 rc 0/0 00000100:00100000:0.0:1746143742.745594:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8860 00000100:00100000:0.0:1746143742.746214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.748647:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.756096:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.759704:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.767379:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.770180:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.770202:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.770226:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.770238:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.770255:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593549184 00000100:00100000:0.0:1746143742.770260:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593549184 00000100:00100000:0.0:1746143742.770285:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593549440 00000100:00100000:0.0:1746143742.770287:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593549440 00000100:00100000:0.0:1746143742.770295:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593549696 00000100:00100000:0.0:1746143742.770302:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593549696 00000100:00100000:0.0:1746143742.770314:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593549056 00000100:00100000:0.0:1746143742.770315:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593549056 00000100:00100000:0.0:1746143742.770326:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11920 00000100:00100000:0.0:1746143742.770331:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593549184:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143742.770362:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093489e00/0xe984082ccd72c0f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770376:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800936cd400/0xe984082ccd72bfd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53f2 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770383:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013519f200/0xe984082ccd72c08f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5477 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770389:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009336b600/0xe984082ccd72c050 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a544d expref: 41 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770406:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.770408:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.770410:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093489e00/0xe984082ccd72c0f1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770435:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009336b600/0xe984082ccd72c050 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a544d expref: 41 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770445:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009336b600/0xe984082ccd72c050 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a544d expref: 41 pid: 4582 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143742.770465:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594115840:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770529:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013519f200/0xe984082ccd72c08f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5477 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770536:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013519f200/0xe984082ccd72c08f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5477 expref: 9 pid: 25369 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143742.770543:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594115968:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770566:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800936cd400/0xe984082ccd72bfd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53f2 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770574:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800936cd400/0xe984082ccd72bfd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53f2 expref: 27 pid: 9527 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.770580:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594116096:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.770592:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.770607:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11921 00000100:00100000:0.0:1746143742.770612:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593549440:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143742.770627:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f06c200/0xe984082ccd72c0f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770636:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800936cda00/0xe984082ccd72bfcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53e4 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770650:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013519e200/0xe984082ccd72c09d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5485 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770656:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093489400/0xe984082ccd72c026 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5423 expref: 37 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770660:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.770661:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.770663:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f06c200/0xe984082ccd72c0f8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770674:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093489400/0xe984082ccd72c026 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5423 expref: 37 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770680:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093489400/0xe984082ccd72c026 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5423 expref: 37 pid: 9527 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.770687:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594116224:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770707:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013519e200/0xe984082ccd72c09d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5485 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770713:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013519e200/0xe984082ccd72c09d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5485 expref: 9 pid: 25369 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143742.770720:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594116352:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770739:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800936cda00/0xe984082ccd72bfcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53e4 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770746:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800936cda00/0xe984082ccd72bfcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a53e4 expref: 35 pid: 9527 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.770751:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594116480:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.770766:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.770783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.770795:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593549312 00000100:00100000:0.0:1746143742.770797:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593549312 00000100:00100000:0.0:1746143742.770809:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11922 00000100:00100000:0.0:1746143742.770813:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593549696:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143742.770824:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f06d800/0xe984082ccd72c0ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770833:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd72bff5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a540e expref: 41 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770839:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f06ce00/0xe984082ccd72c034 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5438 expref: 41 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770844:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72c0c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54a1 expref: 27 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770850:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013519ee00/0xe984082ccd72c0ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5493 expref: 10 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770859:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f06dc00/0xe984082ccd72c042 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a543f expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770864:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143742.770865:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143742.770867:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f06d800/0xe984082ccd72c0ff lrc: 8/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770877:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f06dc00/0xe984082ccd72c042 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a543f expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770883:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f06dc00/0xe984082ccd72c042 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a543f expref: 27 pid: 9527 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.770889:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594116608:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770907:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013519ee00/0xe984082ccd72c0ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5493 expref: 10 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.770913:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013519ee00/0xe984082ccd72c0ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5493 expref: 10 pid: 8496 timeout: 921 lvb_type: 1 00000100:00100000:0.0:1746143742.770919:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594116736:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770931:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72c0c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54a1 expref: 27 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770943:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bedbe00/0xe984082ccd72c0c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54a1 expref: 27 pid: 8496 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.770949:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594116864:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770962:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f06ce00/0xe984082ccd72c034 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5438 expref: 41 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770967:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f06ce00/0xe984082ccd72c034 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5438 expref: 41 pid: 9527 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.770972:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594116992:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.770983:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd72bff5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a540e expref: 41 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.770988:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd72bff5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a540e expref: 41 pid: 25369 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.770994:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594117120:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.771000:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143742.771035:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.785783:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.787906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.787927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.787944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.788735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.789078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790169:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790234:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594117632:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.790257:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594117760:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143742.790271:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790280:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790368:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594117888:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143742.790384:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143742.790433:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790443:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790470:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.790534:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593552640 00000100:00100000:0.0:1746143742.790536:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593552640 00000100:00100000:0.0:1746143742.790548:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593552896 00000100:00100000:0.0:1746143742.790549:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593552896 00000100:00100000:0.0:1746143742.790555:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593553152 00000100:00100000:0.0:1746143742.790556:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593553152 00000100:00100000:0.0:1746143742.790561:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593552512 00000100:00100000:0.0:1746143742.790562:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593552512 00000100:00100000:0.0:1746143742.790567:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593552768 00000100:00100000:0.0:1746143742.790568:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593552768 00000100:00100000:0.0:1746143742.790575:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11926 00000100:00100000:0.0:1746143742.790579:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963593552640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.790590:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.790598:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081de00/0xe984082ccd72c11b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a54bd expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.790620:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a081de00/0xe984082ccd72c11b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54bd expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.790628:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a081de00/0xe984082ccd72c11b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54bd expref: 31 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.790637:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081de00, rc 0) 00000100:00100000:0.0:1746143742.791330:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963593552640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 748us (857us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143742.791335:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11926 00000100:00100000:0.0:1746143742.791347:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11927 00000100:00100000:0.0:1746143742.791352:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:1964:x1830963593552896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.791366:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.791373:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a081c000/0xe984082ccd72c122 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a54cb expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.791408:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a081c000/0xe984082ccd72c122 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54cb expref: 38 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.791416:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a081c000/0xe984082ccd72c122 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54cb expref: 38 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.791422:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081c000, rc 0) 00000100:00100000:0.0:1746143742.791438:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:1964:x1830963593552896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 86us (955us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143742.791443:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11927 00000100:00100000:0.0:1746143742.791453:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11928 00000100:00100000:0.0:1746143742.791458:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963593553152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.791463:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.791468:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081ca00/0xe984082ccd72c129 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a54d9 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792505:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a081ca00/0xe984082ccd72c129 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54d9 expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.792513:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a081ca00/0xe984082ccd72c129 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54d9 expref: 25 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.792529:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081ca00, rc 0) 00000100:00100000:0.0:1746143742.792540:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593553152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1082us (2047us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143742.792544:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11928 00010000:00010000:0.0:1746143742.792557:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792563:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792572:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792577:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792582:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792586:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a081c800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143742.792588:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792593:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792608:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.792613:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c10d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143742.792631:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593549312:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 21395us (21848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.792635:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11924 00000100:00100000:0.0:1746143742.796083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.796469:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.799570:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.799633:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.799659:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.800485:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.800507:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.800518:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.800531:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593554304 00000100:00100000:0.0:1746143742.800534:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593554304 00000100:00100000:0.0:1746143742.800549:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593554432 00000100:00100000:0.0:1746143742.800551:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593554432 00000100:00100000:0.0:1746143742.800561:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11935 00000100:00100000:0.0:1746143742.800565:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963593554304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.800571:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.800578:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a54f5 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143742.800603:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x681409fe, atime: 0x681409fe, ctime: 0x681409fd, blocks: 0x81f 00010000:00010000:0.0:1746143742.800612:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.800613:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.800617:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.800626:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.800633:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081c800, rc 0) 00000100:00100000:0.0:1746143742.800648:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963593554304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.800654:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11935 00000100:00100000:0.0:1746143742.800685:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.802089:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.802157:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.803542:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593554816 00000100:00100000:0.0:1746143742.803547:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593554816 00010000:00010000:0.0:1746143742.803568:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff47800/0xe984082ccd72be58 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52fd expref: 249 pid: 16090 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746143742.803587:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6300 00000100:00100000:0.0:1746143742.803592:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963593554816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143742.803599:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143742.803603:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff47800/0xe984082ccd72be58 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52fd expref: 249 pid: 16090 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.803618:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff47800/0xe984082ccd72be58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a52fd expref: 249 pid: 16090 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746143742.803631:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143742.803635:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.803641:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.803646:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.803657:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143742.803683:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963593554816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.803689:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6300 00000100:00100000:0.0:1746143742.803798:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593554688 00000100:00100000:0.0:1746143742.803801:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593554688 00000100:00100000:0.0:1746143742.803819:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11937 00000100:00100000:0.0:1746143742.803823:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963593554688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.803833:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.803842:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081c000/0xe984082ccd72c16f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5503 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143742.803857:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x681409fe, atime: 0x681409fd, ctime: 0x681409fe, blocks: 0x102b 00010000:00010000:0.0:1746143742.803868:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.803870:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143742.803880:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c000/0xe984082ccd72c16f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5503 expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.803892:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a081c000/0xe984082ccd72c16f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5503 expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143742.803899:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081c000, rc 0) 00000100:00100000:0.0:1746143742.803917:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963593554688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 94us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143742.803922:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11937 00000100:00100000:0.0:1746143742.806503:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.808924:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.810811:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593555328 00000100:00100000:0.0:1746143742.810819:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593555328 00000100:00100000:0.0:1746143742.810854:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3726 00000100:00100000:0.0:1746143742.810860:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:30573:x1830963593555328:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143742.811057:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:30573:x1830963593555328:12345-192.168.202.48@tcp:35:cat.0 Request processed in 196us (2136us total) trans 8589943100 rc 0/0 00000100:00100000:0.0:1746143742.811063:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3726 00000100:00100000:0.0:1746143742.814153:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593555584 00000100:00100000:0.0:1746143742.814166:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593555584 00000100:00100000:0.0:1746143742.814196:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8864 00000100:00100000:0.0:1746143742.814202:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:30582:x1830963593555584:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143742.814220:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.814234:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013519fe00/0xe984082ccd72c176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a550a expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.814334:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.814345:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.814354:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.814364:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.814370:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.814375:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000100:00100000:0.0:1746143742.822316:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143742.846846:0:14764:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.846858:0:14764:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.846865:0:14764:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.846881:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.846886:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.846901:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.846906:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009133dc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143742.846910:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.846915:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.846926:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143742.846928:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143742.846930:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.846935:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72c14c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143742.851540:0:14764:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851546:0:14764:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14764 initiator: MDT0 00000004:00200000:0.0:1746143742.851555:0:14764:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8929408 00010000:00010000:0.0:1746143742.851591:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851596:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851600:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851615:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034ae00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143742.851617:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851622:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851628:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143742.851630:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143742.851632:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851636:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ae00/0xe984082ccd72c1a7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851646:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851651:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851655:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851659:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013519e000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143742.851661:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851665:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851669:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143742.851671:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143742.851676:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851680:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013519e000/0xe984082ccd72c17d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851686:0:14764:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851690:0:14764:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851694:0:14764:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851697:0:14764:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013519ec00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143742.851699:0:14764:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851703:0:14764:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851708:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5c04000) 00010000:00010000:0.0:1746143742.851709:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143742.851711:0:14764:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851715:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013519ec00/0xe984082ccd72c184 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14764 initiator: MDT0 00010000:00010000:0.0:1746143742.851734:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013519fe00/0xe984082ccd72c176 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a550a expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.851739:0:14764:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013519fe00/0xe984082ccd72c176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a550a expref: 9 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.851750:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013519fe00, rc 0) 00000100:00100000:0.0:1746143742.851768:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:30582:x1830963593555584:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 37567us (37664us total) trans 8589943102 rc 301/301 00000100:00100000:0.0:1746143742.851773:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8864 00000100:00100000:0.0:1746143742.853971:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593556352 00000100:00100000:0.0:1746143742.853978:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593556352 00000100:00100000:0.0:1746143742.855000:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3727 00000100:00100000:0.0:1746143742.855006:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:30578:x1830963593556352:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1746143742.855164:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30578:x1830963593556352:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 157us (1350us total) trans 8589943103 rc 0/0 00000100:00100000:0.0:1746143742.855170:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3727 00000100:00100000:0.0:1746143742.860383:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.923922:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.935777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.948430:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.983504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.983544:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593557504 00000100:00100000:0.0:1746143742.983547:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593557504 00000100:00100000:0.0:1746143742.983572:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8870 00000100:00100000:0.0:1746143742.983577:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:30588:x1830963593557504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143742.984227:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143742.984241:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b200/0xe984082ccd72c1df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5534 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.984318:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984362:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984374:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984385:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984399:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984405:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984495:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984502:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984508:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143742.984516:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8929408 00010000:00010000:0.0:1746143742.984617:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984624:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984630:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984643:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034ac00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143742.984646:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984653:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984663:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143742.984665:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143742.984669:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984674:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034ac00/0xe984082ccd72c1e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984683:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984688:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984693:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984696:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a034a600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143742.984698:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984703:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984708:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442c00) 00010000:00010000:0.0:1746143742.984710:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143742.984715:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984720:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034a600/0xe984082ccd72c1ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143742.984751:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034b200/0xe984082ccd72c1df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5534 expref: 244 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.984760:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5534 expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143742.984766:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143742.984768:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143742.984770:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034be00, rc 0) 00000100:00100000:0.0:1746143742.984796:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:30588:x1830963593557504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1218us (1294us total) trans 8589943106 rc 0/0 00000100:00100000:0.0:1746143742.984802:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8870 00000100:00100000:0.0:1746143742.986556:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123520 00000100:00100000:0.0:1746143742.986564:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123520 00000100:00100000:0.0:1746143742.986605:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11971 00000100:00100000:0.0:1746143742.986612:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963594123520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143742.987517:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3294:x1830963594123520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 904us (2024us total) trans 21474840167 rc 0/0 00000100:00100000:0.0:1746143742.987523:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11971 00000100:00100000:0.0:1746143742.987745:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.989231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.989812:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.989882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.990528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.990982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.992901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.992939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.992977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143742.998585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.000063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.006029:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.007384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.008577:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.008610:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.008670:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.013119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.013203:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.013241:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593560576 00000100:00100000:0.0:1746143743.013249:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593560576 00010000:00010000:0.0:1746143743.013570:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091036a00/0xe984082ccd72c145 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54e0 expref: 36 pid: 21542 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.013589:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6306 00000100:00100000:0.0:1746143743.013595:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1965:x1830963593560576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.013602:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.013611:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091036a00/0xe984082ccd72c145 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54e0 expref: 36 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.013620:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091036a00/0xe984082ccd72c145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54e0 expref: 36 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.013642:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.013643:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.013650:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff47400/0xe984082ccd72c23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5573 expref: 42 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.013658:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff47400/0xe984082ccd72c23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5573 expref: 42 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.013688:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff47400/0xe984082ccd72c23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5573 expref: 42 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.013701:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594124416:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143743.013751:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143743.014217:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091036e00/0xe984082ccd72c22c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a555e expref: 41 pid: 21542 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.014238:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594124160:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.014249:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091036a00/0xe984082ccd72c145 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54e0 expref: 36 pid: 21542 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.014257:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594124288:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.014277:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff47400/0xe984082ccd72c23a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5573 expref: 40 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.014294:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff47400, rc 0) 00000100:00100000:0.0:1746143743.014323:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:30583:x1830963593559296:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7457us (8311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.014329:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11980 00000100:00100000:0.0:1746143743.026207:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594124416:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143743.026225:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.026248:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1965:x1830963593560576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12653us (13147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.026255:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6306 00000100:00100000:0.0:1746143743.033984:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.038301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.047468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.049350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.049373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.049410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.049436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.069259:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593562496 00000100:00100000:0.0:1746143743.069263:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593562496 00000100:00100000:0.0:1746143743.069288:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11984 00000100:00100000:0.0:1746143743.069293:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:30582:x1830963593562496:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143743.069303:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.069319:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081de00/0xe984082ccd72c279 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5596 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.069342:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f06d000/0xe984082ccd72c15a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54ee expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.069359:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009133d800/0xe984082ccd72c209 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5549 expref: 40 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.069364:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.069366:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.069369:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081de00/0xe984082ccd72c279 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->1228799] (req 1048576->1228799) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5596 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.069410:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009133d800/0xe984082ccd72c209 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5549 expref: 40 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.069421:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009133d800/0xe984082ccd72c209 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5549 expref: 40 pid: 8495 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.069431:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594125056:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.069521:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f06d000/0xe984082ccd72c15a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54ee expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.069528:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f06d000/0xe984082ccd72c15a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54ee expref: 27 pid: 25369 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.069535:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594125184:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.069553:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.077831:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.095103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.102965:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.122464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.122491:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593565056 00000100:00100000:0.0:1746143743.122501:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593565056 00000100:00100000:0.0:1746143743.122558:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3731 00000100:00100000:0.0:1746143743.122566:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:30582:x1830963593565056:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143743.122780:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:30582:x1830963593565056:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 214us (324us total) trans 8589943109 rc 0/0 00000100:00100000:0.0:1746143743.122787:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3731 00000100:00100000:0.0:1746143743.132829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.132858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.164218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.164273:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.186077:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.186104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.186122:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.186155:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593566336 00000100:00100000:0.0:1746143743.186162:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593566336 00000100:00100000:0.0:1746143743.186196:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8872 00000100:00100000:0.0:1746143743.186203:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:30595:x1830963593566336:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143743.186219:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.186232:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c5e00/0xe984082ccd72c29c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a55c7 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.186311:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143743.186322:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5534 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.186335:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091037000/0xe984082ccd72c256 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a557a expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.186340:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143743.186439:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091037000/0xe984082ccd72c256 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a557a expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.186450:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091037000/0xe984082ccd72c256 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a557a expref: 9 pid: 14762 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.186459:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594125952:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.186520:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5534 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.186526:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5534 expref: 245 pid: 21713 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.186533:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594126080:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.186550:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.186588:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.193451:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.194706:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594125952:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.194756:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.194820:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143743.196579:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a034be00/0xe984082ccd72c1f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5534 expref: 245 pid: 21713 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.196595:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594126080:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.196618:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143743.196629:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143743.196633:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:0.0:1746143743.196651:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8929408 00010000:00010000:0.0:1746143743.196777:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c5e00/0xe984082ccd72c29c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55c7 expref: 246 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.196788:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55c7 expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.196794:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.196797:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143743.196799:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c4c00, rc 0) 00000100:00100000:0.0:1746143743.196823:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:30595:x1830963593566336:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10621us (10753us total) trans 8589943110 rc 0/0 00000100:00100000:0.0:1746143743.196828:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8872 00000100:00100000:0.0:1746143743.207686:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593566976 00000100:00100000:0.0:1746143743.207699:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593566976 00000100:00100000:0.0:1746143743.207766:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11992 00000100:00100000:0.0:1746143743.207774:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:30588:x1830963593566976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.207796:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.207814:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a91fa00/0xe984082ccd72c2c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a55d5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.207841:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143743.207844:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143743.207848:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91fa00/0xe984082ccd72c2c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4751360->5242879] (req 4751360->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55d5 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.207859:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a91fa00/0xe984082ccd72c2c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4751360->5242879] (req 4751360->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55d5 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.207869:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a91fa00, rc 0) 00000100:00100000:0.0:1746143743.207923:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:30588:x1830963593566976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 151us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.207930:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11992 00000100:00100000:0.0:1746143743.248803:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593567744 00000100:00100000:0.0:1746143743.248813:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593567744 00000100:00100000:0.0:1746143743.248859:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 11995 00000100:00100000:0.0:1746143743.248866:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:30595:x1830963593567744:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143743.248880:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.248895:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c8f200/0xe984082ccd72c2db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a55ea expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.248947:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f06d400/0xe984082ccd72c168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54fc expref: 36 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.248974:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd72c210 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5557 expref: 38 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.248980:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.248982:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.248985:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8f200/0xe984082ccd72c2db lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1126400->1568767] (req 1126400->1568767) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ea expref: 39 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.249010:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd72c210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5557 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.249020:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009336a600/0xe984082ccd72c210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5557 expref: 39 pid: 8497 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.249031:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594127232:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.249098:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f06d400/0xe984082ccd72c168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54fc expref: 35 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.249105:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f06d400/0xe984082ccd72c168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54fc expref: 35 pid: 25369 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.249111:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594127360:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.249124:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.255611:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594127232:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.255640:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594127360:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.255665:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c8f200/0xe984082ccd72c2db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1126400->1568767] (req 1126400->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ea expref: 38 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.255681:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c8f200, rc 0) 00000100:00100000:0.0:1746143743.255732:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:30595:x1830963593567744:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6865us (7026us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.255739:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11995 00000100:00100000:0.0:1746143743.260212:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.260246:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.262336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.262459:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128256 00000100:00100000:0.0:1746143743.262464:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128256 00000100:00100000:0.0:1746143743.262494:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1746143743.262501:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963594128256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143743.262552:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963594128256:12345-0@lo:400:kworker.0 Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.262557:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1746143743.262568:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594127872 00000100:00100000:0.0:1746143743.262571:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594127872 00000100:00100000:0.0:1746143743.262594:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1746143743.262599:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830963594127872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143743.262625:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830963594127872:12345-0@lo:400:kworker.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.262630:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1746143743.266446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.273091:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593569152 00000100:00100000:0.0:1746143743.273098:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593569152 00010000:00010000:0.0:1746143743.273125:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091037800/0xe984082ccd72c202 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a553b expref: 42 pid: 4582 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.273175:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6315 00000100:00100000:0.0:1746143743.273182:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963593569152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.273193:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.273211:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091037800/0xe984082ccd72c202 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a553b expref: 42 pid: 4582 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.273222:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091037800/0xe984082ccd72c202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a553b expref: 42 pid: 4582 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.273238:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091037800/0xe984082ccd72c202 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a553b expref: 42 pid: 4582 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.273252:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.273254:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.273260:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4b1200/0xe984082ccd72c2e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55f1 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.273271:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4b1200/0xe984082ccd72c2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55f1 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.273297:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4b1200/0xe984082ccd72c2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55f1 expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.273322:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594128384:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143743.273422:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.278635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.281002:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.281035:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.281070:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.326031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.333060:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.344100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.357399:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1963:x1830963593570688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 12144us (13292us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143743.357407:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 11998 00000100:00100000:0.0:1746143743.362888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.370211:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594128896:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143743.370243:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a081ce00/0xe984082ccd72c2f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5606 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.370257:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a081ce00/0xe984082ccd72c2f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5606 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.370281:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081ce00, rc 0) 00000100:00100000:0.0:1746143743.374938:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.374983:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.393871:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.393939:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.400799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.408062:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.413199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.419687:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.419781:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.427136:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.427487:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594129408:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143743.427498:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.427533:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963593572992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3191us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.427540:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6316 00000100:00100000:0.0:1746143743.429190:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.431952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.435227:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.442522:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.445731:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.448082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.453308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.453378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.457026:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.458918:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.468813:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.472297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.478313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.510876:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.535319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.541494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.555016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.564451:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.564504:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.566734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.566752:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593577728 00000100:00100000:0.0:1746143743.566756:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593577728 00002000:00100000:0.0:1746143743.566783:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093f02a00 x1830963593577728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:139/0 lens 488/0 e 0 to 0 dl 1746143754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.566790:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02a00 with x1830963593577728 ext(3145728->4194303) 00002000:00010000:0.0:1746143743.566793:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02a00 00000100:00100000:0.0:1746143743.566808:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5500 00000100:00100000:0.0:1746143743.566814:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963593577728:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143743.590405:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593577984 00000100:00100000:0.0:1746143743.590417:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593577984 00000100:00100000:0.0:1746143743.590458:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8876 00000100:00100000:0.0:1746143743.590465:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:30610:x1830963593577984:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143743.590485:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.590500:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72c39f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a565a expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.590591:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.590603:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.590611:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.590634:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.590639:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.590644:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592025:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3800/0xe984082ccd72c3b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592035:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3800/0xe984082ccd72c3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592043:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3800/0xe984082ccd72c3b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143743.592052:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:0.0:1746143743.592129:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592135:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592159:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592164:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95e3c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143743.592168:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592174:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592189:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143743.592192:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143743.592196:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592200:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3c00/0xe984082ccd72c3a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592211:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592215:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592219:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592223:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95e3400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143743.592225:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592230:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592235:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b898f00) 00010000:00010000:0.0:1746143743.592237:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143743.592239:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592243:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3400/0xe984082ccd72c3ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.592278:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72c39f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a565a expref: 253 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.592294:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3800/0xe984082ccd72c3b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a565a expref: 252 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.592299:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.592301:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143743.592303:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e3800, rc 0) 00000100:00100000:0.0:1746143743.592334:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:30610:x1830963593577984:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1869us (4243us total) trans 8589943118 rc 0/0 00000100:00100000:0.0:1746143743.592339:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8876 00000100:00100000:0.0:1746143743.598750:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1965:x1830963593577216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33816us (34304us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143743.598760:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5498 00002000:00100000:0.0:1746143743.598771:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f00a80 x1830963593577216/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:139/0 lens 488/440 e 0 to 0 dl 1746143754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.598779:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00a80 with x1830963593577216 ext(2097152->3145727) 00002000:00010000:0.0:1746143743.598785:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f00a80 00000100:00100000:0.0:1746143743.598812:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593578112 00000100:00100000:0.0:1746143743.598817:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593578112 00000100:00100000:0.0:1746143743.599069:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8877 00000100:00100000:0.0:1746143743.599076:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:30612:x1830963593578112:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.599092:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.599105:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2200/0xe984082ccd72c3c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5661 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.606478:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593578368 00000100:00100000:0.0:1746143743.606488:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593578368 00000100:00100000:0.0:1746143743.607164:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3736 00000100:00100000:0.0:1746143743.607173:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:7695:x1830963593578368:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143743.608135:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:7695:x1830963593578368:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 962us (1951us total) trans 8589943119 rc 0/0 00000100:00100000:0.0:1746143743.608154:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3736 00000100:00100000:0.0:1746143743.608218:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.610189:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593578752 00000100:00100000:0.0:1746143743.610197:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593578752 00000100:00100000:0.0:1746143743.610234:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8878 00000100:00100000:0.0:1746143743.610240:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:30614:x1830963593578752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.610257:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.610273:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3000/0xe984082ccd72c3de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5668 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.610451:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.610462:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.610472:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.610998:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.611828:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.611838:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.611947:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2c00/0xe984082ccd72c3f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.611955:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2c00/0xe984082ccd72c3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.611961:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2c00/0xe984082ccd72c3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143743.611970:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:0.0:1746143743.612036:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612042:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612047:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612052:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95e3a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143743.612055:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612061:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612070:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143743.612072:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143743.612076:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612080:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3a00/0xe984082ccd72c3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612106:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612111:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612115:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612118:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95e2a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143743.612120:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612124:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612129:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484700) 00010000:00010000:0.0:1746143743.612131:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143743.612133:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.612161:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2a00/0xe984082ccd72c3ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143743.615401:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3000/0xe984082ccd72c3de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5668 expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.615423:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2c00/0xe984082ccd72c3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5668 expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.615431:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.615443:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143743.615446:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.615454:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.615459:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e2c00, rc 0) 00000100:00100000:0.0:1746143743.615517:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:30614:x1830963593578752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5275us (7297us total) trans 8589943120 rc 0/0 00000100:00100000:0.0:1746143743.615524:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8878 00000100:00100000:0.0:1746143743.615677:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.615773:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.615821:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.615849:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593578496 00000100:00100000:0.0:1746143743.615856:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593578496 00000100:00100000:0.0:1746143743.615884:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593578880 00000100:00100000:0.0:1746143743.615886:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593578880 00010000:00010000:0.0:1746143743.615894:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55c7 expref: 254 pid: 21713 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.615908:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6322 00000100:00100000:0.0:1746143743.615913:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1962:x1830963593578880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.615923:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.615927:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55c7 expref: 254 pid: 21713 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.615936:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55c7 expref: 254 pid: 21713 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.615959:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9c4c00/0xe984082ccd72c2a3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55c7 expref: 254 pid: 21713 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.615968:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.615971:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.615976:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.615982:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.615997:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.616015:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1962:x1830963593578880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 102us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.616020:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6322 00000100:00100000:0.0:1746143743.616031:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 696 00000100:00100000:0.0:1746143743.616035:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1965:x1830963593578496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.616041:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.616048:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e3800/0xe984082ccd72c3b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a565a expref: 252 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.616055:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.616057:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.616068:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963593578496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.616079:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 696 00010000:00010000:0.0:1746143743.616122:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616128:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143743.616179:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00000004:00200000:0.0:1746143743.616183:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143743.616197:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616205:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616213:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136489a00/0xe984082ccd72c3c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616218:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136489a00/0xe984082ccd72c3c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616224:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136489a00/0xe984082ccd72c3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616229:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136489a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143743.616232:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136489a00/0xe984082ccd72c3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616238:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136489a00/0xe984082ccd72c3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616245:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143743.616246:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143743.616253:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136489a00/0xe984082ccd72c3c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616257:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136489a00/0xe984082ccd72c3c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616265:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136488c00/0xe984082ccd72c3d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616269:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136488c00/0xe984082ccd72c3d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616274:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136488c00/0xe984082ccd72c3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616277:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136488c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143743.616332:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136488c00/0xe984082ccd72c3d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616338:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136488c00/0xe984082ccd72c3d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616345:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484700) 00010000:00010000:0.0:1746143743.616346:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143743.616349:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136488c00/0xe984082ccd72c3d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616353:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136488c00/0xe984082ccd72c3d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.616379:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2200/0xe984082ccd72c3c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.616398:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 7 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.616408:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.616410:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143743.616412:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808a800, rc 0) 00000100:00100000:0.0:1746143743.616432:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:30612:x1830963593578112:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 17357us (18455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.616438:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8877 00000100:00100000:0.0:1746143743.623824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.625270:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.625286:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.625331:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.625351:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593579264 00000100:00100000:0.0:1746143743.625358:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593579264 00000100:00100000:0.0:1746143743.625404:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 697 00000100:00100000:0.0:1746143743.625411:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963593579264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.625421:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.625439:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2c00/0xe984082ccd72c3f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5668 expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.625452:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.625456:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.625488:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963593579264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.625494:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 697 00000100:00100000:0.0:1746143743.625513:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593579392 00000100:00100000:0.0:1746143743.625515:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593579392 00000100:00100000:0.0:1746143743.625538:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12008 00000100:00100000:0.0:1746143743.625542:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963593579392:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.625554:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.625565:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a95e3200/0xe984082ccd72c401 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a566f expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.625579:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.625581:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.625587:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a95e3200/0xe984082ccd72c401 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a566f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625599:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a95e3200/0xe984082ccd72c401 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a566f expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625608:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e3200, rc 0) 00000100:00100000:0.0:1746143743.625624:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963593579392:12345-192.168.202.48@tcp:101:cat.0 Request processed in 81us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.625628:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12008 00000100:00100000:0.0:1746143743.625636:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593579520 00000100:00100000:0.0:1746143743.625638:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593579520 00000100:00100000:0.0:1746143743.625648:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593579648 00000100:00100000:0.0:1746143743.625650:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593579648 00000100:00100000:0.0:1746143743.625659:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12009 00000100:00100000:0.0:1746143743.625663:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963593579520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.625669:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.625676:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72c408 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5676 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.625695:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.625696:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.625700:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72c408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5676 expref: 30 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625709:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72c408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5676 expref: 30 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625715:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e3e00, rc 0) 00000100:00100000:0.0:1746143743.625729:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963593579520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 65us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.625734:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12009 00000100:00100000:0.0:1746143743.625743:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12010 00000100:00100000:0.0:1746143743.625747:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:30610:x1830963593579648:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143743.625752:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.625757:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5684 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.625769:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 29 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625776:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd72c225 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5550 expref: 46 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625780:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.625785:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.625789:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1216512->1474559] (req 1216512->1474559) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 46 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.625810:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd72c225 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5550 expref: 46 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625819:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd72c225 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5550 expref: 46 pid: 8495 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.625830:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594130816:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.625873:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 29 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.625881:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 29 pid: 6929 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.625888:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594130944:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.625901:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.635574:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635595:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635608:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635619:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635629:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635640:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635652:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635673:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635733:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.635753:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593579776 00000100:00100000:0.0:1746143743.635759:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593579776 00000100:00100000:0.0:1746143743.635785:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593579904 00000100:00100000:0.0:1746143743.635786:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593579904 00000100:00100000:0.0:1746143743.635795:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580032 00000100:00100000:0.0:1746143743.635797:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580032 00000100:00100000:0.0:1746143743.635803:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580160 00000100:00100000:0.0:1746143743.635805:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580160 00000100:00100000:0.0:1746143743.635810:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580288 00000100:00100000:0.0:1746143743.635812:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580288 00000100:00100000:0.0:1746143743.635817:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580416 00000100:00100000:0.0:1746143743.635818:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580416 00000100:00100000:0.0:1746143743.635823:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580544 00000100:00100000:0.0:1746143743.635824:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580544 00000100:00100000:0.0:1746143743.635830:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580672 00000100:00100000:0.0:1746143743.635831:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580672 00000100:00100000:0.0:1746143743.635840:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12011 00000100:00100000:0.0:1746143743.635846:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593579776:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.635860:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.635873:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fafb600/0xe984082ccd72c416 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a568b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.635891:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.635893:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.635899:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fafb600/0xe984082ccd72c416 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a568b expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.635912:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fafb600/0xe984082ccd72c416 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a568b expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.635930:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafb600, rc 0) 00000100:00100000:0.0:1746143743.635962:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593579776:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.635967:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12011 00000100:00100000:0.0:1746143743.635981:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12012 00000100:00100000:0.0:1746143743.635985:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593579904:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.635991:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.635998:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fafb200/0xe984082ccd72c41d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5692 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.636009:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636010:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636014:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fafb200/0xe984082ccd72c41d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5692 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636023:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fafb200/0xe984082ccd72c41d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5692 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636029:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafb200, rc 0) 00000100:00100000:0.0:1746143743.636041:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593579904:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 56us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.636046:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12012 00000100:00100000:0.0:1746143743.636054:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12013 00000100:00100000:0.0:1746143743.636058:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593580032:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.636069:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.636074:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fafa800/0xe984082ccd72c424 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5699 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.636083:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636090:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fafa800/0xe984082ccd72c424 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5699 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636097:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fafa800/0xe984082ccd72c424 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5699 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636104:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafa800, rc 0) 00000100:00100000:0.0:1746143743.636117:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593580032:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 59us (508us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143743.636122:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12013 00000100:00100000:0.0:1746143743.636130:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12014 00000100:00100000:0.0:1746143743.636134:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593580160:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.636154:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.636160:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fafae00/0xe984082ccd72c42b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56a0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.636188:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594131072:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143743.636225:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.636238:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12015 00000100:00100000:0.0:1746143743.636243:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593580288:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.636254:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.636260:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136489a00/0xe984082ccd72c432 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56a7 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.636269:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636270:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636275:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136489a00/0xe984082ccd72c432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56a7 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636283:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136489a00/0xe984082ccd72c432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56a7 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636289:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489a00, rc 0) 00000100:00100000:0.0:1746143743.636303:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593580288:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.636308:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12015 00000100:00100000:0.0:1746143743.636317:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12016 00000100:00100000:0.0:1746143743.636321:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593580416:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.636326:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.636330:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd72c439 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56ae expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.636339:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636340:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636343:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd72c439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56ae expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636351:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136489e00/0xe984082ccd72c439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56ae expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636361:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489e00, rc 0) 00000100:00100000:0.0:1746143743.636373:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593580416:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 52us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.636377:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12016 00000100:00100000:0.0:1746143743.636399:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12017 00000100:00100000:0.0:1746143743.636404:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593580544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.636409:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.636414:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136489000/0xe984082ccd72c440 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a567d expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.636432:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594131200:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143743.636449:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.636462:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12018 00000100:00100000:0.0:1746143743.636466:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963593580672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.636472:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.636476:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fafba00/0xe984082ccd72c447 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56b5 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.636485:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636486:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.636490:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fafba00/0xe984082ccd72c447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56b5 expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636498:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fafba00/0xe984082ccd72c447 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56b5 expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.636510:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafba00, rc 0) 00000100:00100000:0.0:1746143743.636525:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963593580672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.636529:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12018 00000100:00100000:0.0:1746143743.636544:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580800 00000100:00100000:0.0:1746143743.636547:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580800 00010000:00010000:0.0:1746143743.636560:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd72c225 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5550 expref: 47 pid: 8495 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.636574:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6323 00000100:00100000:0.0:1746143743.636578:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1965:x1830963593580800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.636585:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.636600:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd72c225 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5550 expref: 47 pid: 8495 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.636609:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd72c225 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5550 expref: 47 pid: 8495 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.636620:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.636630:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1965:x1830963593580800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.636635:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6323 00010000:00010000:0.0:1746143743.636661:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009133d200/0xe984082ccd72c225 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5550 expref: 46 pid: 8495 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.636678:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594130816:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.636688:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594130944:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.636705:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1216512->1474559] (req 1216512->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 45 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.636712:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e2400, rc 0) 00000100:00100000:0.0:1746143743.636723:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:30610:x1830963593579648:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10976us (11392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.636728:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12010 00000100:00100000:0.0:1746143743.641096:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.641214:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593580928 00000100:00100000:0.0:1746143743.641220:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593580928 00010000:00010000:0.0:1746143743.641243:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 31 pid: 6929 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.641263:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6324 00000100:00100000:0.0:1746143743.641269:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963593580928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.641278:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.641296:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 31 pid: 6929 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.641306:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 31 pid: 6929 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.641337:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72c161 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a54f5 expref: 31 pid: 6929 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.641348:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.641350:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.641355:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 44 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.641362:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 44 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.641396:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 44 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.641406:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594131328:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143743.641454:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.641495:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594131200:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143743.641514:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136489000/0xe984082ccd72c440 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a567d expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.641523:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136489000/0xe984082ccd72c440 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a567d expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.641530:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489000, rc 0) 00000100:00100000:0.0:1746143743.641550:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593580544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5146us (5896us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143743.641560:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12017 00000100:00100000:0.0:1746143743.641591:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594131072:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143743.641604:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fafae00/0xe984082ccd72c42b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56a0 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.641612:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fafae00/0xe984082ccd72c42b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56a0 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.641619:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafae00, rc 0) 00000100:00100000:0.0:1746143743.641635:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593580160:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5500us (6015us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143743.641640:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12014 00000100:00100000:0.0:1746143743.645906:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594131328:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143743.645923:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.645956:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963593580928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4686us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.645964:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6324 00000100:00100000:0.0:1746143743.647715:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.654748:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593581440 00000100:00100000:0.0:1746143743.654755:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593581440 00000100:00100000:0.0:1746143743.654826:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8879 00000100:00100000:0.0:1746143743.654833:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:30612:x1830963593581440:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.654850:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.654864:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd72c44e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56bc expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.654969:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.654982:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.654989:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.655014:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.655025:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 8 pid: 14763 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.655035:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594131456:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.655108:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.662634:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593582208 00000100:00100000:0.0:1746143743.662642:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593582208 00000100:00100000:0.0:1746143743.662709:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3737 00000100:00100000:0.0:1746143743.662716:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:30603:x1830963593582208:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143743.662853:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:30603:x1830963593582208:12345-192.168.202.48@tcp:35:cat.0 Request processed in 137us (5669us total) trans 8589943121 rc 0/0 00000100:00100000:0.0:1746143743.662860:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3737 00000100:00100000:0.0:1746143743.664616:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.669126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.669188:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594131456:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.669215:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143743.669239:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593582592 00000100:00100000:0.0:1746143743.669243:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593582592 00010000:00010000:0.0:1746143743.669268:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 9 pid: 14763 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.669288:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6325 00000100:00100000:0.0:1746143743.669295:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593582592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.669305:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.669310:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 9 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.669319:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 9 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.669335:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009808a800/0xe984082ccd72c3d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5661 expref: 9 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.669345:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.669349:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.669357:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.669363:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.669377:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.669422:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593582592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.669429:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6325 00010000:00010000:0.0:1746143743.669479:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.669485:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143743.669502:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:0.0:1746143743.669613:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd72c44e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56bc expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.669625:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56bc expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.669631:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.669634:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143743.669636:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d9200, rc 0) 00000100:00100000:0.0:1746143743.669657:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30612:x1830963593581440:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 14825us (15517us total) trans 8589943122 rc 0/0 00000100:00100000:0.0:1746143743.669663:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8879 00000100:00100000:0.0:1746143743.686405:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963593581952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25554us (29229us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143743.686416:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5504 00002000:00100000:0.0:1746143743.686428:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a71bca80 x1830963593581952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:139/0 lens 488/440 e 0 to 0 dl 1746143754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.686437:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a71bca80 with x1830963593581952 ext(1048576->2097151) 00002000:00010000:0.0:1746143743.686450:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a71bca80 00000100:00100000:0.0:1746143743.688547:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.688575:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593582848 00000100:00100000:0.0:1746143743.688582:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593582848 00000100:00100000:0.0:1746143743.688613:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3738 00000100:00100000:0.0:1746143743.688619:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:30610:x1830963593582848:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143743.688780:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:30610:x1830963593582848:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 160us (239us total) trans 8589943123 rc 0/0 00000100:00100000:0.0:1746143743.688786:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3738 00000100:00100000:0.0:1746143743.700083:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594131584:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143743.700097:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143743.703746:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593583232 00000100:00100000:0.0:1746143743.703753:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593583232 00002000:00100000:0.0:1746143743.703787:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1216512->1474559) req@ffff8800930d3800 x1830963593583232/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:139/0 lens 488/0 e 0 to 0 dl 1746143754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.703796:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3800 with x1830963593583232 ext(1216512->1474559) 00010000:00010000:0.0:1746143743.703803:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 45 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.703815:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 45 pid: 21542 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746143743.703821:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930d3800 00000100:00100000:0.0:1746143743.703836:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1581 00000100:00100000:0.0:1746143743.703843:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1965:x1830963593583232:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143743.704067:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593583360 00000100:00100000:0.0:1746143743.704070:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593583360 00010000:00010000:0.0:1746143743.704084:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56bc expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.704098:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6326 00000100:00100000:0.0:1746143743.704102:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593583360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.704110:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.704114:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56bc expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.704122:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56bc expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.704153:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd72c455 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56bc expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.704164:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.704168:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.704175:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.704181:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.704194:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.704209:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593583360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.704221:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6326 00010000:00010000:0.0:1746143743.704239:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.704245:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143743.704279:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00000004:00200000:0.0:1746143743.704283:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143743.704295:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.704318:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72c463 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56c3 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.704329:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dda00/0xe984082ccd72c46a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56c3 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.704335:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.704337:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143743.704340:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dda00, rc 0) 00000100:00100000:0.0:1746143743.704361:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a71bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30612:x1830963593582976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10048us (11702us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.704366:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8880 00000100:00100000:0.0:1746143743.716055:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594131840:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143743.716072:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc400/0xe984082ccd72c478 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56d8 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.716373:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc400/0xe984082ccd72c478 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56d8 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.716380:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dc400, rc 0) 00000100:00100000:0.0:1746143743.716417:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593583616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4347us (4502us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143743.716423:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12020 00000100:00100000:0.0:1746143743.716440:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593583744 00000100:00100000:0.0:1746143743.716444:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593583744 00010000:00010000:0.0:1746143743.716461:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 47 pid: 21542 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.716478:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6327 00000100:00100000:0.0:1746143743.716483:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1964:x1830963593583744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.716493:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.716501:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 47 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.716511:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 47 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.716526:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2400/0xe984082ccd72c40f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1216512->1474559) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5684 expref: 47 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.716537:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.716542:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.716548:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c471 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56ca expref: 30 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.716555:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c471 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56ca expref: 30 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.716578:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c471 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56ca expref: 30 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.716587:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594132096:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143743.716619:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.720817:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594132096:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143743.720832:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.720880:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1964:x1830963593583744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4394us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.720888:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6327 00000100:00100000:0.0:1746143743.723183:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593584000 00000100:00100000:0.0:1746143743.723189:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593584000 00000100:00100000:0.0:1746143743.723231:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8881 00000100:00100000:0.0:1746143743.723236:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30612:x1830963593584000:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143743.723251:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.725755:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd72c486 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56df expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.725845:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.725867:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.725876:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143743.725889:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:0.0:1746143743.725984:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd72c486 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.725995:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.726002:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.726004:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143743.726007:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d9400, rc 0) 00000100:00100000:0.0:1746143743.726057:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:30612:x1830963593584000:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2818us (3711us total) trans 8589943124 rc 0/0 00000100:00100000:0.0:1746143743.726063:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8881 00000100:00100000:0.0:1746143743.726210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.726261:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593584256 00000100:00100000:0.0:1746143743.726265:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593584256 00000100:00100000:0.0:1746143743.726288:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8882 00000100:00100000:0.0:1746143743.726293:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:30618:x1830963593584256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143743.726305:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.726313:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd72c49b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56e6 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.726373:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd72c4a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726381:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd72c4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726396:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd72c4a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726407:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72c4a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726412:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72c4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726416:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9a00/0xe984082ccd72c4a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726484:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd72c4b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726492:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.726498:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd72c4b0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.726520:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.726529:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 9 pid: 14763 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.726548:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594132224:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143743.726592:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.727361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.727378:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593584512 00000100:00100000:0.0:1746143743.727381:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593584512 00002000:00100000:0.0:1746143743.727418:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6c380 x1830963593584512/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:139/0 lens 488/0 e 0 to 0 dl 1746143754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.727426:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c380 with x1830963593584512 ext(1048576->2097151) 00002000:00010000:0.0:1746143743.727430:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c380 00000100:00100000:0.0:1746143743.727442:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5506 00000100:00100000:0.0:1746143743.727447:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963593584512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143743.733422:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593584768 00000100:00100000:0.0:1746143743.733426:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593584768 00010000:00010000:0.0:1746143743.733445:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.733461:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6328 00000100:00100000:0.0:1746143743.733466:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963593584768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.733474:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.733479:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.733486:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.733511:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd72c48d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56df expref: 10 pid: 14763 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.733522:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143743.733526:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd72c4b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.733535:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd72c4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.733541:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd72c4b0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143743.733568:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.733589:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963593584768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 122us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.733595:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6328 00000100:00100000:0.0:1746143743.734723:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.734738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.736297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.737537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.737550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.745346:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593586176 00000100:00100000:0.0:1746143743.745352:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593586176 00002000:00100000:0.0:1746143743.745383:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1126400->1568767) req@ffff8800930d1500 x1830963593586176/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:139/0 lens 488/0 e 0 to 0 dl 1746143754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.745402:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963593586176 ext(1126400->1568767) 00010000:00010000:0.0:1746143743.745409:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c8f200/0xe984082ccd72c2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ea expref: 17 pid: 15784 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.745426:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c8f200/0xe984082ccd72c2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ea expref: 17 pid: 15784 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746143743.745433:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d1500 00000100:00100000:0.0:1746143743.745484:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1582 00000100:00100000:0.0:1746143743.745490:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963593586176:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143743.747225:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963593584512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19775us (19861us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143743.747232:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5506 00002000:00100000:0.0:1746143743.747239:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6c380 x1830963593584512/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:139/0 lens 488/440 e 0 to 0 dl 1746143754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.747246:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c380 with x1830963593584512 ext(1048576->2097151) 00010000:00010000:0.0:1746143743.747253:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c471 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56ca expref: 31 pid: 4582 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.747262:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c471 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56ca expref: 31 pid: 4582 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746143743.747268:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca6c380 00000100:00100000:0.0:1746143743.747287:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593586048 00000100:00100000:0.0:1746143743.747290:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593586048 00010000:00010000:0.0:1746143743.747302:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72c408 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5676 expref: 31 pid: 21542 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.747329:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6332 00000100:00100000:0.0:1746143743.747333:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1963:x1830963593586048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.747341:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.747353:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72c408 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5676 expref: 31 pid: 21542 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.747360:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72c408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5676 expref: 31 pid: 21542 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.747376:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72c408 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5676 expref: 31 pid: 21542 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.747400:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.747416:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963593586048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 82us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.747421:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6332 00000100:00100000:0.0:1746143743.753284:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.753513:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.753528:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.753540:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.753553:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.753960:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.754171:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.756599:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.756617:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593586944 00000100:00100000:0.0:1746143743.756626:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593586944 00010000:00010000:0.0:1746143743.756641:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91fa00/0xe984082ccd72c2c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55d5 expref: 19 pid: 25369 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.756654:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593587072 00000100:00100000:0.0:1746143743.756656:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593587072 00010000:00010000:0.0:1746143743.756662:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bfac00/0xe984082ccd72c2b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ce expref: 8 pid: 8497 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746143743.756671:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6339 00000100:00100000:0.0:1746143743.756675:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963593586944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.756682:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.756691:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a91fa00/0xe984082ccd72c2c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55d5 expref: 19 pid: 25369 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.756698:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a91fa00/0xe984082ccd72c2c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55d5 expref: 19 pid: 25369 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.756708:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a91fa00/0xe984082ccd72c2c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55d5 expref: 19 pid: 25369 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.756716:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.756732:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963593586944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 57us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.756737:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6339 00000100:00100000:0.0:1746143743.756748:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6340 00000100:00100000:0.0:1746143743.756752:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1963:x1830963593587072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.756763:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.756769:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bfac00/0xe984082ccd72c2b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ce expref: 8 pid: 8497 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.756777:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bfac00/0xe984082ccd72c2b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ce expref: 8 pid: 8497 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.756786:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bfac00/0xe984082ccd72c2b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a55ce expref: 8 pid: 8497 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.756793:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.756795:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.756798:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756804:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756818:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143743.756829:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1963:x1830963593587072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.756835:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6340 00010000:00010000:0.0:1746143743.756849:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756855:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756876:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756881:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756886:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756890:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a07dc200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143743.756893:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756899:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756907:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.756912:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc200/0xe984082ccd72c4da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.756941:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593585280:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 19026us (19390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.756947:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12027 00000100:00100000:0.0:1746143743.766983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.768755:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.771067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.778188:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.779130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.781133:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.784929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.797047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.804919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.805844:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593588864 00000100:00100000:0.0:1746143743.805847:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593588864 00000100:00100000:0.0:1746143743.806211:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593589248 00000100:00100000:0.0:1746143743.806215:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593589248 00000100:00100000:0.0:1746143743.806235:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12030 00000100:00100000:0.0:1746143743.806240:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963593588864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.806247:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.806257:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941d9800/0xe984082ccd72c519 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a56fb expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143743.806270:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x681409ff, atime: 0x681409fe, ctime: 0x681409fe, blocks: 0x7a3 00010000:00010000:0.0:1746143743.806278:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.806280:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.806284:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9800/0xe984082ccd72c519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56fb expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.806294:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941d9800/0xe984082ccd72c519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56fb expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.807205:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d9800, rc 0) 00000100:00100000:0.0:1746143743.807239:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593588864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 998us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.807244:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12030 00000100:00100000:0.0:1746143743.807649:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.807679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.807704:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.807722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.807734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.807745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.807763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.807788:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12033 00000100:00100000:0.0:1746143743.807794:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963593589632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.807802:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.807811:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941d9a00/0xe984082ccd72c52e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5725 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.807824:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.807826:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.807831:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941d9a00/0xe984082ccd72c52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5725 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.807841:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941d9a00/0xe984082ccd72c52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5725 expref: 24 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.807847:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d9a00, rc 0) 00000100:00100000:0.0:1746143743.807867:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593589632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.807883:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12033 00000100:00100000:0.0:1746143743.807899:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12039 00000100:00100000:0.0:1746143743.807904:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963593589376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143743.807910:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143743.807916:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941d8400/0xe984082ccd72c558 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5717 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.807953:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.807955:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.807959:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941d8400/0xe984082ccd72c558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5717 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.807967:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941d8400/0xe984082ccd72c558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5717 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143743.807974:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d8400, rc 0) 00000100:00100000:0.0:1746143743.807995:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963593589376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143743.808001:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12039 00000100:00100000:0.0:1746143743.828395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.828431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.828456:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.828879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.881983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.897985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.901884:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.907038:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.909446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.909475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.909494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.909525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.929644:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.933595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.943929:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593594496 00000100:00100000:0.0:1746143743.943938:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593594496 00010000:00010000:0.0:1746143743.943966:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bedae00/0xe984082ccd72c53c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a573a expref: 20 pid: 8496 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746143743.943997:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6345 00000100:00100000:0.0:1746143743.944002:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963593594496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.944011:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143743.944027:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bedae00/0xe984082ccd72c53c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a573a expref: 20 pid: 8496 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.944037:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bedae00/0xe984082ccd72c53c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a573a expref: 20 pid: 8496 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.944054:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bedae00/0xe984082ccd72c53c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a573a expref: 20 pid: 8496 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746143743.944074:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.944076:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.944081:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd72c55f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5748 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.944099:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd72c55f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5748 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.944125:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd72c55f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5748 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.944135:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594134656:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143743.944207:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.948587:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.948625:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.954540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.954593:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.959919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.959985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.960293:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6347 00000100:00100000:0.0:1746143743.960300:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963593595520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143743.960309:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143743.960318:0:9890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143742 -> 1746143743 00002000:00010000:0.0:1746143743.960320:0:9890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143742 -> 1746143743 00010000:00010000:0.0:1746143743.960324:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd72c55f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5748 expref: 12 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.960333:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd72c55f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5748 expref: 12 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.960356:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a034ba00/0xe984082ccd72c55f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5748 expref: 12 pid: 21542 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746143743.960369:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.960371:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143743.960376:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6567000/0xe984082ccd72c57b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5756 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.960397:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6567000/0xe984082ccd72c57b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5756 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143743.960422:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6567000/0xe984082ccd72c57b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5756 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143743.960432:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c22d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594135168:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143743.960471:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143743.962274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.972792:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5520 00000100:00100000:0.0:1746143743.972799:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593596160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143743.972937:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593596160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 138us (346us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143743.972942:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5520 00002000:00100000:0.0:1746143743.972947:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2797568->2801663) req@ffff8801305cb480 x1830963593596160/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746143754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143743.972965:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb480 with x1830963593596160 ext(2797568->2801663) 00002000:00010000:0.0:1746143743.972968:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cb480 00000100:00100000:0.0:1746143743.980752:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.990910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143743.995326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.016664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.025060:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143744.025337:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143744.042549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.047018:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.051471:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.054312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.065495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.065543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143744.066200:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143744.108664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.117249:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.145538:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.152698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.154289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.154310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.165536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.165757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.165790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.165848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.184498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.197274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.206501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.209918:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.220572:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.220592:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.220615:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.220645:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.232516:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.236222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.237904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143744.238493:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143744.238520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143744.239135:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143744.241663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.253295:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.255753:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.255848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.258556:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.261498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.261636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.265092:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.277258:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.277303:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.286040:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.286100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.286113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.286133:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.287282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.287314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.287327:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593605888 00000100:00100000:0.0:1746143744.287330:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593605888 00000100:00100000:0.0:1746143744.287350:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12060 00000100:00100000:0.0:1746143744.287354:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593605376:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143744.287396:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.287410:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72c512 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5702 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.287417:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c8fa00/0xe984082ccd72c61c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a57aa expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.287425:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941d9a00/0xe984082ccd72c52e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5725 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.287430:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.287431:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.287433:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.287453:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941d9a00/0xe984082ccd72c52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5725 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.287464:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941d9a00/0xe984082ccd72c52e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5725 expref: 23 pid: 21542 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.287482:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594138240:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143744.287553:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c8fa00/0xe984082ccd72c61c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a57aa expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.287560:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c8fa00/0xe984082ccd72c61c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a57aa expref: 9 pid: 8497 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.287566:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594138752:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143744.287586:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72c512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5702 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.287592:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72c512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5702 expref: 10 pid: 8497 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.287598:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594139008:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143744.287614:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143744.293550:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.294692:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.294983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.295222:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594138752:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143744.303320:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594139008:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143744.303336:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143744.305171:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593606528 00000100:00100000:0.0:1746143744.305175:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593606528 00010000:00010000:0.0:1746143744.305189:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b410e400/0xe984082ccd72c527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a571e expref: 18 pid: 8497 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.305202:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593607040 00000100:00100000:0.0:1746143744.305204:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593607040 00010000:00010000:0.0:1746143744.305211:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c535 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a572c expref: 23 pid: 9527 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.305217:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593606656 00000100:00100000:0.0:1746143744.305219:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593606656 00010000:00010000:0.0:1746143744.305224:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72c512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5702 expref: 11 pid: 8497 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.305230:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593606912 00000100:00100000:0.0:1746143744.305231:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593606912 00010000:00010000:0.0:1746143744.305238:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009808b400/0xe984082ccd72c615 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a57a3 expref: 9 pid: 21542 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.305243:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593607296 00000100:00100000:0.0:1746143744.305244:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593607296 00010000:00010000:0.0:1746143744.305250:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9800/0xe984082ccd72c519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56fb expref: 14 pid: 9527 timeout: 923 lvb_type: 1 00000100:00100000:0.0:1746143744.305259:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6363 00000100:00100000:0.0:1746143744.305263:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963593606528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143744.305400:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143744.305413:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b410e400/0xe984082ccd72c527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a571e expref: 18 pid: 8497 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305420:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b410e400/0xe984082ccd72c527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a571e expref: 18 pid: 8497 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305432:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b410e400/0xe984082ccd72c527 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a571e expref: 18 pid: 8497 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305446:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143744.305468:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963593606528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 205us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.305473:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6363 00000100:00100000:0.0:1746143744.305483:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6364 00000100:00100000:0.0:1746143744.305487:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963593607040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143744.305492:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143744.305500:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c535 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a572c expref: 23 pid: 9527 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305507:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c535 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a572c expref: 23 pid: 9527 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305515:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd72c535 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a572c expref: 23 pid: 9527 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305530:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.305532:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.305535:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095114600/0xe984082ccd72c69a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.305542:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095114600/0xe984082ccd72c69a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.305555:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143744.305565:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963593607040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 78us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.305569:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6364 00000100:00100000:0.0:1746143744.305575:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6365 00000100:00100000:0.0:1746143744.305579:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963593606656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143744.305584:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143744.305590:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72c512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5702 expref: 11 pid: 8497 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305597:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72c512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5702 expref: 11 pid: 8497 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305605:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164600/0xe984082ccd72c512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5702 expref: 11 pid: 8497 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305611:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.305615:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.305618:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.305623:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.305632:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143744.305644:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593606656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.305648:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6365 00000100:00100000:0.0:1746143744.305656:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6366 00000100:00100000:0.0:1746143744.305660:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593606912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143744.305665:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143744.305671:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009808b400/0xe984082ccd72c615 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a57a3 expref: 9 pid: 21542 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305679:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009808b400/0xe984082ccd72c615 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a57a3 expref: 9 pid: 21542 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305688:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009808b400/0xe984082ccd72c615 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a57a3 expref: 9 pid: 21542 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.305696:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143744.305707:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593606912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.305711:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6366 00000100:00100000:0.0:1746143744.305718:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6367 00000100:00100000:0.0:1746143744.305725:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963593607296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143744.305730:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143744.305736:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941d9800/0xe984082ccd72c519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56fb expref: 14 pid: 9527 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.308948:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941d9800/0xe984082ccd72c519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56fb expref: 16 pid: 9527 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.308966:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941d9800/0xe984082ccd72c519 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a56fb expref: 16 pid: 9527 timeout: 923 lvb_type: 1 00010000:00010000:0.0:1746143744.308976:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.308978:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.308982:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f81ae00/0xe984082ccd72c6a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.308989:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81ae00/0xe984082ccd72c6a8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309011:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143744.309035:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963593607296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3308us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.309042:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6367 00010000:00010000:0.0:1746143744.309075:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309082:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309205:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309213:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309219:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309224:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7b6e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143744.309227:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309233:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309241:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.309246:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7b6e00/0xe984082ccd72c693 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143744.309276:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593605376:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 21921us (23176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.309282:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12060 00000100:00100000:0.0:1746143744.309363:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.345296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.347728:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.350189:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.353862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.364317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.364356:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.364392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.364416:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.364435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.364454:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593609216 00000100:00100000:0.0:1746143744.364460:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593609216 00000100:00100000:0.0:1746143744.364492:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593609344 00000100:00100000:0.0:1746143744.364494:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593609344 00000100:00100000:0.0:1746143744.364504:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593609472 00000100:00100000:0.0:1746143744.364505:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593609472 00000100:00100000:0.0:1746143744.364513:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593609600 00000100:00100000:0.0:1746143744.364514:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593609600 00000100:00100000:0.0:1746143744.364522:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593609728 00000100:00100000:0.0:1746143744.364523:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593609728 00000100:00100000:0.0:1746143744.364534:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12066 00000100:00100000:0.0:1746143744.364539:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963593609216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143744.364554:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143744.364570:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f81aa00/0xe984082ccd72c70a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5813 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143744.364591:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x681409ff, atime: 0x681409fe, ctime: 0x681409fe, blocks: 0x7a3 00010000:00010000:0.0:1746143744.364604:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364606:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364614:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81aa00/0xe984082ccd72c70a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5813 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364643:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f81aa00/0xe984082ccd72c70a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5813 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364653:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81aa00, rc 0) 00000100:00100000:0.0:1746143744.364692:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963593609216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 152us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.364697:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12066 00000100:00100000:0.0:1746143744.364713:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12067 00000100:00100000:0.0:1746143744.364718:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963593609344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143744.364724:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143744.364734:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61ca600/0xe984082ccd72c711 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a581a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143744.364747:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x681409ff, atime: 0x681409fe, ctime: 0x681409fe, blocks: 0x81f 00010000:00010000:0.0:1746143744.364755:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364756:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364760:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61ca600/0xe984082ccd72c711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a581a expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364769:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61ca600/0xe984082ccd72c711 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a581a expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364775:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ca600, rc 0) 00000100:00100000:0.0:1746143744.364789:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593609344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 71us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.364800:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12067 00000100:00100000:0.0:1746143744.364809:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12068 00000100:00100000:0.0:1746143744.364814:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963593609472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143744.364819:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143744.364833:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61cae00/0xe984082ccd72c718 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5821 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143744.364842:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x681409ff, atime: 0x681409fe, ctime: 0x681409ff, blocks: 0x81f 00010000:00010000:0.0:1746143744.364850:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364851:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364854:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61cae00/0xe984082ccd72c718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5821 expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364862:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61cae00/0xe984082ccd72c718 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5821 expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364868:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cae00, rc 0) 00000100:00100000:0.0:1746143744.364884:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593609472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 70us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.364888:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12068 00000100:00100000:0.0:1746143744.364897:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12069 00000100:00100000:0.0:1746143744.364901:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963593609600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143744.364906:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143744.364913:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72c71f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5828 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143744.364931:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x681409ff, atime: 0x681409ff, ctime: 0x681409ff, blocks: 0x821 00010000:00010000:0.0:1746143744.364939:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364940:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.364944:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72c71f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5828 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364952:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72c71f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5828 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143744.364959:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cba00, rc 0) 00000100:00100000:0.0:1746143744.364975:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963593609600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 73us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.364979:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12069 00000100:00100000:0.0:1746143744.364989:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12070 00000100:00100000:0.0:1746143744.364993:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963593609728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143744.364998:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143744.365003:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61caa00/0xe984082ccd72c726 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a582f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143744.365035:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594139904:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143744.365094:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143744.365119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.366297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143744.368603:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368627:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368649:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368656:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368662:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368669:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5003000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143744.368672:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368679:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368688:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.368689:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143744.368694:0:4582:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6238e00/0xe984082ccd72c6e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5805 expref: 14 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368700:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6238e00/0xe984082ccd72c6e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5805 expref: 14 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.368736:0:4582:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6238e00/0xe984082ccd72c6e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5805 expref: 14 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143744.368747:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594140032:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143744.368797:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143744.371652:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594140032:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143744.371667:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.371674:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72c6af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143744.371732:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1965:x1830963593605760:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 84111us (84451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143744.371740:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12063 00000100:00100000:0.0:1746143744.374547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.378679:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.380973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.381046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.381507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.389209:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963593610240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14506us (14661us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143744.389219:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5532 00002000:00100000:0.0:1746143744.389228:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a0878a80 x1830963593610240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:140/0 lens 488/440 e 0 to 0 dl 1746143755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.389242:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878a80 with x1830963593610240 ext(3145728->4194303) 00002000:00010000:0.0:1746143744.389246:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0878a80 00000100:00100000:0.0:1746143744.397212:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.403674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.418111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437231:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437294:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437324:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437342:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437355:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437394:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437408:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437433:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.437700:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593613312 00000100:00100000:0.0:1746143744.437703:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593613312 00002000:00100000:0.0:1746143744.437724:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094304e00 x1830963593613312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:140/0 lens 488/0 e 0 to 0 dl 1746143755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.437731:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963593613312 ext(3145728->4194303) 00002000:00010000:0.0:1746143744.437733:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746143744.437744:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593614080 00000100:00100000:0.0:1746143744.437746:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593614080 00002000:00100000:0.0:1746143744.437754:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094306d80 x1830963593614080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:140/0 lens 488/0 e 0 to 0 dl 1746143755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.437760:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830963593614080 ext(3145728->4194303) 00002000:00010000:0.0:1746143744.437762:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306d80 00000100:00100000:0.0:1746143744.437786:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5538 00000100:00100000:0.0:1746143744.437792:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963593613184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143744.439250:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5540 00000100:00100000:0.0:1746143744.439258:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963593613312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143744.465906:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.473709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.496461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.496610:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.511477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.543042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.553368:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.553931:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.556320:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.569622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.578238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.581844:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.596187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.609043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.615950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.620683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.631401:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593617792 00000100:00100000:0.0:1746143744.631409:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593617792 00002000:00100000:0.0:1746143744.631445:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4251648->4255743) req@ffff88009ca6e680 x1830963593617792/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:140/0 lens 488/0 e 0 to 0 dl 1746143755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.631454:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e680 with x1830963593617792 ext(4251648->4255743) 00002000:00010000:0.0:1746143744.631458:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6e680 00000100:00100000:0.0:1746143744.632039:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5547 00000100:00100000:0.0:1746143744.632048:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963593617792:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143744.632413:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963593617792:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 366us (1500us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143744.632420:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5547 00002000:00100000:0.0:1746143744.632426:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4251648->4255743) req@ffff88009ca6e680 x1830963593617792/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746143755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.632434:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e680 with x1830963593617792 ext(4251648->4255743) 00002000:00010000:0.0:1746143744.632437:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6e680 00000100:00100000:0.0:1746143744.634959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.638364:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.658553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.658593:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.658823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.686736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.701960:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.707056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.711232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.711269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.744771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.751582:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12082 00000100:00100000:0.0:1746143744.751589:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963593620992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143744.751595:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143744.751602:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b78a5c00/0xe984082ccd72c7f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a589f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143744.751635:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594141568:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143744.751663:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143744.776733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.776806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.777959:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.777981:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593621760 00000100:00100000:0.0:1746143744.777987:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593621760 00002000:00100000:0.0:1746143744.778011:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093b07100 x1830963593621760/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:140/0 lens 488/0 e 0 to 0 dl 1746143755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.778018:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07100 with x1830963593621760 ext(1048576->2097151) 00002000:00010000:0.0:1746143744.778022:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b07100 00000100:00100000:0.0:1746143744.778064:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5555 00000100:00100000:0.0:1746143744.778072:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963593621760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143744.784418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.789242:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.804015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.842474:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.842519:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.846562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.851345:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.867036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.869407:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8900 00000100:00100000:0.0:1746143744.869418:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:30663:x1830963593623168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143744.869437:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143744.869462:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89cc00/0xe984082ccd72c837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a58c2 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.869554:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869565:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869573:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869583:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869588:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869592:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869673:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c600/0xe984082ccd72c84c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869680:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c600/0xe984082ccd72c84c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869685:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c600/0xe984082ccd72c84c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143744.869692:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:0.0:1746143744.869758:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869764:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869773:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869778:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f89da00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143744.869781:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869787:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869796:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143744.869799:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143744.869802:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869806:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd72c83e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869828:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869834:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869839:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869842:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f89c400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143744.869844:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869849:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869861:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c400) 00010000:00010000:0.0:1746143744.869863:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143744.869865:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869870:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c400/0xe984082ccd72c845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143744.869899:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89cc00/0xe984082ccd72c837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58c2 expref: 267 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.869908:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c600/0xe984082ccd72c84c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58c2 expref: 266 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143744.869913:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143744.869915:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143744.869917:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f89c600, rc 0) 00000100:00100000:0.0:1746143744.869960:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:30663:x1830963593623168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 545us (2934us total) trans 8589943153 rc 0/0 00000100:00100000:0.0:1746143744.869965:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8900 00000100:00100000:0.0:1746143744.872957:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.872996:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.876266:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.882281:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.896707:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.903064:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.920005:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963593624448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13199us (13558us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143744.920025:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5558 00002000:00100000:0.0:1746143744.920036:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305c8000 x1830963593624448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:140/0 lens 488/440 e 0 to 0 dl 1746143755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.920045:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8000 with x1830963593624448 ext(2097152->3145727) 00002000:00010000:0.0:1746143744.920050:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8000 00000100:00100000:0.0:1746143744.924537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.924971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.936740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.936805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.938354:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5561 00000100:00100000:0.0:1746143744.938365:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963593625472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143744.944155:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.944211:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.944250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.944273:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593625984 00000100:00100000:0.0:1746143744.944280:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593625984 00002000:00100000:0.0:1746143744.944311:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093d54a80 x1830963593625984/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:140/0 lens 488/0 e 0 to 0 dl 1746143755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143744.944320:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d54a80 with x1830963593625984 ext(2097152->3145727) 00002000:00010000:0.0:1746143744.944324:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093d54a80 00000100:00100000:0.0:1746143744.944580:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5563 00000100:00100000:0.0:1746143744.944586:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963593625984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143744.955577:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.970107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.970187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.976665:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.981177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.988738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.992006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.992607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.998714:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.999290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.999312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143744.999323:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.002563:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.005468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.009023:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.009061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.011610:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.013134:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594144256:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143745.013186:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b78a5c00/0xe984082ccd72c8a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a590f expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.013197:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b78a5c00/0xe984082ccd72c8a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a590f expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.013208:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b78a5c00, rc 0) 00000100:00100000:0.0:1746143745.013240:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593628672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3995us (4178us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143745.013247:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12096 00000100:00100000:0.0:1746143745.016566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.020096:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593629312 00000100:00100000:0.0:1746143745.020102:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593629312 00000100:00100000:0.0:1746143745.020137:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12097 00000100:00100000:0.0:1746143745.020154:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593629312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143745.020167:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143745.020180:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3800/0xe984082ccd72c8a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5916 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143745.020220:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594144384:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143745.020295:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143745.021831:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593629568 00000100:00100000:0.0:1746143745.021836:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593629568 00000100:00100000:0.0:1746143745.021869:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3753 00000100:00100000:0.0:1746143745.021874:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:30660:x1830963593629568:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143745.022489:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:30660:x1830963593629568:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 613us (805us total) trans 8589943154 rc 0/0 00000100:00100000:0.0:1746143745.022496:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3753 00000100:00100000:0.0:1746143745.023818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.032566:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593630208 00000100:00100000:0.0:1746143745.032570:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593630208 00010000:00010000:0.0:1746143745.032585:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6567800/0xe984082ccd72c861 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58d0 expref: 22 pid: 8495 timeout: 924 lvb_type: 0 00000100:00100000:0.0:1746143745.032607:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6388 00000100:00100000:0.0:1746143745.032612:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963593630208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143745.032620:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143745.032641:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6567800/0xe984082ccd72c861 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58d0 expref: 22 pid: 8495 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143745.032650:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6567800/0xe984082ccd72c861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58d0 expref: 22 pid: 8495 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143745.032662:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6567800/0xe984082ccd72c861 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58d0 expref: 22 pid: 8495 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143745.032672:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.032673:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.032677:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f79d600/0xe984082ccd72c8ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4718591] (req 4194304->4710399) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a591d expref: 15 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.032683:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f79d600/0xe984082ccd72c8ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4718591] (req 4194304->4710399) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a591d expref: 15 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.032706:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f79d600/0xe984082ccd72c8ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4718591] (req 4194304->4710399) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a591d expref: 15 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143745.032715:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594145024:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143745.033350:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143745.036211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.036244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.036272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.036285:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.038309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.042772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.051427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.063870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.066218:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.067726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143745.069179:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd72c8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069185:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd72c8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143745.069226:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00000004:00200000:0.0:1746143745.069230:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143745.069245:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd72c8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069254:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd72c8f4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069263:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72c8e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069268:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72c8e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069274:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72c8e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069279:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368c6e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143745.069282:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72c8e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069288:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72c8e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069296:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143745.069308:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143745.069311:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72c8e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069315:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72c8e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069337:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd72c8ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069341:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd72c8ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069346:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd72c8ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069349:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d8600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143745.069351:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd72c8ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069355:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd72c8ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069361:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ba5a200) 00010000:00010000:0.0:1746143745.069363:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143745.069365:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd72c8ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069380:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd72c8ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143745.069713:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d42f000/0xe984082ccd72c8df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a594e expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.069733:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9c00/0xe984082ccd72c8f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a594e expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.069738:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143745.069740:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143745.069742:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9c00, rc 0) 00000100:00100000:0.0:1746143745.069775:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:30668:x1830963593631872:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 5660us (5912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.069782:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8901 00000100:00100000:0.0:1746143745.072273:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.072311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.072339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.072363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.072388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.072411:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.079636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.084937:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.088313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.091556:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.095545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.095576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.095608:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.096897:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.096926:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.096966:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.102985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.103024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.103083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.106983:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.109564:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.109595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.109972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.110003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.110016:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.112252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.112295:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.123936:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143745.132093:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132103:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132122:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132129:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132136:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132171:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5806a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143745.132175:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132183:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132197:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143745.132203:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5806a00/0xe984082ccd72c964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143745.132251:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593634432:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 36344us (36641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.132258:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12113 00000100:00100000:0.0:1746143745.139856:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963593635712:12345-192.168.202.48@tcp:4:cat.0 Request processed in 26949us (27600us total) trans 17179872868 rc 0/0 00000100:00100000:0.0:1746143745.139867:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1600 00002000:00100000:0.0:1746143745.139876:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3678208->4194303) req@ffff88012b7cdf80 x1830963593635712/t17179872868(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:141/0 lens 488/448 e 0 to 0 dl 1746143756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143745.139885:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdf80 with x1830963593635712 ext(3678208->4194303) 00010000:00010000:0.0:1746143745.139894:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5807c00/0xe984082ccd72c88b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58fa expref: 13 pid: 4581 timeout: 924 lvb_type: 0 00010000:00010000:0.0:1746143745.139906:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5807c00/0xe984082ccd72c88b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a58fa expref: 13 pid: 4581 timeout: 924 lvb_type: 0 00002000:00010000:0.0:1746143745.139912:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7cdf80 00000100:00100000:0.0:1746143745.141796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.146070:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.161802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.161835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.161865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.163261:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.190933:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12125 00000100:00100000:0.0:1746143745.190940:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594148608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143745.191029:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594148608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (431us total) trans 21474840185 rc 0/0 00000100:00100000:0.0:1746143745.191035:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12125 00000100:00100000:0.0:1746143745.191051:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149248 00000100:00100000:0.0:1746143745.191054:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149248 00000100:00100000:0.0:1746143745.191073:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149760 00000100:00100000:0.0:1746143745.191075:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149760 00000100:00100000:0.0:1746143745.191081:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149120 00000100:00100000:0.0:1746143745.191082:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149120 00000100:00100000:0.0:1746143745.191088:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149632 00000100:00100000:0.0:1746143745.191089:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149632 00000100:00100000:0.0:1746143745.191096:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12127 00000100:00100000:0.0:1746143745.191100:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963594149760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143745.191219:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3293:x1830963594149760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (216us total) trans 17179872869 rc 0/0 00000100:00100000:0.0:1746143745.191224:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12127 00000100:00080000:0.0:1746143745.191345:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746143745.193221:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 34 in progress, 0 in flight, 6 done 00000004:00080000:0.0:1746143745.193341:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 26 done 00000100:00100000:0.0:1746143745.200736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.206393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.206425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.206452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.206464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.206476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.206546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143745.206565:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593637632 00000100:00100000:0.0:1746143745.206571:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593637632 00000100:00100000:0.0:1746143745.206599:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593637888 00000100:00100000:0.0:1746143745.206601:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593637888 00000100:00100000:0.0:1746143745.206611:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593638144 00000100:00100000:0.0:1746143745.206613:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593638144 00000100:00100000:0.0:1746143745.206621:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593637760 00000100:00100000:0.0:1746143745.206622:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593637760 00000100:00100000:0.0:1746143745.206629:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593638016 00000100:00100000:0.0:1746143745.206631:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593638016 00000100:00100000:0.0:1746143745.206639:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593638272 00000100:00100000:0.0:1746143745.206640:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593638272 00000100:00100000:0.0:1746143745.206649:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12134 00000100:00100000:0.0:1746143745.206656:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593637632:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143745.206670:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143745.206684:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091036600/0xe984082ccd72c99c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59a2 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143745.206705:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x681409ff, atime: 0x681409fe, ctime: 0x681409fe, blocks: 0x7a3 00010000:00010000:0.0:1746143745.206720:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.206721:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.206730:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091036600/0xe984082ccd72c99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a2 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.206747:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091036600/0xe984082ccd72c99c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a2 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.206755:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091036600, rc 0) 00000100:00100000:0.0:1746143745.206787:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593637632:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 132us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.206793:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12134 00000100:00100000:0.0:1746143745.206807:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12135 00000100:00100000:0.0:1746143745.206811:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593637888:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143745.206817:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143745.206826:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091036200/0xe984082ccd72c9a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59b0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143745.206838:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a00, atime: 0x68140a00, ctime: 0x68140a00, blocks: 0x81f 00010000:00010000:0.0:1746143745.206845:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.206846:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.206849:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091036200/0xe984082ccd72c9a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59b0 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.206858:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091036200/0xe984082ccd72c9a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59b0 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.206864:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091036200, rc 0) 00000100:00100000:0.0:1746143745.206876:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593637888:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 65us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.206884:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12135 00000100:00100000:0.0:1746143745.206893:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12136 00000100:00100000:0.0:1746143745.206897:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593638144:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143745.206902:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143745.206908:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091036400/0xe984082ccd72c9aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59be expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143745.206917:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4755392, mtime: 0x68140a00, atime: 0x68140a00, ctime: 0x68140a00, blocks: 0x1487 00010000:00010000:0.0:1746143745.206923:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.206924:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.206928:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091036400/0xe984082ccd72c9aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59be expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.206935:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091036400/0xe984082ccd72c9aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59be expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.206941:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091036400, rc 0) 00000100:00100000:0.0:1746143745.206952:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593638144:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 55us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.206957:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12136 00000100:00100000:0.0:1746143745.206966:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12137 00000100:00100000:0.0:1746143745.206970:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593637760:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143745.206974:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143745.206980:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091036000/0xe984082ccd72c9b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59a9 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143745.206993:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x681409ff, atime: 0x681409fe, ctime: 0x681409fe, blocks: 0x81f 00010000:00010000:0.0:1746143745.206999:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.207000:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.207003:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091036000/0xe984082ccd72c9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a9 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.207011:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091036000/0xe984082ccd72c9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a9 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.207017:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091036000, rc 0) 00000100:00100000:0.0:1746143745.207029:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593637760:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 59us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.207033:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12137 00000100:00100000:0.0:1746143745.207040:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12138 00000100:00100000:0.0:1746143745.207044:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593638016:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143745.207049:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143745.207055:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd72c9b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59b7 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143745.207064:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a00, atime: 0x681409ff, ctime: 0x68140a00, blocks: 0x821 00010000:00010000:0.0:1746143745.207069:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.207070:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.207074:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd72c9b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59b7 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.207086:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd72c9b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59b7 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.207092:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1800, rc 0) 00000100:00100000:0.0:1746143745.207103:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593638016:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 58us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.207107:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12138 00000100:00100000:0.0:1746143745.207114:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12139 00000100:00100000:0.0:1746143745.207118:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593638272:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143745.207123:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143745.207129:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd72c9bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59c5 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143745.207169:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a00, atime: 0x68140a00, ctime: 0x68140a00, blocks: 0x1029 00010000:00010000:0.0:1746143745.207176:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.207178:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143745.207181:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd72c9bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59c5 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.207189:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1c00/0xe984082ccd72c9bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59c5 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143745.207196:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1c00, rc 0) 00000100:00100000:0.0:1746143745.207209:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593638272:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 90us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143745.207217:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12139 00000100:00100000:0.0:1746143746.222098:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.227025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.227088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.227125:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593638912 00000100:00100000:0.0:1746143746.227133:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593638912 00000100:00100000:0.0:1746143746.229523:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5574 00000100:00100000:0.0:1746143746.229530:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593638912:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143746.229550:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0a00/0xe984082ccd72c9d4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.229558:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.229560:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.229564:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e0a00/0xe984082ccd72c9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.229572:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e0a00/0xe984082ccd72c9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143746.232712:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.232734:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.234055:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.234567:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.235524:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.235537:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593640192 00000100:00100000:0.0:1746143746.235541:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593640192 00000100:00100000:0.0:1746143746.235556:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593639808 00000100:00100000:0.0:1746143746.235558:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593639808 00000100:00100000:0.0:1746143746.235569:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5578 00000100:00100000:0.0:1746143746.235574:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963593640192:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143746.235588:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a6567800/0xe984082ccd72c9f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.235596:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.235597:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.235600:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6567800/0xe984082ccd72c9f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.235609:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6567800/0xe984082ccd72c9f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.289487:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800936cdc00/0xe984082ccd72c9db lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.289495:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800936cdc00/0xe984082ccd72c9db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.289501:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800936cdc00/0xe984082ccd72c9db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.289506:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800936cdc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143746.289508:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936cdc00/0xe984082ccd72c9db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.289513:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800936cdc00/0xe984082ccd72c9db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.289527:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800936cdc00/0xe984082ccd72c9db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.289532:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936cdc00/0xe984082ccd72c9db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143746.289583:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593639168:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 54907us (56874us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143746.289589:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5575 00000100:00100000:0.0:1746143746.295227:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.301057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.303124:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.328232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.328675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.329517:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8909 00000100:00100000:0.0:1746143746.329524:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:30675:x1830963593641344:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143746.329532:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.329539:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72ca21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59d3 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.329576:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329583:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329589:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329596:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329600:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329605:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329649:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd72ca36 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329655:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd72ca36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329661:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd72ca36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143746.329666:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:0.0:1746143746.329699:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329704:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329709:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329713:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4c08600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143746.329716:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329720:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329728:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143746.329730:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143746.329732:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329736:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329748:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329753:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329757:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329761:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4c09c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143746.329763:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329768:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329772:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ba5ab00) 00010000:00010000:0.0:1746143746.329774:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143746.329776:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329780:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143746.329807:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72ca21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59d3 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.329817:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd72ca36 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59d3 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.329822:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143746.329824:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143746.329826:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08000, rc 0) 00000100:00100000:0.0:1746143746.329863:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:30675:x1830963593641344:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 340us (1188us total) trans 8589943164 rc 0/0 00000100:00100000:0.0:1746143746.329869:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8909 00000100:00100000:0.0:1746143746.344407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.346192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.346845:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.346858:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.346884:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.346905:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.346924:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.346937:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593641856 00000100:00100000:0.0:1746143746.346940:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593641856 00000100:00100000:0.0:1746143746.346959:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593641984 00000100:00100000:0.0:1746143746.346961:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593641984 00000100:00100000:0.0:1746143746.346968:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593642112 00000100:00100000:0.0:1746143746.346969:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593642112 00000100:00100000:0.0:1746143746.346977:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593642240 00000100:00100000:0.0:1746143746.346978:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593642240 00000100:00100000:0.0:1746143746.346987:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593642368 00000100:00100000:0.0:1746143746.346989:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593642368 00000100:00100000:0.0:1746143746.346999:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12141 00000100:00100000:0.0:1746143746.347004:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1963:x1830963593641856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.347012:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.347021:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d42f000/0xe984082ccd72ca60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59e8 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.347032:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347033:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347038:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d42f000/0xe984082ccd72ca60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59e8 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347048:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d42f000/0xe984082ccd72ca60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59e8 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347054:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d42f000, rc 0) 00000100:00100000:0.0:1746143746.347073:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963593641856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.347079:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12141 00000100:00100000:0.0:1746143746.347089:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12142 00000100:00100000:0.0:1746143746.347094:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1963:x1830963593641984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.347099:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.347104:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08c00/0xe984082ccd72ca67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59ef expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.347114:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347115:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347119:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08c00/0xe984082ccd72ca67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59ef expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347127:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08c00/0xe984082ccd72ca67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59ef expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347134:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08c00, rc 0) 00000100:00100000:0.0:1746143746.347166:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963593641984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.347171:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12142 00000100:00100000:0.0:1746143746.347181:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12143 00000100:00100000:0.0:1746143746.347185:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963593642112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.347191:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.347197:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59f6 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.347206:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347207:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347211:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59f6 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347220:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59f6 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347226:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09c00, rc 0) 00000100:00100000:0.0:1746143746.347239:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963593642112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.347243:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12143 00000100:00100000:0.0:1746143746.347251:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12144 00000100:00100000:0.0:1746143746.347255:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963593642240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.347262:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.347267:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a59fd expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.347275:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347276:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347280:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59fd expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347287:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08600/0xe984082ccd72ca75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59fd expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347293:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08600, rc 0) 00000100:00100000:0.0:1746143746.347305:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963593642240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 50us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.347309:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12144 00000100:00100000:0.0:1746143746.347318:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12145 00000100:00100000:0.0:1746143746.347322:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1963:x1830963593642368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.347327:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.347332:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c09e00/0xe984082ccd72ca7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5a04 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.347341:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347342:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.347345:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c09e00/0xe984082ccd72ca7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a04 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347353:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c09e00/0xe984082ccd72ca7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a04 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.347373:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09e00, rc 0) 00000100:00100000:0.0:1746143746.347387:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963593642368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.347391:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12145 00000100:00100000:0.0:1746143746.355847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.377229:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.382043:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593644160 00000100:00100000:0.0:1746143746.382049:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593644160 00000100:00100000:0.0:1746143746.382085:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8913 00000100:00100000:0.0:1746143746.382090:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:30675:x1830963593644160:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143746.382101:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.382103:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746143746.382110:0:16090:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368c6e00/0xe984082ccd72ca4b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59da expref: 10 pid: 14762 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.382124:0:16090:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd72ca36 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59d3 expref: 10 pid: 20509 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.382131:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143746.382134:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd72ca9f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143746.382154:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd72ca9f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143746.382158:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143746.382164:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0750400/0xe984082ccd72caa6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5a19 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.382185:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0751000/0xe984082ccd72caad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.382280:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd72ca9f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143746.382286:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0751000/0xe984082ccd72caad lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.382296:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd72ca9f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143746.382304:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0751000/0xe984082ccd72caad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143746.382663:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.384349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.384385:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.384414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.385202:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6408 00000100:00100000:0.0:1746143746.385212:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593644672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.385219:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.385223:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd72c987 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5994 expref: 11 pid: 14763 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.385313:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b410e400/0xe984082ccd72c987 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5994 expref: 11 pid: 14763 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.385324:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143746.385328:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06dc00/0xe984082ccd72cabb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143746.385334:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd72ca9f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143746.385338:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d0c00/0xe984082ccd72ca9f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143746.385343:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06dc00/0xe984082ccd72cabb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143746.385347:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.385376:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593644672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 168us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.385382:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6408 00000100:00100000:0.0:1746143746.386732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:0.0:1746143746.410399:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c9f80/2, rc 0, transno 21474840188 00000100:00100000:0.0:1746143746.410406:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594152192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.410414:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9c00/2, rc 0, transno 21474840189 00000100:00100000:0.0:1746143746.410417:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594152704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.410424:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c9500/2, rc 0, transno 21474840186 00000100:00100000:0.0:1746143746.410426:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594152064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.410431:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f9880/2, rc 0, transno 21474840187 00000100:00100000:0.0:1746143746.410434:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594152576:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.410861:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c8700/2, rc 0, transno 21474840192 00000100:00100000:0.0:1746143746.410865:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594151808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.410870:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3caa00/2, rc 0, transno 21474840193 00000100:00100000:0.0:1746143746.410874:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594152320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.410879:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c8380/2, rc 0, transno 21474840190 00000100:00100000:0.0:1746143746.410882:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594151936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.410887:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3cb800/2, rc 0, transno 21474840191 00000100:00100000:0.0:1746143746.410889:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594152448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143746.410895:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143746.410899:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594152960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143746.410918:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143746.411861:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fb800/2, rc 0, transno 21474840194 00000100:00100000:0.0:1746143746.411865:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594152960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143746.414641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.414707:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143746.415234:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0751000/0xe984082ccd72caad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.415240:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0751000/0xe984082ccd72caad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00000040:00080000:0.0:1746143746.415859:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2522, 88 off212456 00000004:00080000:0.0:1746143746.415865:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825425724481ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416662:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2557, 88 off215720 00000004:00080000:0.0:1746143746.416667:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426527560ns, next at 788234422982ns, rc = 0 00000040:00080000:0.0:1746143746.416693:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2558, 88 off215808 00000004:00080000:0.0:1746143746.416696:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426556590ns, next at 788234422982ns, rc = 0 00000040:00080000:0.0:1746143746.416704:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2523, 88 off212544 00000004:00080000:0.0:1746143746.416706:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426566616ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416712:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2524, 88 off212632 00000004:00080000:0.0:1746143746.416715:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426575651ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416721:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2559, 88 off215896 00000004:00080000:0.0:1746143746.416723:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426583029ns, next at 788234422982ns, rc = 0 00000040:00080000:0.0:1746143746.416728:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2560, 88 off215984 00000004:00080000:0.0:1746143746.416730:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426590200ns, next at 788234422982ns, rc = 0 00000040:00080000:0.0:1746143746.416735:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2561, 88 off216072 00000004:00080000:0.0:1746143746.416737:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426597379ns, next at 788234422982ns, rc = 0 00000040:00080000:0.0:1746143746.416742:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2525, 88 off212720 00000004:00080000:0.0:1746143746.416744:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426604489ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416749:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2562, 88 off216160 00000004:00080000:0.0:1746143746.416752:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426612368ns, next at 788234422982ns, rc = 0 00000040:00080000:0.0:1746143746.416758:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2526, 88 off212808 00000004:00080000:0.0:1746143746.416760:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426620985ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416766:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2563, 88 off216248 00000004:00080000:0.0:1746143746.416768:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426628906ns, next at 788234422982ns, rc = 0 00000040:00080000:0.0:1746143746.416774:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2527, 88 off212896 00000004:00080000:0.0:1746143746.416776:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426636493ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416804:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2529, 88 off213080 00000004:00080000:0.0:1746143746.416807:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426667095ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416813:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2530, 88 off213168 00000004:00080000:0.0:1746143746.416815:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426675576ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416821:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2531, 88 off213256 00000004:00080000:0.0:1746143746.416824:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825426683969ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143746.416830:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2564, 88 off216336 00000004:00080000:0.0:1746143746.416832:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825426692849ns, next at 788234422982ns, rc = 0 00000001:00080000:0.0:1746143746.438180:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943168 is committed 00000004:00080000:0.0:1746143746.438185:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1900 committed 00000004:00080000:0.0:1746143746.438196:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1868 committed 00000004:00080000:0.0:1746143746.438202:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1867 committed 00000004:00080000:0.0:1746143746.438203:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1866 committed 00000004:00080000:0.0:1746143746.438204:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1865 committed 00000004:00080000:0.0:1746143746.438206:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1899 committed 00000004:00080000:0.0:1746143746.438208:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1864 committed 00000004:00080000:0.0:1746143746.438210:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1898 committed 00000004:00080000:0.0:1746143746.438211:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1863 committed 00000004:00080000:0.0:1746143746.438213:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1897 committed 00000004:00080000:0.0:1746143746.438214:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1896 committed 00000004:00080000:0.0:1746143746.438215:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1895 committed 00000004:00080000:0.0:1746143746.438216:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1862 committed 00000004:00080000:0.0:1746143746.438218:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1861 committed 00000004:00080000:0.0:1746143746.438219:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1894 committed 00000004:00080000:0.0:1746143746.438220:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1893 committed 00000004:00080000:0.0:1746143746.438222:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1860 committed 00000100:00100000:0.0:1746143746.438246:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594153216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143746.438281:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143746.438305:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594153728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143746.438320:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594153344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143746.438333:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143746.438342:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594153856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143746.438450:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153216 00000100:00100000:0.0:1746143746.438455:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153216 00000100:00100000:0.0:1746143746.438478:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594154112 00000100:00100000:0.0:1746143746.438479:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594154112 00000100:00100000:0.0:1746143746.438487:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153344 00000100:00100000:0.0:1746143746.438489:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153344 00000100:00100000:0.0:1746143746.438494:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153984 00000100:00100000:0.0:1746143746.438495:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153984 00000100:00100000:0.0:1746143746.438501:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594154496 00000100:00100000:0.0:1746143746.438502:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594154496 00000100:00100000:0.0:1746143746.438516:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12164 00000100:00100000:0.0:1746143746.438519:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963594154112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143746.438659:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963594154112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (339us total) trans 17179872885 rc 0/0 00000100:00100000:0.0:1746143746.438665:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12164 00000100:00100000:0.0:1746143746.438675:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12169 00000100:00100000:0.0:1746143746.438679:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3295:x1830963594154624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143746.438763:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:0.0:1746143746.438766:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143744 -> 1746143744 00002000:00010000:0.0:1746143746.438768:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143744 -> 1746143744 00002000:00010000:0.0:1746143746.438771:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143744 -> 1746143744 00002000:00010000:0.0:1746143746.438773:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5255 00000100:00100000:0.0:1746143746.438792:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594154624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (364us total) trans 21474840195 rc 0/0 00000100:00100000:0.0:1746143746.438797:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12169 00000100:00100000:0.0:1746143746.438806:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12172 00000100:00100000:0.0:1746143746.438810:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1830963594155008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143746.438870:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3295:x1830963594155008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (128us total) trans 21474840198 rc 0/0 00000100:00100000:0.0:1746143746.438874:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12172 00000100:00100000:0.0:1746143746.438882:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594154752 00000100:00100000:0.0:1746143746.438884:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594154752 00000100:00100000:0.0:1746143746.438891:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155264 00000100:00100000:0.0:1746143746.438892:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155264 00000100:00100000:0.0:1746143746.438900:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12173 00000100:00100000:0.0:1746143746.438903:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963594154752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143746.438975:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594154752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (121us total) trans 21474840199 rc 0/0 00000100:00100000:0.0:1746143746.438982:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12173 00000100:00100000:0.0:1746143746.438990:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12175 00000100:00100000:0.0:1746143746.438994:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963594154368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143746.439058:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143746.439061:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143743 -> 1746143743 00002000:00010000:0.0:1746143746.439062:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143742 -> 1746143742 00002000:00010000:0.0:1746143746.439064:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143742 -> 1746143742 00002000:00010000:0.0:1746143746.439065:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 1955 -> 1955 00000100:00100000:0.0:1746143746.439083:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594154368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (155us total) trans 21474840201 rc 0/0 00000100:00100000:0.0:1746143746.439088:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12175 00000100:00100000:0.0:1746143746.439163:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143746.439221:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143746.439223:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143746.439225:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143746.439227:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143746.439228:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143746.439247:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963594153600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 686us (951us total) trans 17179872886 rc 0/0 00000100:00100000:0.0:1746143746.439251:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12165 00002000:00010000:0.0:1746143746.439306:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143746.439308:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143744 -> 1746143744 00002000:00010000:0.0:1746143746.439310:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143744 -> 1746143744 00002000:00010000:0.0:1746143746.439312:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143744 -> 1746143744 00002000:00010000:0.0:1746143746.439313:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143746.439330:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3294:x1830963594153344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 733us (996us total) trans 17179872888 rc 0/0 00000100:00100000:0.0:1746143746.439335:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12166 00000004:00080000:0.0:1746143746.439353:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8a80/2, rc 0, transno 17179872888 00000100:00100000:0.0:1746143746.439357:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594153344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143746.439376:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fa680/2, rc 0, transno 17179872887 00000100:00100000:0.0:1746143746.439378:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594153856:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143746.439438:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143746.439440:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143743 -> 1746143743 00002000:00010000:0.0:1746143746.439441:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143742 -> 1746143742 00002000:00010000:0.0:1746143746.439443:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143742 -> 1746143742 00002000:00010000:0.0:1746143746.439445:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143746.439461:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3293:x1830963594153216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 950us (1180us total) trans 17179872891 rc 0/0 00000100:00100000:0.0:1746143746.439466:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12163 00000100:00100000:0.0:1746143746.439504:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594153984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 837us (1114us total) trans 17179872890 rc 0/0 00000100:00100000:0.0:1746143746.439508:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12168 00000100:00100000:0.0:1746143746.439520:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143746.439536:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3fb100/2, rc 0, transno 17179872891 00000100:00100000:0.0:1746143746.439887:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594153216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143746.439895:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594155392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143746.439916:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143746.440620:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12178 00000100:00100000:0.0:1746143746.440625:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963594155392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143746.440717:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963594155392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (800us total) trans 21474840203 rc 0/0 00000100:00100000:0.0:1746143746.440721:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12178 00000004:00080000:0.0:1746143746.440740:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949f3480/2, rc 0, transno 21474840203 00000100:00100000:0.0:1746143746.440744:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594155392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143746.440750:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c3f8380/2, rc 0, transno 17179872892 00000100:00100000:0.0:1746143746.440752:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594153728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143746.441224:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.441623:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.444571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.444600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.444633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.446551:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.450582:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593646848 00000100:00100000:0.0:1746143746.450587:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593646848 00000100:00100000:0.0:1746143746.450617:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12187 00000100:00100000:0.0:1746143746.450623:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:30680:x1830963593646848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.450632:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.450641:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0750600/0xe984082ccd72cb01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5a66 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.450654:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.450659:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bedac00/0xe984082ccd72cad0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [135168->565247] (req 135168->565247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a3c expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.450664:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143746.450667:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0750600/0xe984082ccd72cb01 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a66 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.450689:0:4582:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bedac00/0xe984082ccd72cad0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [135168->565247] (req 135168->565247) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a3c expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.450697:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0750600/0xe984082ccd72cb01 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a66 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.450704:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0750600, rc 0) 00000100:00100000:0.0:1746143746.450728:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:30680:x1830963593646848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 106us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.450733:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12187 00000100:00100000:0.0:1746143746.451206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.452946:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.454506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.454955:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593647488 00000100:00100000:0.0:1746143746.454958:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593647488 00010000:00010000:0.0:1746143746.454970:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2200/0xe984082ccd72cafa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a5f expref: 29 pid: 8497 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.455113:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6413 00000100:00100000:0.0:1746143746.455119:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593647488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.455124:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.455134:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2200/0xe984082ccd72cafa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a5f expref: 29 pid: 8497 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.455158:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2200/0xe984082ccd72cafa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a5f expref: 29 pid: 8497 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.455168:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e2200/0xe984082ccd72cafa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a5f expref: 29 pid: 8497 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.455176:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.455187:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963593647488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.455191:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6413 00000100:00100000:0.0:1746143746.459115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.462432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.465463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.465509:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.475456:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.476923:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5588 00000100:00100000:0.0:1746143746.476929:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963593649664:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143746.477046:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963593649664:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 116us (1337us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143746.477052:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5588 00002000:00100000:0.0:1746143746.477058:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3891200->3895295) req@ffff88009cdc0a80 x1830963593649664/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746143757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143746.477065:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0a80 with x1830963593649664 ext(3891200->3895295) 00002000:00010000:0.0:1746143746.477068:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0a80 00000100:00100000:0.0:1746143746.481947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.490928:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.508903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.508941:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.508985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.509174:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5590 00000100:00100000:0.0:1746143746.509182:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963593650560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143746.510690:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.516700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.521503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.521533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.521594:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5595 00000100:00100000:0.0:1746143746.521599:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963593651840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143746.539438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.556235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.567500:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.567545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.570944:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593652480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14288us (14716us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143746.570951:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5597 00002000:00100000:0.0:1746143746.570958:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880130fd5f80 x1830963593652480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:142/0 lens 488/440 e 0 to 0 dl 1746143757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143746.570965:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5f80 with x1830963593652480 ext(2097152->3145727) 00002000:00010000:0.0:1746143746.570968:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5f80 00000100:00100000:0.0:1746143746.573223:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.573727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.580038:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.581784:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.582343:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.582387:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.592422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.598600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.605778:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.605809:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.605835:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.608455:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6418 00000100:00100000:0.0:1746143746.608466:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593654656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.608476:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.608482:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0aa4800/0xe984082ccd72cb63 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a9e expref: 10 pid: 14763 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.608492:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0aa4800/0xe984082ccd72cb63 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a9e expref: 10 pid: 14763 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.608508:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0aa4800/0xe984082ccd72cb63 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a9e expref: 10 pid: 14763 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.608536:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143746.608540:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0aa5400/0xe984082ccd72cb86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.608547:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0aa5400/0xe984082ccd72cb86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.608552:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0aa5400/0xe984082ccd72cb86 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.608576:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.608604:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593654656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 141us (2794us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.608610:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6418 00000100:00100000:0.0:1746143746.610632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.610705:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.610733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.610746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.610756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.611035:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.613522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.613557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.613569:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593655808 00000100:00100000:0.0:1746143746.613573:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593655808 00000100:00100000:0.0:1746143746.613594:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12200 00000100:00100000:0.0:1746143746.613598:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963593655808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.613605:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.613612:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f9d0c00/0xe984082ccd72cbcc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5aba expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143746.613637:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594159488:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143746.613679:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143746.617046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620014:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620127:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620167:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620200:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620214:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593656064 00000100:00100000:0.0:1746143746.620219:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593656064 00010000:00010000:0.0:1746143746.620248:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091036000/0xe984082ccd72c9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a9 expref: 10 pid: 4581 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.620267:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593656448 00000100:00100000:0.0:1746143746.620269:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593656448 00010000:00010000:0.0:1746143746.620279:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0aa5000/0xe984082ccd72cb2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a7b expref: 11 pid: 21542 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.620288:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593656320 00000100:00100000:0.0:1746143746.620290:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593656320 00010000:00010000:0.0:1746143746.620298:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd72c9b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59b7 expref: 12 pid: 4581 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.620305:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593656576 00000100:00100000:0.0:1746143746.620306:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593656576 00010000:00010000:0.0:1746143746.620312:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091036400/0xe984082ccd72c9aa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59be expref: 13 pid: 4581 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.620321:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6420 00000100:00100000:0.0:1746143746.620327:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963593656064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.620336:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.620355:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091036000/0xe984082ccd72c9b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a9 expref: 10 pid: 4581 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620385:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091036000/0xe984082ccd72c9b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a9 expref: 10 pid: 4581 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620404:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091036000/0xe984082ccd72c9b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59a9 expref: 10 pid: 4581 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620419:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.620448:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963593656064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.620453:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6420 00000100:00100000:0.0:1746143746.620467:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6421 00000100:00100000:0.0:1746143746.620472:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963593656448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.620479:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.620490:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0aa5000/0xe984082ccd72cb2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a7b expref: 13 pid: 21542 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620497:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0aa5000/0xe984082ccd72cb2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a7b expref: 13 pid: 21542 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620508:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.620519:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963593656448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.620523:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6421 00000100:00100000:0.0:1746143746.620531:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6422 00000100:00100000:0.0:1746143746.620534:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963593656320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.620539:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.620546:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd72c9b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59b7 expref: 12 pid: 4581 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620553:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd72c9b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59b7 expref: 12 pid: 4581 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620561:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.620571:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963593656320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.620575:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6422 00000100:00100000:0.0:1746143746.620582:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6423 00000100:00100000:0.0:1746143746.620586:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963593656576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.620590:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.620598:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091036400/0xe984082ccd72c9aa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59be expref: 11 pid: 4581 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620604:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091036400/0xe984082ccd72c9aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59be expref: 11 pid: 4581 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620613:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.620623:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963593656576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.620628:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6423 00000100:00100000:0.0:1746143746.620652:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620664:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593656704 00000100:00100000:0.0:1746143746.620667:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593656704 00010000:00010000:0.0:1746143746.620676:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59f6 expref: 18 pid: 25369 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.620688:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6424 00000100:00100000:0.0:1746143746.620691:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963593656704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.620696:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.620702:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59f6 expref: 18 pid: 25369 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620709:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59f6 expref: 18 pid: 25369 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620718:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72ca6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a59f6 expref: 18 pid: 25369 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620727:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.620738:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963593656704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.620743:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6424 00000100:00100000:0.0:1746143746.620864:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620872:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593656832 00000100:00100000:0.0:1746143746.620875:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593656832 00010000:00010000:0.0:1746143746.620884:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72cade lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a43 expref: 30 pid: 9527 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.620896:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6425 00000100:00100000:0.0:1746143746.620901:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963593656832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.620907:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.620913:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72cade lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a43 expref: 30 pid: 9527 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620920:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72cade lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a43 expref: 30 pid: 9527 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620928:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72cade lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a43 expref: 30 pid: 9527 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.620935:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.620951:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593656832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.620955:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6425 00000100:00100000:0.0:1746143746.620977:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.620985:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593657088 00000100:00100000:0.0:1746143746.620987:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593657088 00010000:00010000:0.0:1746143746.620995:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0751800/0xe984082ccd72cb47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a90 expref: 17 pid: 4582 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.621007:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6426 00000100:00100000:0.0:1746143746.621011:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963593657088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.621016:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.623773:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0751800/0xe984082ccd72cb47 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a90 expref: 17 pid: 4582 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.623786:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0751800/0xe984082ccd72cb47 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a90 expref: 17 pid: 4582 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.623797:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.623812:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963593657088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2801us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.623817:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6426 00000100:00100000:0.0:1746143746.623847:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6430 00000100:00100000:0.0:1746143746.623852:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963593657344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.623857:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.623864:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0750600/0xe984082ccd72cb01 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a66 expref: 25 pid: 4582 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.623871:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0750600/0xe984082ccd72cb01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a66 expref: 25 pid: 4582 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.623879:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.623880:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.623883:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0aa5200/0xe984082ccd72cbb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.623888:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0aa5200/0xe984082ccd72cbb7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.623896:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.623908:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963593657344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.623914:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6430 00000100:00100000:0.0:1746143746.623969:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.623981:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593657728 00000100:00100000:0.0:1746143746.623984:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593657728 00010000:00010000:0.0:1746143746.623994:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3000/0xe984082ccd72cae5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a4a expref: 29 pid: 8497 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.624006:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6432 00000100:00100000:0.0:1746143746.624010:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963593657728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.624014:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.624021:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3000/0xe984082ccd72cae5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a4a expref: 29 pid: 8497 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.624027:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3000/0xe984082ccd72cae5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a4a expref: 29 pid: 8497 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.624036:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.624037:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.624040:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0aa5800/0xe984082ccd72cbbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.624045:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0aa5800/0xe984082ccd72cbbe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.624053:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.624061:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963593657728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.624068:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6432 00000100:00100000:0.0:1746143746.624104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.624114:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593657984 00000100:00100000:0.0:1746143746.624116:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593657984 00010000:00010000:0.0:1746143746.624126:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72caec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a58 expref: 25 pid: 15784 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746143746.624155:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6433 00000100:00100000:0.0:1746143746.624161:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963593657984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.624166:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.624174:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72caec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a58 expref: 25 pid: 15784 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.624181:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72caec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a58 expref: 25 pid: 15784 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.624191:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0e00/0xe984082ccd72caec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a58 expref: 25 pid: 15784 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746143746.624199:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.624209:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963593657984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.624214:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6433 00000100:00100000:0.0:1746143746.628422:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.628473:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.634461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.634585:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143746.635373:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72cbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635381:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72cbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635400:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72cbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635406:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72cbc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635412:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72cbc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635418:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a581c400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143746.635421:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72cbc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635427:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a581c400/0xe984082ccd72cbc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635437:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.635438:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.635443:0:8497:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f06da00/0xe984082ccd72cbfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5acf expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635448:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f06da00/0xe984082ccd72cbfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5acf expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.635470:0:8497:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f06da00/0xe984082ccd72cbfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5acf expref: 15 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143746.635480:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594159744:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143746.635534:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143746.639346:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.639638:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.642770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.642816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.646394:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.646878:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.646934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.648088:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.650626:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.654464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.661925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.662455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.662496:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.682433:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.682473:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.682498:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.682521:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.682786:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12206 00000100:00100000:0.0:1746143746.682792:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963593662336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.682798:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.682806:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009321b200/0xe984082ccd72cc19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5add expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143746.682818:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a02, atime: 0x681409fe, ctime: 0x68140a02, blocks: 0x7a3 00010000:00010000:0.0:1746143746.682825:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.682826:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.682831:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009321b200/0xe984082ccd72cc19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5add expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.682839:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009321b200/0xe984082ccd72cc19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5add expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.682846:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009321b200, rc 0) 00000100:00100000:0.0:1746143746.682861:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963593662336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 70us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.682866:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12206 00000100:00100000:0.0:1746143746.686766:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.697890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.761490:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.766404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.766503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.766534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.766563:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.766577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.766603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.766630:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663616 00000100:00100000:0.0:1746143746.766637:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663616 00000100:00100000:0.0:1746143746.766668:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663744 00000100:00100000:0.0:1746143746.766670:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663744 00000100:00100000:0.0:1746143746.766680:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593663872 00000100:00100000:0.0:1746143746.766681:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593663872 00000100:00100000:0.0:1746143746.766689:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664000 00000100:00100000:0.0:1746143746.766690:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664000 00000100:00100000:0.0:1746143746.767514:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664128 00000100:00100000:0.0:1746143746.767519:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664128 00000100:00100000:0.0:1746143746.767646:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12208 00000100:00100000:0.0:1746143746.767653:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963593663616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.767668:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.767682:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a081da00/0xe984082ccd72cc4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5b00 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.767700:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.767702:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.767708:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a081da00/0xe984082ccd72cc4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b00 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.767720:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a081da00/0xe984082ccd72cc4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b00 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.767729:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081da00, rc 0) 00000100:00100000:0.0:1746143746.767767:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963593663616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.767771:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12208 00000100:00100000:0.0:1746143746.767783:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12210 00000100:00100000:0.0:1746143746.767787:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963593663872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.767792:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.767798:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081d800/0xe984082ccd72cc58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5b0e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.767806:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.767807:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.767811:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081d800/0xe984082ccd72cc58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b0e expref: 18 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.767818:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a081d800/0xe984082ccd72cc58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b0e expref: 18 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143746.767823:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081d800, rc 0) 00000100:00100000:0.0:1746143746.767962:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963593663872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 175us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.767966:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12210 00000100:00100000:0.0:1746143746.767975:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12213 00000100:00100000:0.0:1746143746.767979:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963593664256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.767983:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.767988:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081d400/0xe984082ccd72cc6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5b23 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143746.768017:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594160256:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143746.768272:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143746.788722:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.788761:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.788791:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.788816:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.788846:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593664768 00000100:00100000:0.0:1746143746.788849:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593664768 00002000:00100000:0.0:1746143746.788868:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88013691a300 x1830963593664768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:142/0 lens 488/0 e 0 to 0 dl 1746143757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143746.788875:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691a300 with x1830963593664768 ext(1048576->2097151) 00002000:00010000:0.0:1746143746.788879:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691a300 00000100:00100000:0.0:1746143746.788963:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665152 00000100:00100000:0.0:1746143746.788967:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665152 00002000:00100000:0.0:1746143746.788980:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88013691bb80 x1830963593665152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:142/0 lens 488/0 e 0 to 0 dl 1746143757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143746.789279:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691bb80 with x1830963593665152 ext(1048576->2097151) 00002000:00010000:0.0:1746143746.789282:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013691bb80 00000100:00100000:0.0:1746143746.792121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.792152:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593665536 00000100:00100000:0.0:1746143746.792157:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593665536 00000100:00100000:0.0:1746143746.792183:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8925 00000100:00100000:0.0:1746143746.792187:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:30698:x1830963593665536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143746.792199:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.792211:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c800/0xe984082ccd72cc74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5b2a expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.792289:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.792299:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.792308:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.792322:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.792327:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.792332:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793315:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72cc89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793324:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72cc89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793330:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72cc89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143746.793338:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:0.0:1746143746.793425:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793430:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793434:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793439:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a081d000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143746.793442:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793448:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793457:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143746.793460:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143746.793462:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793466:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d000/0xe984082ccd72cc7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793480:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793484:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793487:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793491:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a081c000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143746.793493:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793497:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793501:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880129f5ea00) 00010000:00010000:0.0:1746143746.793503:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143746.793504:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.793508:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c000/0xe984082ccd72cc82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143746.794923:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c800/0xe984082ccd72cc74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b2a expref: 248 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.794939:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72cc89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b2a expref: 247 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.794945:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143746.794947:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143746.794949:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081c200, rc 0) 00000100:00100000:0.0:1746143746.794999:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:30698:x1830963593665536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2810us (2878us total) trans 8589943182 rc 0/0 00000100:00100000:0.0:1746143746.795006:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8925 00000100:00100000:0.0:1746143746.823599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.829195:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.829221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.829248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.838419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.841865:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.843378:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.844476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.844511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.851157:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.863057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.875924:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.877182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.879016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.879055:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.879077:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593668864 00000100:00100000:0.0:1746143746.879081:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593668864 00010000:00010000:0.0:1746143746.879109:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72cc89 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b2a expref: 250 pid: 16090 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746143746.879167:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6440 00000100:00100000:0.0:1746143746.879174:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1963:x1830963593668864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.879187:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.879193:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72cc89 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b2a expref: 250 pid: 16090 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.879203:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd72cc89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b2a expref: 250 pid: 16090 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.880244:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143746.880249:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.880288:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1963:x1830963593668864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1114us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.880295:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6440 00000100:00100000:0.0:1746143746.883416:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.884533:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.884569:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.887293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.895772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.903873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.906475:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593670272 00000100:00100000:0.0:1746143746.906482:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593670272 00000100:00100000:0.0:1746143746.906539:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12219 00000100:00100000:0.0:1746143746.906546:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:30701:x1830963593670272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.906567:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.906584:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a081d600/0xe984082ccd72cce4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5b62 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.906612:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009321d200/0xe984082ccd72ccdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b5b expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.906620:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143746.906621:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143746.906624:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a081d600/0xe984082ccd72cce4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b62 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.906652:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009321d200/0xe984082ccd72ccdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b5b expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.906664:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009321d200/0xe984082ccd72ccdd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b5b expref: 19 pid: 4581 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746143746.906674:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594161792:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143746.906825:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143746.907429:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593670400 00000100:00100000:0.0:1746143746.907432:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593670400 00000100:00100000:0.0:1746143746.907461:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12220 00000100:00100000:0.0:1746143746.907466:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:30696:x1830963593670400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.907474:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.907483:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72cceb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5b69 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.907502:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0675c00/0xe984082ccd72cbd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2789375) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ac1 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.907508:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143746.907510:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143746.907512:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72cceb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b69 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.907526:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0675c00/0xe984082ccd72cbd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2789375) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ac1 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.907533:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0675c00/0xe984082ccd72cbd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2715648->2789375) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ac1 expref: 30 pid: 25369 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746143746.907540:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594161920:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143746.907581:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143746.908427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.911892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.914941:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.915056:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.923745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.923782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.923825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.924211:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6444 00000100:00100000:0.0:1746143746.924221:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593671296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143746.924237:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143746.924330:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0675000/0xe984082ccd72cc04 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ad6 expref: 26 pid: 8497 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.924901:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0675000/0xe984082ccd72cc04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ad6 expref: 26 pid: 8497 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.925068:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0675000/0xe984082ccd72cc04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ad6 expref: 26 pid: 8497 timeout: 925 lvb_type: 0 00010000:00010000:0.0:1746143746.925134:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.925135:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143746.925164:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009321c000/0xe984082ccd72ccf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b70 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.925171:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009321c000/0xe984082ccd72ccf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b70 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143746.925191:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009321c000/0xe984082ccd72ccf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5b70 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143746.925198:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594162560:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143746.925239:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143746.928898:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.930059:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594162560:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143746.930123:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143746.930163:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963593671296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5943us (6428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143746.930169:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6444 00000100:00100000:0.0:1746143746.930209:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.939094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.939134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.939186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.965551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.965634:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.966515:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12222 00000100:00100000:0.0:1746143746.966523:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963593673088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143746.966541:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143746.966559:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0751a00/0xe984082ccd72ccf9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5b77 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143746.966615:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594162688:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143746.967726:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143746.972535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.972604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.977606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.977650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.990505:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.990596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143746.997319:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.000382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.005565:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.005622:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.005659:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.005708:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.005756:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.036645:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593675520:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28151us (30923us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143747.036658:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5623 00002000:00100000:0.0:1746143747.036671:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094c0d180 x1830963593675520/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:143/0 lens 488/440 e 0 to 0 dl 1746143758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143747.036680:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d180 with x1830963593675520 ext(3145728->4194303) 00002000:00010000:0.0:1746143747.036685:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0d180 00000100:00100000:0.0:1746143747.048862:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.073677:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.081338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.081385:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.091980:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.097986:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.098075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.104945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.139919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.147073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.158026:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.162995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.170608:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.192126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.201071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.204004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.224810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.230315:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.233331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.236594:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.241244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.244162:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593681024 00000100:00100000:0.0:1746143747.244168:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593681024 00000100:00100000:0.0:1746143747.244217:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12237 00000100:00100000:0.0:1746143747.244223:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593681024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143747.244237:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.244250:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081ce00/0xe984082ccd72cde7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5c03 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.244294:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594164736:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143747.244721:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.248784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.252297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.252330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.252366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.252382:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.252397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.252425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.263221:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593682432 00000100:00100000:0.0:1746143747.263224:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593682432 00002000:00100000:0.0:1746143747.263253:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1056768->1146879) req@ffff88012f187b80 x1830963593682432/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:143/0 lens 488/0 e 0 to 0 dl 1746143758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143747.263261:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187b80 with x1830963593682432 ext(1056768->1146879) 00010000:00010000:0.0:1746143747.263266:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009321de00/0xe984082ccd72cd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5baf expref: 32 pid: 8495 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.263275:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009321de00/0xe984082ccd72cd69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5baf expref: 32 pid: 8495 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746143747.263281:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f187b80 00000100:00100000:0.0:1746143747.263292:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1617 00000100:00100000:0.0:1746143747.263297:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963593682432:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143747.263628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.263753:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6463 00000100:00100000:0.0:1746143747.263758:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593682944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.263764:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.264401:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009321d200/0xe984082ccd72cda8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5bcb expref: 9 pid: 25369 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746143747.264409:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009321d200/0xe984082ccd72cda8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5bcb expref: 9 pid: 25369 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746143747.265302:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009321d200/0xe984082ccd72cda8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5bcb expref: 9 pid: 25369 timeout: 926 lvb_type: 1 00010000:00010000:0.0:1746143747.265316:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.265317:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.265320:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265326:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265340:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.265368:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593682944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1609us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.265373:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6463 00010000:00010000:0.0:1746143747.265598:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265605:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265620:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265626:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265631:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265636:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4bba00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143747.265639:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265645:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265658:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.265664:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4bba00/0xe984082ccd72ce18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.265698:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593681536:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 12762us (13313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.265704:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12241 00000100:00100000:0.0:1746143747.270932:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.275613:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593684096 00000100:00100000:0.0:1746143747.275622:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593684096 00010000:00010000:0.0:1746143747.275652:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009321c400/0xe984082ccd72cd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5bb6 expref: 17 pid: 8495 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.275820:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6469 00000100:00100000:0.0:1746143747.275828:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963593684096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.275842:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.275864:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009321c400/0xe984082ccd72cd70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5bb6 expref: 17 pid: 8495 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.275875:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009321c400/0xe984082ccd72cd70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->3026943) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5bb6 expref: 17 pid: 8495 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.275896:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009321c400/0xe984082ccd72cd70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->3026943) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5bb6 expref: 17 pid: 8495 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.275922:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.275924:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.275929:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0xe984082ccd72ce26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.275937:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffc0800/0xe984082ccd72ce26 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.275967:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.276002:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963593684096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 175us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.276007:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6469 00000100:00100000:0.0:1746143747.285227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.293005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.293039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.293052:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.293068:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593684992 00000100:00100000:0.0:1746143747.293076:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593684992 00010000:00010000:0.0:1746143747.293110:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7da800/0xe984082ccd72cac9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a2e expref: 253 pid: 14762 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.293129:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593685248 00000100:00100000:0.0:1746143747.293132:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593685248 00010000:00010000:0.0:1746143747.293159:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0751000/0xe984082ccd72caad lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a19 expref: 19 pid: 16090 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.293172:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6470 00000100:00100000:0.0:1746143747.293176:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1962:x1830963593684992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.293191:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.293196:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7da800/0xe984082ccd72cac9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a2e expref: 253 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.293205:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7da800/0xe984082ccd72cac9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a2e expref: 253 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.293226:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7da800/0xe984082ccd72cac9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5a2e expref: 253 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.293254:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143747.293258:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06c600/0xe984082ccd72ce2d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143747.293267:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.293342:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1962:x1830963593684992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 163us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.293348:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6470 00000100:00100000:0.0:1746143747.293392:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.293582:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.293589:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593684480 00000100:00100000:0.0:1746143747.293592:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593684480 00010000:00010000:0.0:1746143747.293600:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06ce00/0xe984082ccd72cd5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ba8 expref: 252 pid: 14762 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.293612:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6473 00000100:00100000:0.0:1746143747.293616:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1964:x1830963593684480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.293622:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.293625:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06ce00/0xe984082ccd72cd5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ba8 expref: 252 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.293632:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06ce00/0xe984082ccd72cd5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ba8 expref: 253 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.293642:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06ce00/0xe984082ccd72cd5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ba8 expref: 253 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.293649:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88008f1f4c00) 00010000:00010000:0.0:1746143747.293652:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f06c600/0xe984082ccd72ce2d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143747.293657:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.293668:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1964:x1830963593684480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.293672:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6473 00000100:00100000:0.0:1746143747.293749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.294985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.323765:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594167808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143747.323786:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143747.323798:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594168320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143747.323810:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143747.323827:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594167808 00000100:00100000:0.0:1746143747.323829:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594167808 00000100:00100000:0.0:1746143747.323844:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12244 00000100:00100000:0.0:1746143747.323849:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3292:x1830963594167680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143747.324075:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3292:x1830963594168192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (319us total) trans 17179872900 rc 0/0 00000100:00100000:0.0:1746143747.324082:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12245 00000100:00100000:0.0:1746143747.325332:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12251 00000100:00100000:0.0:1746143747.325338:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963594168960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143747.325863:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963594168960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 526us (1562us total) trans 21474840209 rc 0/0 00000100:00100000:0.0:1746143747.327774:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12251 00000100:00100000:0.0:1746143747.328263:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12259 00000100:00100000:0.0:1746143747.328269:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3292:x1830963594168832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143747.328365:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3292:x1830963594168832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (458us total) trans 21474840215 rc 0/0 00000100:00100000:0.0:1746143747.328371:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12259 00000100:00100000:0.0:1746143747.328382:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12260 00000100:00100000:0.0:1746143747.328386:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3292:x1830963594169344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143747.328458:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3292:x1830963594169344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (530us total) trans 21474840216 rc 0/0 00000100:00100000:0.0:1746143747.328463:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12260 00000100:00100000:0.0:1746143747.328580:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:0.0:1746143747.328623:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79e680/2, rc 0, transno 17179872901 00000100:00100000:0.0:1746143747.328627:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594167808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143747.328635:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f800/2, rc 0, transno 17179872898 00000100:00100000:0.0:1746143747.328638:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594168320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143747.328697:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3292:x1830963594167680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4847us (4994us total) trans 17179872899 rc 0/0 00000100:00100000:0.0:1746143747.328702:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12244 00000100:00100000:0.0:1746143747.334760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.337577:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.337880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.337911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.337990:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.339456:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.339493:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.349341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.357678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.367261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.367299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.367325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.367357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.367404:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593688192 00000100:00100000:0.0:1746143747.367408:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593688192 00010000:00010000:0.0:1746143747.387479:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c1eba00/0xe984082ccd72ce88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.387495:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c1eba00/0xe984082ccd72ce88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.387502:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c1eba00/0xe984082ccd72ce88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.387509:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c1eba00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143747.387513:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c1eba00/0xe984082ccd72ce88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.387520:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c1eba00/0xe984082ccd72ce88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.387540:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c1eba00/0xe984082ccd72ce88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.387546:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c1eba00/0xe984082ccd72ce88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.387644:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963593687168:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 26422us (26784us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143747.387654:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5632 00000100:00100000:0.0:1746143747.413249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.423109:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.425059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.427695:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.432213:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.436644:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.440461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.441126:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593689600 00000100:00100000:0.0:1746143747.441132:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593689600 00000100:00100000:0.0:1746143747.441190:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12270 00000100:00100000:0.0:1746143747.441196:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30715:x1830963593689600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143747.441214:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.441230:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b02c800/0xe984082ccd72cec7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5c5e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.441255:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c1ebc00/0xe984082ccd72ce5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c34 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.441268:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.441269:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.441273:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02c800/0xe984082ccd72cec7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c5e expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.441300:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c1ebc00/0xe984082ccd72ce5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c34 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143747.441312:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c1ebc00/0xe984082ccd72ce5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c34 expref: 9 pid: 15784 timeout: 926 lvb_type: 1 00000100:00100000:0.0:1746143747.441323:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594170368:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143747.442531:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.444973:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.450435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.454549:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.460665:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.466344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.469841:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.469864:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.469882:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.469894:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.469918:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.472308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.474242:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.477315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.508520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.512607:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.533447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.534881:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.535072:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8940 00000100:00100000:0.0:1746143747.535079:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:30725:x1830963593692288:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143747.535088:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.535095:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1a00/0xe984082ccd72cef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5c81 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.535170:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535186:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535192:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535199:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535206:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535210:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535302:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72cf14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535308:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72cf14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535313:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72cf14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143747.535320:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143747.535399:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535405:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535410:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535426:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06c1800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143747.535429:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535434:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535444:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143747.535447:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143747.535449:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535454:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1800/0xe984082ccd72ceff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535680:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535685:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535692:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535696:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06c1600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143747.535698:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535703:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535709:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009066dd00) 00010000:00010000:0.0:1746143747.535711:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143747.535713:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535717:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1600/0xe984082ccd72cf0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.535743:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1a00/0xe984082ccd72cef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c81 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.535751:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72cf14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c81 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.535757:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143747.535758:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143747.535760:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06c1400, rc 0) 00000100:00100000:0.0:1746143747.535895:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:30725:x1830963593692288:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 817us (1019us total) trans 8589943199 rc 0/0 00000100:00100000:0.0:1746143747.535901:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8940 00000100:00100000:0.0:1746143747.540015:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593692672 00000100:00100000:0.0:1746143747.540023:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593692672 00000100:00100000:0.0:1746143747.540073:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12296 00000100:00100000:0.0:1746143747.540080:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:30727:x1830963593692672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143747.540094:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.540107:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06c1000/0xe984082ccd72cf30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5c8f expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.540131:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72ceb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c49 expref: 10 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.540250:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143747.540253:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143747.540258:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06c1000/0xe984082ccd72cf30 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c8f expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.540284:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72ceb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c49 expref: 10 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.540295:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72ceb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c49 expref: 10 pid: 4581 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.540306:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594173440:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143747.540946:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.541873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.541917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.552162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.552184:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693184 00000100:00100000:0.0:1746143747.552192:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693184 00010000:00010000:0.0:1746143747.552220:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4ba200/0xe984082ccd72cf1b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c7a expref: 10 pid: 14762 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.552258:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6483 00000100:00100000:0.0:1746143747.552264:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593693184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.552275:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.552279:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4ba200/0xe984082ccd72cf1b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c7a expref: 10 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.552289:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4ba200/0xe984082ccd72cf1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c7a expref: 10 pid: 14762 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.552306:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143747.552311:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa5d600/0xe984082ccd72cf45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.552318:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa5d600/0xe984082ccd72cf45 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143747.552323:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.552383:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593693184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 119us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.552389:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6483 00000100:00100000:0.0:1746143747.552445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.553399:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.553433:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593693056 00000100:00100000:0.0:1746143747.553436:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593693056 00010000:00010000:0.0:1746143747.553448:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72ceb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c49 expref: 11 pid: 4581 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.553467:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6485 00000100:00100000:0.0:1746143747.553472:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593693056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.553478:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.553490:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72ceb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c49 expref: 11 pid: 4581 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.553498:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72ceb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c49 expref: 11 pid: 4581 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.553508:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72ceb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c49 expref: 11 pid: 4581 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.553517:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.553519:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.553523:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06c1000/0xe984082ccd72cf30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c8f expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.553529:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06c1000/0xe984082ccd72cf30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c8f expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.553546:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06c1000/0xe984082ccd72cf30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c8f expref: 21 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.553555:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594173824:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143747.553591:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.556829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.562379:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.565555:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.566340:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.575455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.585412:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963593693952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19062us (19853us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143747.585424:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5637 00002000:00100000:0.0:1746143747.585436:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880094c0ea00 x1830963593693952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:143/0 lens 488/440 e 0 to 0 dl 1746143758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143747.585445:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963593693952 ext(0->1048575) 00002000:00010000:0.0:1746143747.585452:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ea00 00000100:00100000:0.0:1746143747.595914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.604675:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.613691:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.617934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.617977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.618651:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5640 00000100:00100000:0.0:1746143747.618659:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963593695232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143747.631280:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.632955:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.643039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.646824:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.646897:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.649699:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.649781:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.655825:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.655864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.655884:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593696384 00000100:00100000:0.0:1746143747.655890:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593696384 00010000:00010000:0.0:1746143747.655922:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4bba00/0xe984082ccd72cf4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c96 expref: 243 pid: 14762 timeout: 926 lvb_type: 0 00000001:00080000:0.0:1746143747.688381:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943199 is committed 00000001:00080000:0.0:1746143747.688399:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943202 is committed 00000001:00080000:0.0:1746143747.688403:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943198 is committed 00000001:00080000:0.0:1746143747.688407:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943203 is committed 00000004:00080000:0.0:1746143747.688411:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1924 committed 00000004:00080000:0.0:1746143747.688419:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1895 committed 00000004:00080000:0.0:1746143747.688425:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1894 committed 00000004:00080000:0.0:1746143747.688426:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1893 committed 00000004:00080000:0.0:1746143747.688428:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1892 committed 00000004:00080000:0.0:1746143747.688429:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1923 committed 00000004:00080000:0.0:1746143747.688431:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1891 committed 00000004:00080000:0.0:1746143747.688432:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1922 committed 00000004:00080000:0.0:1746143747.688434:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1890 committed 00000004:00080000:0.0:1746143747.688435:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1921 committed 00000004:00080000:0.0:1746143747.688437:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1920 committed 00000004:00080000:0.0:1746143747.688438:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1919 committed 00000004:00080000:0.0:1746143747.688440:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1889 committed 00000004:00080000:0.0:1746143747.688442:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1888 committed 00000004:00080000:0.0:1746143747.688443:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1918 committed 00000004:00080000:0.0:1746143747.688445:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1917 committed 00000004:00080000:0.0:1746143747.688446:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1887 committed 00000001:00080000:0.0:1746143747.688449:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943201 is committed 00000100:00100000:0.0:1746143747.689071:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594175360 00000100:00100000:0.0:1746143747.689078:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594175360 00000100:00100000:0.0:1746143747.689110:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176384 00000100:00100000:0.0:1746143747.689112:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176384 00000100:00100000:0.0:1746143747.689119:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176768 00000100:00100000:0.0:1746143747.689120:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176768 00000100:00100000:0.0:1746143747.689126:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594175104 00000100:00100000:0.0:1746143747.689127:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594175104 00000100:00100000:0.0:1746143747.689133:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176512 00000100:00100000:0.0:1746143747.689134:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176512 00000100:00100000:0.0:1746143747.689156:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177024 00000100:00100000:0.0:1746143747.689158:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177024 00000100:00100000:0.0:1746143747.689170:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12303 00000100:00100000:0.0:1746143747.689174:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3293:x1830963594175872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143747.689361:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594175872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (605us total) trans 21474840229 rc 0/0 00000100:00100000:0.0:1746143747.689370:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12303 00000100:00100000:0.0:1746143747.689384:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12305 00000100:00100000:0.0:1746143747.689389:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3293:x1830963594176896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143747.689463:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3293:x1830963594176896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (499us total) trans 17179872918 rc 0/0 00000100:00100000:0.0:1746143747.690232:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12305 00000100:00100000:0.0:1746143747.690243:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12311 00000100:00100000:0.0:1746143747.690247:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3294:x1830963594176000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143747.690300:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143747.690302:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143747.690304:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143747.690306:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143747.690308:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143747.690323:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594176000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1242us total) trans 17179872921 rc 0/0 00000100:00100000:0.0:1746143747.690328:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12311 00000100:00100000:0.0:1746143747.690335:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12313 00000100:00100000:0.0:1746143747.690338:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3294:x1830963594175616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143747.690414:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:0.0:1746143747.690416:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143746 -> 1746143746 00002000:00010000:0.0:1746143747.690417:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143746 -> 1746143746 00002000:00010000:0.0:1746143747.690419:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143747 -> 1746143747 00002000:00010000:0.0:1746143747.690421:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5255 00000100:00100000:0.0:1746143747.690436:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594175616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1255us total) trans 21474840233 rc 0/0 00000100:00100000:0.0:1746143747.690440:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12313 00000100:00100000:0.0:1746143747.690450:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12315 00000100:00100000:0.0:1746143747.690454:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+51:3294:x1830963594176640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143747.690516:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594176640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1293us total) trans 17179872923 rc 0/0 00000100:00100000:0.0:1746143747.690520:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12315 00000100:00100000:0.0:1746143747.691024:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143747.691052:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594176256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143747.691069:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143747.691088:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093805c00/2, rc 0, transno 17179872920 00000100:00100000:0.0:1746143747.691091:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594175232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143747.691104:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c21180/2, rc 0, transno 21474840235 00000100:00100000:0.0:1746143747.691107:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594175104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143747.692513:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.692555:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.692855:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3780 00000100:00100000:0.0:1746143747.692862:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:30727:x1830963593697152:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143747.692908:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:30727:x1830963593697152:12345-192.168.202.48@tcp:49:cat.0 Request processed in 47us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.692914:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3780 00000100:00100000:0.0:1746143747.693102:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.695069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.695199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.698012:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593697536 00000100:00100000:0.0:1746143747.698019:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593697536 00000100:00100000:0.0:1746143747.698057:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12319 00000100:00100000:0.0:1746143747.698063:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:30722:x1830963593697536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143747.698076:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.698093:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd72cfbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5cea expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.698126:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a7c5200/0xe984082ccd72cece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c65 expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.698133:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143747.698135:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143747.698155:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd72cfbc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2576384->3145727] (req 2576384->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cea expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.698244:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a7c5200/0xe984082ccd72cece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c65 expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.698262:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a7c5200/0xe984082ccd72cece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c65 expref: 9 pid: 4581 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.698273:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594177536:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143747.698470:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.698820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.701995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.702017:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593698048 00000100:00100000:0.0:1746143747.702023:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593698048 00010000:00010000:0.0:1746143747.702050:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a7c5200/0xe984082ccd72cece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c65 expref: 10 pid: 4581 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.702075:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6492 00000100:00100000:0.0:1746143747.702082:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963593698048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143747.702095:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143747.702117:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a7c5200/0xe984082ccd72cece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c65 expref: 10 pid: 4581 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.702127:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a7c5200/0xe984082ccd72cece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c65 expref: 10 pid: 4581 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.702173:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a7c5200/0xe984082ccd72cece lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c65 expref: 10 pid: 4581 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.702190:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.702193:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143747.702200:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd72cfbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cea expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.702207:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd72cfbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cea expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.702236:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd72cfbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cea expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.702246:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594177920:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143747.702296:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.707784:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594177920:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143747.707802:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143747.707823:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963593698048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5741us (5835us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.707830:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6492 00000100:00100000:0.0:1746143747.708405:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.715941:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593699200 00000100:00100000:0.0:1746143747.715947:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593699200 00000100:00100000:0.0:1746143747.716577:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12321 00000100:00100000:0.0:1746143747.716586:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:30727:x1830963593699200:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143747.716604:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.716622:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f06c200/0xe984082ccd72cfca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5cf8 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.716650:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b02c800/0xe984082ccd72cec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c5e expref: 8 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.716659:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143747.716661:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143747.716664:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f06c200/0xe984082ccd72cfca lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cf8 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.716692:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b02c800/0xe984082ccd72cec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c5e expref: 8 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.716705:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b02c800/0xe984082ccd72cec7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5c5e expref: 8 pid: 4581 timeout: 926 lvb_type: 0 00000100:00100000:0.0:1746143747.716716:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594178176:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143747.716799:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.718723:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.721473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.722432:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594178304:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143747.722450:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0xe984082ccd72cfd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->2224127] (req 2097152->2224127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cff expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143747.722461:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:0.0:1746143747.722491:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:30722:x1830963593699328:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3655us (3770us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143747.722496:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12322 00000100:00100000:0.0:1746143747.722884:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.722935:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.725441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.730108:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.730213:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.730227:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.730250:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.739658:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.741087:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.746514:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.746553:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.746589:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.746609:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593701760 00000100:00100000:0.0:1746143747.746612:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593701760 00000100:00100000:0.0:1746143747.746634:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593701888 00000100:00100000:0.0:1746143747.746635:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593701888 00000100:00100000:0.0:1746143747.746651:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12325 00000100:00100000:0.0:1746143747.746656:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963593701760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143747.746667:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143747.746685:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f06dc00/0xe984082ccd72cfe6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5d14 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143747.746738:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594179072:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143747.746800:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143747.755940:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.758775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.775269:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963593702144:12345-192.168.202.48@tcp:4:cat.0 Request processed in 14947us (16488us total) trans 21474840238 rc 0/0 00000100:00100000:0.0:1746143747.775282:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1619 00002000:00100000:0.0:1746143747.775295:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2576384->3145727) req@ffff88009445b100 x1830963593702144/t21474840238(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:143/0 lens 488/448 e 0 to 0 dl 1746143758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143747.775305:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b100 with x1830963593702144 ext(2576384->3145727) 00010000:00010000:0.0:1746143747.775315:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd72cfbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cea expref: 26 pid: 15784 timeout: 926 lvb_type: 0 00010000:00010000:0.0:1746143747.775333:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5806c00/0xe984082ccd72cfbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2576384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5cea expref: 26 pid: 15784 timeout: 926 lvb_type: 0 00002000:00010000:0.0:1746143747.775341:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009445b100 00000100:00100000:0.0:1746143747.784985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.785711:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.785738:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.785822:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.809019:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.811430:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.815968:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.816361:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.837813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.837898:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.838211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.840560:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.845506:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.852295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.854192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.854225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.854286:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.862539:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.862579:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.862619:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.880098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.887887:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.890253:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.892511:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.901018:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.904304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.904724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.906844:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.907522:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963593707904:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 430us (676us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143747.907528:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5658 00002000:00100000:0.0:1746143747.907532:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1314816->1318911) req@ffff8800a087aa00 x1830963593707904/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:143/0 lens 488/4536 e 0 to 0 dl 1746143758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143747.907540:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087aa00 with x1830963593707904 ext(1314816->1318911) 00002000:00010000:0.0:1746143747.907542:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087aa00 00000100:00100000:0.0:1746143747.910111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.910219:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.912871:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143747.980114:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.016240:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.024374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.033806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.062030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.062515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.062539:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143748.063374:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143748.092769:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.094675:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12343 00000100:00100000:0.0:1746143748.094685:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:30737:x1830963593710848:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143748.094703:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.094721:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5dae expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.094749:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b02d600/0xe984082ccd72cff4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d22 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.094758:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b02d400/0xe984082ccd72cffb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d29 expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.094763:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.094764:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.094767:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4063232->4194303] (req 4063232->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dae expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.094794:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b02d400/0xe984082ccd72cffb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d29 expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.094804:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b02d400/0xe984082ccd72cffb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d29 expref: 25 pid: 15784 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.094817:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594181632:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143748.094885:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b02d600/0xe984082ccd72cff4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d22 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.094894:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b02d600/0xe984082ccd72cff4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d22 expref: 27 pid: 15784 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.094901:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594181760:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143748.094925:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.098834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.102824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.110550:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.112952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.116059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.122467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.122510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.122612:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593712128 00000100:00100000:0.0:1746143748.122622:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593712128 00002000:00100000:0.0:1746143748.123089:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012fc13100 x1830963593712128/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.123100:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13100 with x1830963593712128 ext(1048576->2097151) 00002000:00010000:0.0:1746143748.123105:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13100 00000100:00100000:0.0:1746143748.123127:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593712384 00000100:00100000:0.0:1746143748.123130:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593712384 00002000:00100000:0.0:1746143748.123161:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc13b80 x1830963593712384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:144/0 lens 504/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.123169:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963593712384 ext(1048576->2097151) 00002000:00010000:0.0:1746143748.123174:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:0.0:1746143748.123187:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5664 00000100:00100000:0.0:1746143748.123195:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963593712128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143748.125086:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5665 00000100:00100000:0.0:1746143748.125264:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963593712384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143748.148920:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963593712384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23644us (26392us total) trans 0 rc 917504/917504 00000100:00100000:0.0:1746143748.148937:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5665 00002000:00100000:0.0:1746143748.148950:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc13b80 x1830963593712384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:144/0 lens 504/440 e 0 to 0 dl 1746143759 ref 1 fl Complete:/200/0 rc 917504/917504 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.148963:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963593712384 ext(1048576->2097151) 00002000:00010000:0.0:1746143748.148970:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:0.0:1746143748.149473:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.150062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.150077:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.152164:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963593712128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28969us (29708us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143748.152173:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5664 00002000:00100000:0.0:1746143748.152181:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012fc13100 x1830963593712128/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:144/0 lens 488/440 e 0 to 0 dl 1746143759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.152189:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13100 with x1830963593712128 ext(1048576->2097151) 00002000:00010000:0.0:1746143748.152192:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13100 00000100:00100000:0.0:1746143748.152253:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.155562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.155618:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594182784:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143748.155636:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.155679:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963593712896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4598us (5617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.155689:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6505 00000100:00100000:0.0:1746143748.155741:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593713408 00000100:00100000:0.0:1746143748.155747:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593713408 00010000:00010000:0.0:1746143748.155778:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b020e00/0xe984082ccd72d04f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d68 expref: 17 pid: 14763 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.155801:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6507 00000100:00100000:0.0:1746143748.155809:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963593713408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.155822:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.155828:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b020e00/0xe984082ccd72d04f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d68 expref: 17 pid: 14763 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.155838:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b020e00/0xe984082ccd72d04f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d68 expref: 17 pid: 14763 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.155862:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143748.155867:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090486400/0xe984082ccd72d0f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.155874:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880090486400/0xe984082ccd72d0f0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.155880:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.155895:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963593713408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.155904:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6507 00000100:00100000:0.0:1746143748.171521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.172113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.172534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.172556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.172615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.172631:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593714048 00000100:00100000:0.0:1746143748.172633:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593714048 00002000:00100000:0.0:1746143748.172647:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1314816->1445887) req@ffff880094c11880 x1830963593714048/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.172653:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963593714048 ext(1314816->1445887) 00010000:00010000:0.0:1746143748.172660:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 20 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.172671:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 20 pid: 15784 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746143748.172676:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c11880 00000100:00100000:0.0:1746143748.172686:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1626 00000100:00100000:0.0:1746143748.172691:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963593714048:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143748.180131:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593714048:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7437us (7514us total) trans 17179872928 rc 0/0 00000100:00100000:0.0:1746143748.180158:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1626 00002000:00100000:0.0:1746143748.180167:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1314816->1445887) req@ffff880094c11880 x1830963593714048/t17179872928(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:144/0 lens 488/448 e 0 to 0 dl 1746143759 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.180183:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963593714048 ext(1314816->1445887) 00010000:00010000:0.0:1746143748.180191:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 22 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.180204:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 22 pid: 15784 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746143748.180210:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c11880 00000100:00100000:0.0:1746143748.187160:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593714432 00000100:00100000:0.0:1746143748.187164:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593714432 00010000:00010000:0.0:1746143748.187189:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 22 pid: 15784 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.187212:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6509 00000100:00100000:0.0:1746143748.187218:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593714432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.187233:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.187255:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 22 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.187268:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 22 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.187291:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800936cce00/0xe984082ccd72d05d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1314816->1445887) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5d6f expref: 22 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.187782:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.187785:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.187797:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a63de800/0xe984082ccd72d0f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dca expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.187806:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a63de800/0xe984082ccd72d0f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dca expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.187844:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a63de800/0xe984082ccd72d0f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dca expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.187929:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594183296:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143748.188000:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.194952:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.194979:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593714688 00000100:00100000:0.0:1746143748.194988:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593714688 00002000:00100000:0.0:1746143748.195036:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4063232->4194303) req@ffff880094c13b80 x1830963593714688/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.195045:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13b80 with x1830963593714688 ext(4063232->4194303) 00010000:00010000:0.0:1746143748.195055:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dae expref: 26 pid: 6929 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.195070:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dae expref: 26 pid: 6929 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746143748.195083:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c13b80 00000100:00100000:0.0:1746143748.195103:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1627 00000100:00100000:0.0:1746143748.195111:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963593714688:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143748.196501:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594183296:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143748.196519:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.196545:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963593714432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9325us (9537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.196554:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6509 00000100:00100000:0.0:1746143748.198365:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.214079:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593715072 00000100:00100000:0.0:1746143748.214090:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593715072 00010000:00010000:0.0:1746143748.214126:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dae expref: 28 pid: 6929 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.214172:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6510 00000100:00100000:0.0:1746143748.214180:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963593715072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.214193:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143748.214212:0:7150:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5259 00010000:00010000:0.0:1746143748.214218:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dae expref: 28 pid: 6929 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.214231:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dae expref: 28 pid: 6929 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.214259:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b02c400/0xe984082ccd72d0d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5dae expref: 28 pid: 6929 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.214272:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.214275:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.214282:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a63dec00/0xe984082ccd72d113 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ddf expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.214291:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63dec00/0xe984082ccd72d113 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ddf expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.214328:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a63dec00/0xe984082ccd72d113 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ddf expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.214341:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594183552:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143748.214438:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.224695:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.253594:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183680 00000100:00100000:0.0:1746143748.253603:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183680 00000100:00100000:0.0:1746143748.253652:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1746143748.253659:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1830963594183680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746143748.253683:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 460259328 pending 1703936 free 3852468224 avail 3835691008 00000100:00100000:0.0:1746143748.253723:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1830963594183680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.253729:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1746143748.258681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.269414:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963594183936:0@lo:400:kworker.0 00000100:00100000:0.0:1746143748.269666:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143748.269733:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143748.269837:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963594183936:0@lo:400:kworker.0 00000100:00080000:0.0:1746143748.269975:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143748.270019:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594184192 00000100:00100000:0.0:1746143748.270022:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594184192 00000100:00100000:0.0:1746143748.270044:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1746143748.270049:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594184192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143748.270091:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594184192:12345-0@lo:400:kworker.0 Request processed in 41us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.270096:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1746143748.271389:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594184320 00000100:00100000:0.0:1746143748.271392:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594184320 00000100:00100000:0.0:1746143748.271422:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1746143748.271427:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963594184320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143748.271459:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963594184320:12345-0@lo:400:kworker.0 Request processed in 32us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.271464:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1746143748.272616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.274587:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.274609:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593715968 00000100:00100000:0.0:1746143748.274613:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593715968 00002000:00100000:0.0:1746143748.274635:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c10000 x1830963593715968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.274642:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10000 with x1830963593715968 ext(3145728->4194303) 00002000:00010000:0.0:1746143748.274645:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10000 00000100:00100000:0.0:1746143748.275178:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5670 00000100:00100000:0.0:1746143748.275185:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963593715968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143748.284543:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.284586:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.299750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.300920:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.308135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.315621:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593717248 00000100:00100000:0.0:1746143748.315630:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593717248 00010000:00010000:0.0:1746143748.315659:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72d11a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5de6 expref: 18 pid: 15784 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.316274:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6512 00000100:00100000:0.0:1746143748.316282:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963593717248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.316293:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.316312:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72d11a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5de6 expref: 18 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.316321:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72d11a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5de6 expref: 18 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.316339:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72d11a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5de6 expref: 18 pid: 15784 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.316367:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.316369:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143748.316376:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009133c200/0xe984082ccd72d128 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5df4 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.316383:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009133c200/0xe984082ccd72d128 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5df4 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.316410:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009133c200/0xe984082ccd72d128 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3317760->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5df4 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.316421:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594184960:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143748.317279:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.321433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.321475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.330561:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5676 00000100:00100000:0.0:1746143748.330567:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963593718144:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143748.334627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.349543:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.356530:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.356581:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.358289:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593719040 00000100:00100000:0.0:1746143748.358307:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593719040 00000100:00100000:0.0:1746143748.358371:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3788 00000100:00100000:0.0:1746143748.358378:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:27138:x1830963593719040:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143748.359529:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a8e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:27138:x1830963593719040:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 1147us (2996us total) trans 8589943215 rc 0/0 00000100:00100000:0.0:1746143748.359542:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3788 00000100:00100000:0.0:1746143748.362853:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.366466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.366674:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.366708:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.366742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.368526:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5678 00000100:00100000:0.0:1746143748.368535:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593719680:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143748.386423:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.389561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.392313:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593721216 00000100:00100000:0.0:1746143748.392326:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593721216 00010000:00010000:0.0:1746143748.392380:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d000/0xe984082ccd72d14b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e02 expref: 9 pid: 14762 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.392410:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6515 00000100:00100000:0.0:1746143748.392416:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963593721216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.392430:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.392436:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d000/0xe984082ccd72d14b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e02 expref: 9 pid: 14762 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.392445:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d000/0xe984082ccd72d14b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e02 expref: 9 pid: 14762 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.392465:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d000/0xe984082ccd72d14b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e02 expref: 9 pid: 14762 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.392961:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143748.392966:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72d191 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143748.392975:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72d191 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143748.392981:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72d191 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143748.393002:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.393047:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593721216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 631us (3494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.393053:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6515 00000100:00100000:0.0:1746143748.399822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.400326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.408001:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.408047:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.409795:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5680 00000100:00100000:0.0:1746143748.409807:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963593721984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143748.417423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.423794:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.423886:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.431072:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.437047:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.447546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.450531:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.507808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.513004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.513039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.515267:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.517628:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.525288:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.528170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.530120:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.530761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.533181:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.535681:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.565234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.571030:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.578214:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.578269:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594187264:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143748.578299:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f81a800/0xe984082ccd72d21d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3432448->3477503] (req 3432448->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e80 expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.578319:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81a800, rc 0) 00000100:00100000:0.0:1746143748.578377:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:30757:x1830963593726080:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7043us (7348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.578386:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12366 00000100:00100000:0.0:1746143748.603394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.603434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.603455:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593726720 00000100:00100000:0.0:1746143748.603461:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593726720 00000100:00100000:0.0:1746143748.603502:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12367 00000100:00100000:0.0:1746143748.603509:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963593726720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143748.603526:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.603544:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4277200/0xe984082ccd72d224 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5e87 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.603596:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594187520:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143748.603647:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.608502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.608534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143748.608582:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143747 -> 1746143748 00000100:00100000:0.0:1746143748.608603:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594187520:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143748.608637:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4277200/0xe984082ccd72d224 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e87 expref: 43 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143748.608649:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4277200/0xe984082ccd72d224 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e87 expref: 43 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143748.608659:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4277200, rc 0) 00000100:00100000:0.0:1746143748.608697:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963593726720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5189us (5263us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143748.608705:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12367 00000100:00100000:0.0:1746143748.608729:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593727104 00000100:00100000:0.0:1746143748.608734:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593727104 00000100:00100000:0.0:1746143748.608763:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12368 00000100:00100000:0.0:1746143748.608769:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593727104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143748.608782:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.608796:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6468200/0xe984082ccd72d22b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5e8e expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143748.608842:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594187648:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143748.608886:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143748.614973:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593727360 00000100:00100000:0.0:1746143748.614981:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593727360 00000100:00100000:0.0:1746143748.616434:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3791 00000100:00100000:0.0:1746143748.616446:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:30757:x1830963593727360:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143748.616656:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:30757:x1830963593727360:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 213us (1796us total) trans 8589943221 rc 0/0 00000100:00100000:0.0:1746143748.616663:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3791 00000100:00100000:0.0:1746143748.660629:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.660717:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.662867:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.665121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.665164:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.665188:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.665207:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593728640 00000100:00100000:0.0:1746143748.665212:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593728640 00010000:00010000:0.0:1746143748.665255:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81a600/0xe984082ccd72d20f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e79 expref: 19 pid: 20509 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.665276:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593728896 00000100:00100000:0.0:1746143748.665278:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593728896 00010000:00010000:0.0:1746143748.665286:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d600/0xe984082ccd72d1a6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e48 expref: 9 pid: 14762 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.665301:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593728768 00000100:00100000:0.0:1746143748.665302:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593728768 00010000:00010000:0.0:1746143748.665311:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72d1c9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e4f expref: 252 pid: 14762 timeout: 927 lvb_type: 0 00000100:00100000:0.0:1746143748.665326:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6525 00000100:00100000:0.0:1746143748.665331:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963593728640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.665353:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.665358:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81a600/0xe984082ccd72d20f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e79 expref: 19 pid: 20509 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.665367:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81a600/0xe984082ccd72d20f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e79 expref: 19 pid: 20509 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.665384:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143748.665387:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72d240 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.665394:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72d240 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.665399:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.665429:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963593728640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.665435:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6525 00000100:00100000:0.0:1746143748.665451:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6527 00000100:00100000:0.0:1746143748.665456:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1962:x1830963593728768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143748.665463:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143748.665466:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72d1c9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e4f expref: 252 pid: 14762 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.666591:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72d1c9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e4f expref: 252 pid: 14762 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.666608:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a06c1400/0xe984082ccd72d1c9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e4f expref: 252 pid: 14762 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.666624:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143748.666627:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72d240 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.666633:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72d240 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.666638:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72d240 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.666661:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143748.666682:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1962:x1830963593728768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1226us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143748.666689:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6527 00000100:00100000:0.0:1746143748.666818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.667192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.685515:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.701168:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593729792 00000100:00100000:0.0:1746143748.701177:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593729792 00002000:00100000:0.0:1746143748.701257:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f3c8700 x1830963593729792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:144/0 lens 488/0 e 0 to 0 dl 1746143759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.701269:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8700 with x1830963593729792 ext(2097152->3145727) 00002000:00010000:0.0:1746143748.701275:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8700 00000100:00100000:0.0:1746143748.701298:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5691 00000100:00100000:0.0:1746143748.701306:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593729792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143748.713030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.714060:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.733508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.733641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.733687:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.742211:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.760972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.769995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.771788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.778999:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963593732480:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 7091us (9003us total) trans 17179872932 rc 0/0 00000100:00100000:0.0:1746143748.779012:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1637 00002000:00100000:0.0:1746143748.779024:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3829760->4177919) req@ffff8801305ca680 x1830963593732480/t17179872932(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:144/0 lens 488/448 e 0 to 0 dl 1746143759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143748.779034:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca680 with x1830963593732480 ext(3829760->4177919) 00010000:00010000:0.0:1746143748.779045:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094875600/0xe984082ccd72d25c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3829760->18446744073709551615] (req 3829760->4177919) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5eb1 expref: 26 pid: 6929 timeout: 927 lvb_type: 0 00010000:00010000:0.0:1746143748.779061:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094875600/0xe984082ccd72d25c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3829760->18446744073709551615] (req 3829760->4177919) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5eb1 expref: 26 pid: 6929 timeout: 927 lvb_type: 0 00002000:00010000:0.0:1746143748.779074:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305ca680 00000100:00100000:0.0:1746143748.788447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.797902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.802487:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.832029:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.853318:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.858962:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.865605:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.870083:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.873908:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.873943:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.882022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.884783:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143748.885222:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd72d2cc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.885229:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd72d2cc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143748.885249:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143748.885399:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd72d2c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ee9 expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.885938:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd72d2cc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ee9 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.885945:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143748.885948:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143748.885950:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ff800, rc 0) 00000100:00100000:0.0:1746143748.886366:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:30771:x1830963593734784:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 8063us (8364us total) trans 8589943225 rc 0/0 00000100:00100000:0.0:1746143748.886372:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8963 00000100:00100000:0.0:1746143748.891510:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593735296 00000100:00100000:0.0:1746143748.891521:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593735296 00000100:00100000:0.0:1746143748.891568:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8964 00000100:00100000:0.0:1746143748.891576:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:30771:x1830963593735296:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143748.891603:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143748.891607:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143748.891635:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd72d2cc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ee9 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.891653:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143748.891657:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143748.891670:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd72d2da lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5ef0 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.891762:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891775:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891784:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891794:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891802:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891807:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891812:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d8200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143748.891815:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891820:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891826:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143748.891828:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143748.891831:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891834:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72d2e1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143748.891855:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd72d2da lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ef0 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.891861:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9600/0xe984082ccd72d2da lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ef0 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143748.891867:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d9600, rc 0) 00000100:00100000:0.0:1746143748.891918:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:30771:x1830963593735296:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 343us (495us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143748.891924:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8964 00000100:00100000:0.0:1746143748.893863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.923860:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.927108:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.928395:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.930481:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.933185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.939415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.944969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.954573:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.978057:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143748.987369:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.001703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.011606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.011636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.011656:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737728 00000100:00100000:0.0:1746143749.011661:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737728 00010000:00010000:0.0:1746143749.011687:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009133c800/0xe984082ccd72d160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e1e expref: 7 pid: 15784 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746143749.011713:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6538 00000100:00100000:0.0:1746143749.011720:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963593737728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.011731:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.011750:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009133c800/0xe984082ccd72d160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e1e expref: 7 pid: 15784 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.011759:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009133c800/0xe984082ccd72d160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e1e expref: 7 pid: 15784 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.011781:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009133c800/0xe984082ccd72d160 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e1e expref: 7 pid: 15784 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.011795:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.011811:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1963:x1830963593737728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.011817:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6538 00000100:00100000:0.0:1746143749.011847:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593737856 00000100:00100000:0.0:1746143749.011850:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593737856 00010000:00010000:0.0:1746143749.011859:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f4400/0xe984082ccd72d0db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5db5 expref: 26 pid: 8497 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143749.011869:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6540 00000100:00100000:0.0:1746143749.011874:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593737856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.011879:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.011891:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f8f4400/0xe984082ccd72d0db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5db5 expref: 26 pid: 8497 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.011901:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f8f4400/0xe984082ccd72d0db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5db5 expref: 26 pid: 8497 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.011912:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f8f4400/0xe984082ccd72d0db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5db5 expref: 26 pid: 8497 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.011921:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.011924:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143749.012885:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094874400/0xe984082ccd72d320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5f13 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.012894:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094874400/0xe984082ccd72d320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5f13 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.012913:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094874400/0xe984082ccd72d320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5f13 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143749.012921:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594190976:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143749.012961:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143749.016136:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.019951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.037430:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.042047:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.044859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.048377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.062193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.070851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.101826:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.108916:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.114625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.115344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.128491:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.132108:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.140669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.149814:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.182136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.185992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.189461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.189492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.189540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.200599:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.207352:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.227319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.244465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.244564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.259912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.259957:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.296246:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.307840:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.307881:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.307918:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.308115:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6548 00000100:00100000:0.0:1746143749.308123:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963593744128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.308129:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.308158:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094875000/0xe984082ccd72d247 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ea3 expref: 11 pid: 6929 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.308167:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094875000/0xe984082ccd72d247 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ea3 expref: 11 pid: 6929 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.308179:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094875000/0xe984082ccd72d247 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5ea3 expref: 11 pid: 6929 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.308196:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.308211:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593744128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.308217:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6548 00000100:00100000:0.0:1746143749.308255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.311612:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593744768 00000100:00100000:0.0:1746143749.311617:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593744768 00002000:00100000:0.0:1746143749.311646:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3899392->3903487) req@ffff88008f3c8380 x1830963593744768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.311655:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8380 with x1830963593744768 ext(3899392->3903487) 00002000:00010000:0.0:1746143749.311658:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8380 00000100:00100000:0.0:1746143749.311725:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5710 00000100:00100000:0.0:1746143749.311732:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593744768:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143749.313225:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593744768:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1489us (1703us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143749.313234:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5710 00002000:00100000:0.0:1746143749.313240:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3899392->3903487) req@ffff88008f3c8380 x1830963593744768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746143760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.313248:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8380 with x1830963593744768 ext(3899392->3903487) 00002000:00010000:0.0:1746143749.313252:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8380 00000100:00100000:0.0:1746143749.313899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.337481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.337553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.340856:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.342588:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.343558:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.349853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.353221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.353299:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.358851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.363289:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.371106:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.377045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.377090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.388234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.392127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.422560:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.431944:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.434963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.435051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.450234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.450294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.450623:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143749.452804:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594194944:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143749.452821:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06c0800/0xe984082ccd72d493 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5fd7 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.452832:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06c0800/0xe984082ccd72d493 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5fd7 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143749.452847:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06c0800, rc 0) 00000100:00100000:0.0:1746143749.453242:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963593749120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2733us (3008us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143749.453248:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12400 00000100:00100000:0.0:1746143749.454271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.454308:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.458903:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593749760 00000100:00100000:0.0:1746143749.458907:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593749760 00000100:00100000:0.0:1746143749.458933:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12402 00000100:00100000:0.0:1746143749.458938:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:30799:x1830963593749760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143749.458950:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143749.458962:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094874800/0xe984082ccd72d4a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a5fe5 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.458980:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009518b800/0xe984082ccd72d3b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5f60 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.458986:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143749.458987:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143749.458990:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094874800/0xe984082ccd72d4a1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5fe5 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.459005:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009518b800/0xe984082ccd72d3b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5f60 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.459014:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009518b800/0xe984082ccd72d3b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5f60 expref: 9 pid: 6929 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143749.459023:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093d54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594195328:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143749.459060:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143749.462522:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.462548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.470909:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.471696:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.479354:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.479395:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.484749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.484846:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.484895:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.492507:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.503558:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.506977:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.512797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.512842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.524242:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.531692:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.541251:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.547407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.561224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.581610:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.581652:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.581690:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.584149:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12411 00000100:00100000:0.0:1746143749.584158:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:30802:x1830963593754752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143749.584169:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143749.584186:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013013d800/0xe984082ccd72d503 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a602b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.584213:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06c1400/0xe984082ccd72d4a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5fec expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.584220:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143749.584222:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143749.584225:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013013d800/0xe984082ccd72d503 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a602b expref: 15 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.584247:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06c1400/0xe984082ccd72d4a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5fec expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.584257:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06c1400/0xe984082ccd72d4a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5fec expref: 32 pid: 8495 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143749.584266:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594196992:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143749.584312:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143749.586121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.594509:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.595883:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.599836:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.599872:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.604189:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.604216:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143749.604847:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0xe984082ccd72d518 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143749.604854:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0xe984082ccd72d518 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143749.604871:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143749.604982:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0xe984082ccd72d511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6039 expref: 29 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.605004:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0xe984082ccd72d518 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6039 expref: 28 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.605010:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143749.605012:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143749.605014:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:0.0:1746143749.605031:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:30805:x1830963593755392:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9174us (10527us total) trans 8589943244 rc 0/0 00000100:00100000:0.0:1746143749.605036:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8976 00000100:00100000:0.0:1746143749.607377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.612296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.620825:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.620861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.623501:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.627422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.632500:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.636511:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.641539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.649415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.657105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.664406:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.664454:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.668019:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6573 00000100:00100000:0.0:1746143749.668029:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b03a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593758336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.668036:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.668056:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cab8800/0xe984082ccd72d175 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e17 expref: 6 pid: 6929 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.668072:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cab8800/0xe984082ccd72d175 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e17 expref: 6 pid: 6929 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.668084:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cab8800/0xe984082ccd72d175 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a5e17 expref: 6 pid: 6929 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.668107:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.668125:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b03a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593758336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.668131:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6573 00000100:00100000:0.0:1746143749.668250:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.671642:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.675637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.675677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.679543:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.713983:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.727056:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.736099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.750736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.759304:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.764309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.770366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.832934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.847482:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.847516:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.847550:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.871551:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963593762048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21936us (23992us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143749.871561:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5733 00002000:00100000:0.0:1746143749.871571:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136b9d180 x1830963593762048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:145/0 lens 488/440 e 0 to 0 dl 1746143760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.871579:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d180 with x1830963593762048 ext(1048576->2097151) 00002000:00010000:0.0:1746143749.871584:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9d180 00000100:00100000:0.0:1746143749.902577:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.908418:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.914165:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593762304 00000100:00100000:0.0:1746143749.914170:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593762304 00010000:00010000:0.0:1746143749.914192:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009808aa00/0xe984082ccd72d4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6008 expref: 12 pid: 4582 timeout: 928 lvb_type: 1 00000100:00100000:0.0:1746143749.914219:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6575 00000100:00100000:0.0:1746143749.914224:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963593762304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.914233:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.914252:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009808aa00/0xe984082ccd72d4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6008 expref: 12 pid: 4582 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.914262:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009808aa00/0xe984082ccd72d4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6008 expref: 12 pid: 4582 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.914277:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009808aa00/0xe984082ccd72d4e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6008 expref: 12 pid: 4582 timeout: 928 lvb_type: 1 00010000:00010000:0.0:1746143749.914293:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.914318:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1962:x1830963593762304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.916570:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6575 00000100:00100000:0.0:1746143749.917364:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593762688 00000100:00100000:0.0:1746143749.917372:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593762688 00002000:00100000:0.0:1746143749.917411:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1380352->1441791) req@ffff880094305c00 x1830963593762688/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:145/0 lens 488/0 e 0 to 0 dl 1746143760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143749.917421:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830963593762688 ext(1380352->1441791) 00010000:00010000:0.0:1746143749.917429:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093326c00/0xe984082ccd72d52d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6047 expref: 11 pid: 15784 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.917442:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093326c00/0xe984082ccd72d52d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1380352->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6047 expref: 11 pid: 15784 timeout: 928 lvb_type: 0 00002000:00010000:0.0:1746143749.917449:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094305c00 00000100:00100000:0.0:1746143749.917494:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1645 00000100:00100000:0.0:1746143749.917503:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963593762688:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143749.927436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.928171:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.937441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.937562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.937581:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.937595:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593763584 00000100:00100000:0.0:1746143749.937598:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593763584 00010000:00010000:0.0:1746143749.937613:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c9cc00/0xe984082ccd72d550 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a605c expref: 18 pid: 15784 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143749.937626:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593763712 00000100:00100000:0.0:1746143749.937628:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593763712 00010000:00010000:0.0:1746143749.937635:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009808a400/0xe984082ccd72d4fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6024 expref: 34 pid: 4581 timeout: 928 lvb_type: 0 00000100:00100000:0.0:1746143749.937646:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6578 00000100:00100000:0.0:1746143749.937651:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963593763584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.937658:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.937673:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c9cc00/0xe984082ccd72d550 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a605c expref: 18 pid: 15784 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.937681:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c9cc00/0xe984082ccd72d550 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a605c expref: 18 pid: 15784 timeout: 928 lvb_type: 0 00010000:00010000:0.0:1746143749.937698:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.937727:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963593763584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.937735:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6578 00000100:00100000:0.0:1746143749.950907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.964450:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.964539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.971446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.977059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.989793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.997015:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.997461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.998400:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.998427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.998462:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143749.998512:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 706 00000100:00100000:0.0:1746143749.998518:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1963:x1830963593765248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143749.998525:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143749.998539:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4bbe00/0xe984082ccd72d5d5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60b0 expref: 33 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143749.998788:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143749.998792:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143749.998805:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1963:x1830963593765248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 288us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143749.998811:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 706 00000100:00100000:0.0:1746143750.002951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143750.006165:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143750.009462:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.009532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.009566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.009592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143750.010157:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143750.010817:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143750.014419:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143750.014943:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143750.016950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.018572:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593766912 00000100:00100000:0.0:1746143750.018576:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593766912 00000100:00100000:0.0:1746143750.018603:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12433 00000100:00100000:0.0:1746143750.018608:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:30819:x1830963593766912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.018615:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.018623:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72d629 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a60e8 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.018637:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4bb800/0xe984082ccd72d5e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2437120->3145727] (req 2437120->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60b7 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.018643:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143750.018644:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143750.018647:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72d629 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60e8 expref: 34 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.018661:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4bb800/0xe984082ccd72d5e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2437120->3145727] (req 2437120->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60b7 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.018667:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f4bb800/0xe984082ccd72d5e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2437120->3145727] (req 2437120->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60b7 expref: 34 pid: 25369 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143750.018679:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594201728:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143750.018712:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00080000:0.0:1746143750.018722:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143750.019301:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143750.019544:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143750.020017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.020030:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593767296 00000100:00100000:0.0:1746143750.020032:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593767296 00000100:00100000:0.0:1746143750.020050:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12434 00000100:00100000:0.0:1746143750.020054:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:30816:x1830963593767296:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143750.020062:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.020070:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5c00/0xe984082ccd72d630 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a60ef expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.020085:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4bbc00/0xe984082ccd72d5b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60a9 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.020091:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4bb400/0xe984082ccd72d5f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60cc expref: 16 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.020096:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.020097:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.020100:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9c5c00/0xe984082ccd72d630 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3375103] (req 3145728->3375103) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60ef expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.020116:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f4bb400/0xe984082ccd72d5f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60cc expref: 16 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.020124:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f4bb400/0xe984082ccd72d5f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60cc expref: 16 pid: 25369 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746143750.020133:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594201856:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143750.020196:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f4bbc00/0xe984082ccd72d5b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60a9 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.020203:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f4bbc00/0xe984082ccd72d5b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60a9 expref: 21 pid: 25369 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143750.020210:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594201984:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143750.020223:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.021074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.022678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.023703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.023728:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.026098:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143750.027542:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143750.027546:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143750.027554:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593768576 00000100:00100000:0.0:1746143750.027557:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593768576 00000100:00100000:0.0:1746143750.027584:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593768704 00000100:00100000:0.0:1746143750.027586:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593768704 00000100:00100000:0.0:1746143750.027598:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12439 00000100:00100000:0.0:1746143750.027603:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593768576:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143750.027612:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.027618:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd72d653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6112 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.027639:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594202368:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143750.027673:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.031581:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594202368:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143750.031613:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd72d653 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6112 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.031626:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9c4600/0xe984082ccd72d653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6112 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.031654:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9c4600, rc 0) 00000100:00100000:0.0:1746143750.031751:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593768576:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4145us (4775us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.031759:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12439 00000100:00100000:0.0:1746143750.033270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.035449:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.038547:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.040171:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.040223:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.040667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.056673:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.056714:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.056731:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593770880 00000100:00100000:0.0:1746143750.056742:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593770880 00002000:00100000:0.0:1746143750.056773:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009ace7b80 x1830963593770880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:146/0 lens 488/0 e 0 to 0 dl 1746143761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.056783:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ace7b80 with x1830963593770880 ext(2097152->3145727) 00002000:00010000:0.0:1746143750.056788:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ace7b80 00000100:00100000:0.0:1746143750.056812:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593771136 00000100:00100000:0.0:1746143750.056815:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593771136 00002000:00100000:0.0:1746143750.056826:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3375104->4194303) req@ffff88009ace5880 x1830963593771136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:146/0 lens 488/0 e 0 to 0 dl 1746143761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.056833:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ace5880 with x1830963593771136 ext(3375104->4194303) 00002000:00010000:0.0:1746143750.056835:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ace5880 00000100:00100000:0.0:1746143750.056849:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5742 00000100:00100000:0.0:1746143750.056854:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963593771136:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143750.060750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.070026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.070222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.070252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.070265:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593771392 00000100:00100000:0.0:1746143750.070270:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593771392 00000100:00100000:0.0:1746143750.070302:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593771648 00000100:00100000:0.0:1746143750.070304:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593771648 00000100:00100000:0.0:1746143750.070312:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593771904 00000100:00100000:0.0:1746143750.070313:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593771904 00000100:00100000:0.0:1746143750.070323:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12441 00000100:00100000:0.0:1746143750.070337:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593771392:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143750.070365:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800930c5400/0xe984082ccd72d692 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.070379:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4ba400/0xe984082ccd72d622 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60e1 expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.070385:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.070386:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.070389:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c5400/0xe984082ccd72d692 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.070408:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f4ba400/0xe984082ccd72d622 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60e1 expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.070417:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f4ba400/0xe984082ccd72d622 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60e1 expref: 14 pid: 25369 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143750.070426:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594203008:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143750.070468:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.070488:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.070533:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.070548:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.070559:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593771776 00000100:00100000:0.0:1746143750.070561:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593771776 00000100:00100000:0.0:1746143750.071321:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12444 00000100:00100000:0.0:1746143750.071334:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963593771520:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143750.071347:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a0750400/0xe984082ccd72d6a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.071360:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009808b400/0xe984082ccd72d4f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a601d expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.071367:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca49000/0xe984082ccd72d63e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60fd expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.071373:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012faf7400/0xe984082ccd72d50a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6032 expref: 34 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.071377:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.071378:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.071380:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0750400/0xe984082ccd72d6a7 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.071392:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012faf7400/0xe984082ccd72d50a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6032 expref: 34 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.071398:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012faf7400/0xe984082ccd72d50a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6032 expref: 34 pid: 4581 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746143750.071405:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594203264:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143750.071425:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca49000/0xe984082ccd72d63e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60fd expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.071431:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca49000/0xe984082ccd72d63e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60fd expref: 9 pid: 12618 timeout: 929 lvb_type: 1 00000100:00100000:0.0:1746143750.071442:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594203520:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143750.071457:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009808b400/0xe984082ccd72d4f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a601d expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.071464:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009808b400/0xe984082ccd72d4f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a601d expref: 14 pid: 4581 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143750.071470:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594203776:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143750.071479:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.071492:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12446 00000100:00100000:0.0:1746143750.071496:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963593772032:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143750.071508:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.071515:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c93f200/0xe984082ccd72d5a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3235839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6094 expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.071521:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72d629 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60e8 expref: 34 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.071525:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143750.071526:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143750.071528:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.072458:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72d629 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60e8 expref: 34 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.072464:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6264000/0xe984082ccd72d629 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a60e8 expref: 34 pid: 6929 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143750.072471:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594204416:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143750.072515:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c93f200/0xe984082ccd72d5a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3235839) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6094 expref: 14 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.072521:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c93f200/0xe984082ccd72d5a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3235839) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6094 expref: 14 pid: 25369 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143750.072527:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594204544:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143750.072537:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.077431:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077535:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077549:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077564:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077577:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077589:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077599:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077617:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.077638:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594204416:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143750.077663:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594204544:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143750.077674:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.077704:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.078672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.081717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.085434:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.092255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.092296:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.092343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143750.092895:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092901:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092918:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092925:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092931:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092937:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368a7000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143750.092941:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092948:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092956:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.092961:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a7000/0xe984082ccd72d6b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.093911:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1962:x1830963593772032:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 22412us (23360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.093919:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12446 00000100:00100000:0.0:1746143750.094225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.094268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.097265:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.097280:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593774592 00000100:00100000:0.0:1746143750.097458:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593774592 00010000:00010000:0.0:1746143750.097481:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57afc00/0xe984082ccd72d67d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6127 expref: 16 pid: 20509 timeout: 929 lvb_type: 0 00000100:00100000:0.0:1746143750.097508:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6603 00000100:00100000:0.0:1746143750.097513:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963593774592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143750.097697:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143750.097704:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57afc00/0xe984082ccd72d67d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6127 expref: 16 pid: 20509 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143750.097714:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57afc00/0xe984082ccd72d67d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6127 expref: 16 pid: 20509 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143750.097730:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57afc00/0xe984082ccd72d67d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6127 expref: 16 pid: 20509 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143750.097740:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143750.097744:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd72d6df lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143750.097753:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd72d6df lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143750.097759:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd72d6df lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143750.097774:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143750.097803:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963593774592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 290us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.097809:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6603 00000100:00100000:0.0:1746143750.099435:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.099475:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.102498:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.108535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.112454:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.116361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.120579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.123667:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.129226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.129263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.129321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.138965:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.140078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.140135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.140179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.140192:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593777664 00000100:00100000:0.0:1746143750.140195:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593777664 00000100:00100000:0.0:1746143750.140212:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593777280 00000100:00100000:0.0:1746143750.140215:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593777280 00000100:00100000:0.0:1746143750.140224:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593777536 00000100:00100000:0.0:1746143750.140225:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593777536 00000100:00100000:0.0:1746143750.140236:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12452 00000100:00100000:0.0:1746143750.140241:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963593777664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.140249:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.140258:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093326c00/0xe984082ccd72d702 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a616d expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143750.140272:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a05, atime: 0x68140a05, ctime: 0x68140a05, blocks: 0x821 00010000:00010000:0.0:1746143750.140280:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.140282:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.140286:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093326c00/0xe984082ccd72d702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a616d expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.140295:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093326c00/0xe984082ccd72d702 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a616d expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.140301:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326c00, rc 0) 00000100:00100000:0.0:1746143750.140320:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593777664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.140336:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12452 00000100:00100000:0.0:1746143750.140348:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12453 00000100:00100000:0.0:1746143750.140353:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963593777280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.140359:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.140368:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093327600/0xe984082ccd72d709 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6158 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143750.140378:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a05, atime: 0x68140a05, ctime: 0x68140a05, blocks: 0x7a9 00010000:00010000:0.0:1746143750.140386:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.140387:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.140391:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093327600/0xe984082ccd72d709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6158 expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.140398:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093327600/0xe984082ccd72d709 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6158 expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.140404:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327600, rc 0) 00000100:00100000:0.0:1746143750.140417:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593777280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.140421:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12453 00000100:00100000:0.0:1746143750.142236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.144740:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.144793:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.149233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.151238:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.151272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.151290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.152914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.155998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.156083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.157763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.165411:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.165748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.165792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.169653:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.169687:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.169707:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.169779:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.173855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.174007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.174820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.174854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.176290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.177965:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.177991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.178012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.182007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.185618:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.311363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.315387:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.315443:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.320547:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.320656:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.329697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.355022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.358696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.366441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.375266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.375304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.375350:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.376937:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5759 00000100:00100000:0.0:1746143750.376943:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963593784832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143750.407213:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963593784576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30456us (31900us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143750.407222:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5758 00002000:00100000:0.0:1746143750.407231:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fd18e00 x1830963593784576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:146/0 lens 488/440 e 0 to 0 dl 1746143761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.407239:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fd18e00 with x1830963593784576 ext(1048576->2097151) 00002000:00010000:0.0:1746143750.407244:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fd18e00 00000100:00100000:0.0:1746143750.417639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.427585:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.427631:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.427711:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.427734:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593785344 00000100:00100000:0.0:1746143750.427741:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593785344 00000100:00100000:0.0:1746143750.427787:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593785472 00000100:00100000:0.0:1746143750.427790:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593785472 00000100:00100000:0.0:1746143750.427808:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12471 00000100:00100000:0.0:1746143750.427813:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963593785344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.427830:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.427845:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f6200/0xe984082ccd72d7e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a61f9 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.427863:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.427865:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.427871:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f6200/0xe984082ccd72d7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a61f9 expref: 37 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.427884:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f6200/0xe984082ccd72d7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a61f9 expref: 37 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.427892:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f6200, rc 0) 00000100:00100000:0.0:1746143750.427934:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963593785344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 120us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143750.427939:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12471 00000100:00100000:0.0:1746143750.428722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.430213:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.437031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.445900:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.449150:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593786752 00000100:00100000:0.0:1746143750.449155:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593786752 00002000:00100000:0.0:1746143750.449177:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093d55880 x1830963593786752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:146/0 lens 488/0 e 0 to 0 dl 1746143761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.449183:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d55880 with x1830963593786752 ext(1048576->2097151) 00010000:00010000:0.0:1746143750.449189:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72d710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6166 expref: 39 pid: 8495 timeout: 929 lvb_type: 1 00010000:00010000:0.0:1746143750.449203:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a63d9600/0xe984082ccd72d710 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6166 expref: 39 pid: 8495 timeout: 929 lvb_type: 1 00002000:00010000:0.0:1746143750.449209:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093d55880 00000100:00100000:0.0:1746143750.449275:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1654 00000100:00100000:0.0:1746143750.449280:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963593786752:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143750.464546:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.464581:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.472545:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.479736:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.486579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.490128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.507829:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.513934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.519611:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.526320:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.526390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.526440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.526464:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593789568 00000100:00100000:0.0:1746143750.526472:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593789568 00000100:00100000:0.0:1746143750.526530:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593789696 00000100:00100000:0.0:1746143750.526533:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593789696 00000100:00100000:0.0:1746143750.526555:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12479 00000100:00100000:0.0:1746143750.526561:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963593789568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.526576:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.526590:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0xe984082ccd72d81a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6231 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.526627:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594207872:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143750.527319:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.541063:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.548911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.569846:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.580671:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.580707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.580748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.582130:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5772 00000100:00100000:0.0:1746143750.582150:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963593790720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143750.603991:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963593790720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21854us (23282us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143750.603997:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5772 00002000:00100000:0.0:1746143750.604002:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009e5ce680 x1830963593790720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:146/0 lens 488/440 e 0 to 0 dl 1746143761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.604009:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ce680 with x1830963593790720 ext(3145728->4194303) 00002000:00010000:0.0:1746143750.604012:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5ce680 00000100:00100000:0.0:1746143750.608443:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.616303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.616347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.616390:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.620619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.622112:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.629232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.639963:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.640002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.640034:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.640074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.640367:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6618 00000100:00100000:0.0:1746143750.640374:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963593792512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143750.640381:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143750.641290:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a63d8600/0xe984082ccd72d7f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2371584->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a620e expref: 21 pid: 8495 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143750.641301:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a63d8600/0xe984082ccd72d7f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2371584->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a620e expref: 21 pid: 8495 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143750.641312:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63d8600/0xe984082ccd72d7f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2371584->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a620e expref: 21 pid: 8495 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143750.641335:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.641336:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143750.641340:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b42e600/0xe984082ccd72d83d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4751359] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6254 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.641347:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b42e600/0xe984082ccd72d83d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4751359] (req 4194304->4481023) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6254 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.641372:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b42e600/0xe984082ccd72d83d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4751359] (req 4194304->4481023) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6254 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143750.641387:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da20e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594209024:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143750.641432:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143750.650618:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.653136:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.657079:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.665101:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.669094:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.669228:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.675805:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.675832:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.675856:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.675868:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.676643:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.686298:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093d57800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594209280:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143750.686317:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06e1600/0xe984082ccd72d87c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6269 expref: 17 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.686336:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06e1600/0xe984082ccd72d87c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6269 expref: 17 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.686355:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06e1600, rc 0) 00000100:00100000:0.0:1746143750.686384:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963593794176:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9262us (10514us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.686390:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12488 00000100:00100000:0.0:1746143750.688547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.694257:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.699413:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.703668:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963593795328:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3364us (4253us total) trans 17179872943 rc 0/0 00000100:00100000:0.0:1746143750.703676:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1657 00002000:00100000:0.0:1746143750.703683:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1376256->1675263) req@ffff88012da23b80 x1830963593795328/t17179872943(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:146/0 lens 488/448 e 0 to 0 dl 1746143761 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.703690:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012da23b80 with x1830963593795328 ext(1376256->1675263) 00010000:00010000:0.0:1746143750.703695:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a06e1400/0xe984082ccd72d7fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6215 expref: 40 pid: 8495 timeout: 929 lvb_type: 0 00010000:00010000:0.0:1746143750.703703:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a06e1400/0xe984082ccd72d7fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6215 expref: 40 pid: 8495 timeout: 929 lvb_type: 0 00002000:00010000:0.0:1746143750.703709:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012da23b80 00000100:00100000:0.0:1746143750.704417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.705976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.706795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.709606:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593796096 00000100:00100000:0.0:1746143750.709610:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593796096 00002000:00100000:0.0:1746143750.709632:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136b9d500 x1830963593796096/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:146/0 lens 488/0 e 0 to 0 dl 1746143761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.709640:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d500 with x1830963593796096 ext(3145728->4194303) 00002000:00010000:0.0:1746143750.709643:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9d500 00000100:00100000:0.0:1746143750.709653:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5778 00000100:00100000:0.0:1746143750.709659:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963593796096:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143750.716013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.716107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.716186:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.733353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.733394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.733419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.733610:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12495 00000100:00100000:0.0:1746143750.733619:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963593797248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.733627:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.733634:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094769c00/0xe984082ccd72d8ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a62a8 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.733650:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094769c00/0xe984082ccd72d8ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a62a8 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.733659:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094769c00/0xe984082ccd72d8ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a62a8 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.733670:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094769c00, rc 0) 00000100:00100000:0.0:1746143750.733687:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963593797248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 71us (267us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.733717:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12495 00000100:00100000:0.0:1746143750.737212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.740934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.758058:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.759990:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593797888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12373us (12684us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143750.759999:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5782 00002000:00100000:0.0:1746143750.760007:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093d55f80 x1830963593797888/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:146/0 lens 488/440 e 0 to 0 dl 1746143761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.760351:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093d55f80 with x1830963593797888 ext(2097152->3145727) 00002000:00010000:0.0:1746143750.760356:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093d55f80 00000100:00100000:0.0:1746143750.763776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.767604:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.772264:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.772306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.776847:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593798784 00000100:00100000:0.0:1746143750.776854:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593798784 00000100:00100000:0.0:1746143750.776899:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12500 00000100:00100000:0.0:1746143750.776905:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963593798784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.776921:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.776935:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06e1400/0xe984082ccd72d8d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a62cb expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.776959:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06e1400/0xe984082ccd72d8d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a62cb expref: 43 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.776969:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06e1400/0xe984082ccd72d8d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a62cb expref: 43 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.776981:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06e1400, rc 0) 00000100:00100000:0.0:1746143750.777018:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963593798784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 112us (377us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.777023:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12500 00000100:00100000:0.0:1746143750.787567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.790079:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.799006:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.799104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.801563:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.802389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.802414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.807198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.807254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.823702:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.827725:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.828157:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.832345:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801216 00000100:00100000:0.0:1746143750.832448:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801216 00002000:00100000:0.0:1746143750.832481:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2101247) req@ffff880136b9dc00 x1830963593801216/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:146/0 lens 488/0 e 0 to 0 dl 1746143761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.832491:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9dc00 with x1830963593801216 ext(2097152->2101247) 00002000:00010000:0.0:1746143750.832495:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9dc00 00000100:00100000:0.0:1746143750.833043:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5787 00000100:00100000:0.0:1746143750.833050:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963593801216:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143750.833198:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963593801216:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 148us (917us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143750.833204:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5787 00002000:00100000:0.0:1746143750.833210:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2101247) req@ffff880136b9dc00 x1830963593801216/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:146/0 lens 488/4536 e 0 to 0 dl 1746143761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143750.833217:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9dc00 with x1830963593801216 ext(2097152->2101247) 00002000:00010000:0.0:1746143750.833219:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9dc00 00000100:00100000:0.0:1746143750.838983:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.843297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.846272:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593801856 00000100:00100000:0.0:1746143750.846277:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593801856 00000100:00100000:0.0:1746143750.846308:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12503 00000100:00100000:0.0:1746143750.846314:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963593801856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143750.846337:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143750.846351:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f3fc000/0xe984082ccd72d908 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a62e7 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143750.846377:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f3fc000/0xe984082ccd72d908 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a62e7 expref: 25 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.846386:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f3fc000/0xe984082ccd72d908 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a62e7 expref: 25 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143750.846399:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f3fc000, rc 0) 00000100:00100000:0.0:1746143750.847816:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963593801856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1496us (1610us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143750.847825:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12503 00000100:00100000:0.0:1746143750.856012:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.872612:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.879374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.938840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.942402:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.943162:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.947412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.956091:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.958221:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.965462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.969475:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.979734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143750.979927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.013815:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.013866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.024679:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.027835:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.027883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.028540:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.028982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.028998:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593805440 00000100:00100000:0.0:1746143751.029001:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593805440 00002000:00100000:0.0:1746143751.029018:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1691647) req@ffff88009c274380 x1830963593805440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.029025:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274380 with x1830963593805440 ext(1048576->1691647) 00002000:00010000:0.0:1746143751.029028:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c274380 00000100:00100000:0.0:1746143751.029885:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5793 00000100:00100000:0.0:1746143751.029893:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963593805440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143751.035713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.048459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.050840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.061344:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.061677:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.072916:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.084002:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.091820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.091869:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.097331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.100439:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.100753:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.105185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.110305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.118268:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.118325:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143751.124619:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime: 1746143749 -> 1746143750 00002000:00010000:0.0:1746143751.124622:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143749 -> 1746143750 00002000:00010000:0.0:1746143751.124624:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime: 1746143749 -> 1746143750 00000100:00100000:0.0:1746143751.124632:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594212864:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143751.124687:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f1c4400/0xe984082ccd72d9b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6357 expref: 41 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.124697:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f1c4400/0xe984082ccd72d9b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6357 expref: 41 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.124716:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f1c4400, rc 0) 00000100:00100000:0.0:1746143751.124734:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963593808384:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6122us (6417us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143751.124739:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12517 00000100:00100000:0.0:1746143751.124875:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.127579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.128079:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.134778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.139216:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.145891:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.145928:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.145963:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.151964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.152798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.178489:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.187061:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.192275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.198806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.199219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.199932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.199963:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12525 00000100:00100000:0.0:1746143751.199970:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1965:x1830963593811328:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143751.199985:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.199997:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba59600/0xe984082ccd72da0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6396 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.200014:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.200016:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.200022:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba59600/0xe984082ccd72da0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6396 expref: 6 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.200037:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba59600/0xe984082ccd72da0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6396 expref: 6 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.200044:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba59600, rc 0) 00000100:00100000:0.0:1746143751.200394:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593811328:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 424us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.200399:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12525 00000100:00100000:0.0:1746143751.200778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.200799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.200823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.207494:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.211014:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.215105:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.218899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.223574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.223952:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.232729:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.236572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.236603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.236622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.236640:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593813376 00000100:00100000:0.0:1746143751.236645:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593813376 00000100:00100000:0.0:1746143751.236672:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593813248 00000100:00100000:0.0:1746143751.236673:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593813248 00000100:00100000:0.0:1746143751.236681:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593813504 00000100:00100000:0.0:1746143751.236682:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593813504 00000100:00100000:0.0:1746143751.236693:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12533 00000100:00100000:0.0:1746143751.236699:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593813376:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143751.236732:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.236746:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd72d99b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6342 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.236752:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143751.236753:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143751.236756:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.236784:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd72d99b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6342 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.236794:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd72d99b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6342 expref: 18 pid: 4581 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.236806:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594214784:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143751.236865:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.238271:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.238361:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.238519:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.244040:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.244072:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.244104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.244723:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1665 00000100:00100000:0.0:1746143751.244731:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963593814272:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143751.245380:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136b9c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594215040:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143751.245397:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.266546:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.266554:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.266570:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.266576:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.266581:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267098:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091061600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143751.267100:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267107:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267119:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267125:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091061600/0xe984082ccd72da7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.267172:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593813248:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 30178us (30566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.267177:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12534 00010000:00010000:0.0:1746143751.267886:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267893:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267905:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267911:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267917:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267921:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091060600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143751.267923:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267930:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267938:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.267943:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091060600/0xe984082ccd72da97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.267987:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593813888:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 28449us (29467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.267992:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12538 00000100:00100000:0.0:1746143751.269075:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143751.271279:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271287:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271304:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271310:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271324:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271330:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba59e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143751.271333:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271339:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271347:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.271351:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba59e00/0xe984082ccd72da74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.271422:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593813376:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 34721us (34855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.271428:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12533 00000100:00100000:0.0:1746143751.273083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.276601:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.276664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.276700:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.276748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.277820:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.277854:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.277920:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000001:00080000:0.0:1746143751.305753:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943244 is committed 00000001:00080000:0.0:1746143751.305763:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943225 is committed 00000001:00080000:0.0:1746143751.305773:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943275 is committed 00000001:00080000:0.0:1746143751.305777:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943274 is committed 00000001:00080000:0.0:1746143751.305810:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943272 is committed 00000001:00080000:0.0:1746143751.305869:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943276 is committed 00000004:00080000:0.0:1746143751.305873:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1932 committed 00000004:00080000:0.0:1746143751.305887:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1904 committed 00000004:00080000:0.0:1746143751.305893:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1903 committed 00000004:00080000:0.0:1746143751.305894:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1902 committed 00000004:00080000:0.0:1746143751.305896:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1901 committed 00000004:00080000:0.0:1746143751.305897:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1931 committed 00000004:00080000:0.0:1746143751.305899:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1900 committed 00000004:00080000:0.0:1746143751.305900:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1930 committed 00000004:00080000:0.0:1746143751.305901:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1899 committed 00000004:00080000:0.0:1746143751.305904:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1929 committed 00000004:00080000:0.0:1746143751.305905:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1928 committed 00000004:00080000:0.0:1746143751.305907:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1927 committed 00000004:00080000:0.0:1746143751.305909:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1898 committed 00000004:00080000:0.0:1746143751.305910:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1897 committed 00000004:00080000:0.0:1746143751.305912:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1926 committed 00000004:00080000:0.0:1746143751.305914:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1925 committed 00000004:00080000:0.0:1746143751.305915:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1896 committed 00000100:00080000:0.0:1746143751.308226:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143751.308229:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143751.309247:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220032 00000100:00100000:0.0:1746143751.309252:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220032 00000100:00100000:0.0:1746143751.309272:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12555 00000100:00100000:0.0:1746143751.309281:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594220032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143751.309422:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594220032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (196us total) trans 21474840260 rc 0/0 00000100:00100000:0.0:1746143751.309427:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12555 00000100:00100000:0.0:1746143751.312311:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593818368 00000100:00100000:0.0:1746143751.312327:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593818368 00000100:00100000:0.0:1746143751.312367:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 8999 00000100:00100000:0.0:1746143751.312373:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30875:x1830963593818368:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143751.312387:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.312400:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba58000/0xe984082ccd72daac lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a63ea expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.312467:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba59000/0xe984082ccd72dab3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143751.312477:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba59000/0xe984082ccd72dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143751.312486:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba59000/0xe984082ccd72dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143751.312509:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00000004:00200000:0.0:1746143751.312513:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143751.312526:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba59000/0xe984082ccd72dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143751.312545:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba58000/0xe984082ccd72daac lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a63ea expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.312555:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba59000/0xe984082ccd72dab3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a63ea expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.312562:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88009066df00) 00010000:00010000:0.0:1746143751.312564:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143751.312566:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba59000, rc 0) 00000100:00100000:0.0:1746143751.312616:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:30875:x1830963593818368:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 243us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.312622:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 8999 00000100:00100000:0.0:1746143751.315887:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593818496 00000100:00100000:0.0:1746143751.315895:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593818496 00000100:00100000:0.0:1746143751.316282:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12556 00000100:00100000:0.0:1746143751.316291:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1963:x1830963593818496:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143751.316304:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.316331:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72daba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a63f1 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143751.316350:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a05, atime: 0x68140a05, ctime: 0x68140a05, blocks: 0x7a9 00010000:00010000:0.0:1746143751.316364:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.316366:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.316373:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72daba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a63f1 expref: 6 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.316385:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72daba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a63f1 expref: 6 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.316393:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba58e00, rc 0) 00000100:00100000:0.0:1746143751.316434:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1963:x1830963593818496:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 143us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.316441:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12556 00000100:00100000:0.0:1746143751.317136:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.317183:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.317200:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.317219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.317425:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12559 00000100:00100000:0.0:1746143751.317431:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593818880:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143751.317438:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.317446:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba59600/0xe984082ccd72dacf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6406 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143751.317457:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a06, atime: 0x68140a06, ctime: 0x68140a06, blocks: 0x821 00010000:00010000:0.0:1746143751.317464:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.317465:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.317469:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba59600/0xe984082ccd72dacf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6406 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.317478:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba59600/0xe984082ccd72dacf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6406 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.317485:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba59600, rc 0) 00000100:00100000:0.0:1746143751.317500:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963593818880:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.317512:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12559 00000100:00100000:0.0:1746143751.327134:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.327200:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.328787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.330116:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593819648 00000100:00100000:0.0:1746143751.330120:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593819648 00000100:00100000:0.0:1746143751.330156:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593820160 00000100:00100000:0.0:1746143751.330158:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593820160 00000100:00100000:0.0:1746143751.330172:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5805 00000100:00100000:0.0:1746143751.330177:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593819648:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143751.330192:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a081d600/0xe984082ccd72daf9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.330199:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.330201:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.330203:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081d600/0xe984082ccd72daf9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.330211:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081d600/0xe984082ccd72daf9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.334878:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593820672 00000100:00100000:0.0:1746143751.334884:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593820672 00000100:00100000:0.0:1746143751.335828:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5808 00000100:00100000:0.0:1746143751.335834:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963593820928:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143751.335852:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ae41200/0xe984082ccd72db0e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.335863:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.335864:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.335868:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae41200/0xe984082ccd72db0e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.335877:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae41200/0xe984082ccd72db0e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.337459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.386467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.388692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.390216:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.392357:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.394678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.398031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.401177:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.404405:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.411162:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.414424:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.419310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.424712:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.427417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.427482:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.428287:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.428339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.428393:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.430452:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.433359:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.437624:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000001:00080000:0.0:1746143751.465199:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943278 is committed 00000004:00080000:0.0:1746143751.465205:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1940 committed 00000004:00080000:0.0:1746143751.465211:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1913 committed 00000004:00080000:0.0:1746143751.465216:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1912 committed 00000004:00080000:0.0:1746143751.465218:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1911 committed 00000004:00080000:0.0:1746143751.465220:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1910 committed 00000004:00080000:0.0:1746143751.465221:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1939 committed 00000004:00080000:0.0:1746143751.465223:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1909 committed 00000004:00080000:0.0:1746143751.465224:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1938 committed 00000004:00080000:0.0:1746143751.465225:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1908 committed 00000004:00080000:0.0:1746143751.465227:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1937 committed 00000004:00080000:0.0:1746143751.465229:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1936 committed 00000004:00080000:0.0:1746143751.465230:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1935 committed 00000004:00080000:0.0:1746143751.465231:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1907 committed 00000004:00080000:0.0:1746143751.465233:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1906 committed 00000004:00080000:0.0:1746143751.465235:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1934 committed 00000004:00080000:0.0:1746143751.465236:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1933 committed 00000004:00080000:0.0:1746143751.465237:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1905 committed 00000100:00100000:0.0:1746143751.465805:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594222208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143751.465845:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143751.465864:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594222720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143751.465885:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.468270:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594223744:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143751.468275:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b162a00/2, rc 0, transno 21474840271 00000100:00100000:1.0:1746143751.468277:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594222080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.468282:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca6c700/2, rc 0, transno 21474840272 00000100:00100000:1.0:1746143751.468284:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594222592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.468289:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090767100/2, rc 0, transno 17179872959 00000100:00100000:1.0:1746143751.468291:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594223104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143751.468295:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093804e00/2, rc 0, transno 17179872960 00000100:00100000:1.0:1746143751.468297:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594223616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143751.468443:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dd180/2, rc 0, transno 21474840266 00000100:00100000:0.0:1746143751.468447:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594222720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143751.468457:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2300/2, rc 0, transno 21474840265 00000100:00100000:0.0:1746143751.468460:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594222208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143751.468859:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.472261:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.495346:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.520421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.523496:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.529932:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.531732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.539836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.539881:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.556742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.559545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.573266:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.576561:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.576576:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.576902:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.588160:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12594 00000100:00100000:1.0:1746143751.588167:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:30887:x1830963593827328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143751.588174:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.588181:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06c0200/0xe984082ccd72dbee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6484 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.588193:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143751.588196:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06c0200/0xe984082ccd72dbee lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6484 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.588203:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06c0200/0xe984082ccd72dbee lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6484 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.588211:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06c0200, rc 0) 00000100:00100000:1.0:1746143751.589033:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:30887:x1830963593827328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 864us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.589043:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12594 00000100:00100000:0.0:1746143751.594963:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.594987:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593827456 00000100:00100000:0.0:1746143751.594994:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593827456 00010000:00010000:0.0:1746143751.595018:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72db2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6422 expref: 11 pid: 15784 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.595043:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6675 00000100:00100000:0.0:1746143751.595049:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593827456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.595061:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.595080:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72db2a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6422 expref: 11 pid: 15784 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.595090:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd72db2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6422 expref: 11 pid: 15784 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.595111:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.595113:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.595119:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0c00/0xe984082ccd72dbe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a647d expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.595127:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0c00/0xe984082ccd72dbe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a647d expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.595135:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.595136:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.595154:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06c0200/0xe984082ccd72dbee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6484 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.595160:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06c0200/0xe984082ccd72dbee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6484 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.595187:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06c0200/0xe984082ccd72dbee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6484 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.595197:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594224768:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143751.595265:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0c00/0xe984082ccd72dbe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a647d expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.595272:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594224896:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143751.595289:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.600917:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.601899:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593827712 00000100:00100000:0.0:1746143751.601902:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593827712 00000100:00100000:0.0:1746143751.601921:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9008 00000100:00100000:0.0:1746143751.601926:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:30887:x1830963593827712:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143751.601933:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.601940:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801351b2600/0xe984082ccd72dbfc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6492 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.601960:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801351b2600/0xe984082ccd72dbfc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6492 expref: 246 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.601972:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801351b2600/0xe984082ccd72dbfc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6492 expref: 246 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.601978:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143751.601979:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143751.601982:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd72dbf5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a648b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.601987:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351b2600, rc 0) 00000100:00100000:0.0:1746143751.602006:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:30887:x1830963593827712:12345-192.168.202.48@tcp:101:cat.0 Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.602011:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9008 00000001:00080000:1.0:1746143751.610569:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943284 is committed 00000004:00080000:1.0:1746143751.610575:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1948 committed 00000004:00080000:1.0:1746143751.610612:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1922 committed 00000004:00080000:1.0:1746143751.610622:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1921 committed 00000004:00080000:1.0:1746143751.610624:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1920 committed 00000004:00080000:1.0:1746143751.610625:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1919 committed 00000004:00080000:1.0:1746143751.610626:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1947 committed 00000004:00080000:1.0:1746143751.610627:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1918 committed 00000004:00080000:1.0:1746143751.610629:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1946 committed 00000004:00080000:1.0:1746143751.610630:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1917 committed 00000004:00080000:1.0:1746143751.610631:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1945 committed 00000004:00080000:1.0:1746143751.610632:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1944 committed 00000004:00080000:1.0:1746143751.610633:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1943 committed 00000004:00080000:1.0:1746143751.610635:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1916 committed 00000004:00080000:1.0:1746143751.610637:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1915 committed 00000004:00080000:1.0:1746143751.610638:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1942 committed 00000004:00080000:1.0:1746143751.610639:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1941 committed 00000004:00080000:1.0:1746143751.610641:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1914 committed 00000001:00080000:1.0:1746143751.610646:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943281 is committed 00000001:00080000:1.0:1746143751.610651:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943279 is committed 00000100:00100000:0.0:1746143751.610752:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594225408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143751.610929:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594225152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143751.611578:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.611610:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143751.611668:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594226048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143751.611690:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594225664 00000100:00100000:0.0:1746143751.611695:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594225664 00000100:00100000:0.0:1746143751.611723:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594225408 00000100:00100000:0.0:1746143751.611725:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594225408 00000100:00100000:0.0:1746143751.611738:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12595 00000100:00100000:0.0:1746143751.611743:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963594225664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143751.611896:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143751.611899:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143751.611901:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143751.611903:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143751.611905:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143751.611933:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963594225664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (354us total) trans 17179872966 rc 0/0 00000100:00100000:0.0:1746143751.611939:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12595 00000100:00100000:0.0:1746143751.611961:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12596 00000100:00100000:0.0:1746143751.611965:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594225408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143751.612035:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143751.612038:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143750 -> 1746143750 00002000:00010000:0.0:1746143751.612039:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:0.0:1746143751.612041:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:0.0:1746143751.612042:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143751.612064:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594225408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (487us total) trans 17179872967 rc 0/0 00000100:00100000:0.0:1746143751.612068:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12596 00000100:00100000:1.0:1746143751.612684:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594225792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143751.612703:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612714:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594226304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.612729:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612742:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594226816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.612756:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612770:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143751.612775:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594226688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.612788:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612798:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594227200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.612810:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612916:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594225280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143751.612934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612942:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594225920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143751.612954:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612960:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594226432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.612970:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612976:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594226944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.612986:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.612993:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143751.612998:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594226560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613009:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.613016:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012da21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594227072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613027:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143751.613040:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226560 00000100:00100000:1.0:1746143751.613043:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226560 00000100:00100000:1.0:1746143751.613053:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594227072 00000100:00100000:1.0:1746143751.613054:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594227072 00000100:00100000:1.0:1746143751.613061:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12599 00000100:00100000:1.0:1746143751.613065:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963594226304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143751.613163:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143751.613165:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613167:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613169:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143751.613171:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 1961 -> 1961 00000100:00100000:1.0:1746143751.613184:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963594226304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (455us total) trans 21474840275 rc 0/0 00000100:00100000:1.0:1746143751.613189:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12599 00000100:00100000:1.0:1746143751.613196:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12602 00000100:00100000:1.0:1746143751.613199:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963594227200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613242:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12603 00000100:00100000:1.0:1746143751.613246:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963594225280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143751.613336:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963594227200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (525us total) trans 21474840277 rc 0/0 00000100:00100000:1.0:1746143751.613341:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12602 00000100:00100000:1.0:1746143751.613350:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12605 00000100:00100000:1.0:1746143751.613354:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594226432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143751.613419:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143751.613422:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613423:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613425:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143751.613427:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143751.613448:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594226432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (476us total) trans 21474840278 rc 0/0 00000100:00100000:1.0:1746143751.613455:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12605 00000100:00100000:1.0:1746143751.613463:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12606 00000100:00100000:1.0:1746143751.613467:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594226944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613532:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594226944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (544us total) trans 21474840279 rc 0/0 00000100:00100000:1.0:1746143751.613536:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12606 00000100:00100000:1.0:1746143751.613544:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12607 00000100:00100000:1.0:1746143751.613548:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594226560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143751.613605:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:1.0:1746143751.613608:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613609:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613610:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143751.613612:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5259 -> 5259 00000100:00100000:1.0:1746143751.613630:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594226560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (619us total) trans 21474840280 rc 0/0 00000100:00100000:1.0:1746143751.613635:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12607 00000100:00100000:1.0:1746143751.613643:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12608 00000100:00100000:1.0:1746143751.613647:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594227072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613712:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594227072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (683us total) trans 21474840281 rc 0/0 00000100:00100000:1.0:1746143751.613717:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12608 00002000:00010000:1.0:1746143751.613743:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143751.613746:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613747:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143751.613749:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143751.613751:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143751.613767:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594225280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 521us (833us total) trans 17179872970 rc 0/0 00000100:00100000:1.0:1746143751.613772:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12603 00000004:00080000:1.0:1746143751.613797:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012da22a00/2, rc 0, transno 21474840280 00000100:00100000:1.0:1746143751.613805:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594226560:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.613813:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012da21f80/2, rc 0, transno 21474840281 00000100:00100000:1.0:1746143751.613816:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594227072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.613823:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085180/2, rc 0, transno 17179872970 00000100:00100000:1.0:1746143751.613826:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594225280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143751.613831:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012da23100/2, rc 0, transno 21474840278 00000100:00100000:1.0:1746143751.613833:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594226432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.613839:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012da20000/2, rc 0, transno 21474840279 00000100:00100000:1.0:1746143751.613841:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594226944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613876:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594227328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613894:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143751.613909:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012da22d80/2, rc 0, transno 21474840276 00000100:00100000:1.0:1746143751.613912:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594226688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.613917:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a07c7b80/2, rc 0, transno 21474840277 00000100:00100000:1.0:1746143751.613920:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594227200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.613926:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a97800/2, rc 0, transno 17179872968 00000100:00100000:1.0:1746143751.613928:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594225152:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143751.613936:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0086680/2, rc 0, transno 17179872969 00000100:00100000:1.0:1746143751.613939:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594225792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143751.613944:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012da22680/2, rc 0, transno 21474840275 00000100:00100000:1.0:1746143751.613946:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594226304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143751.613951:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012da20a80/2, rc 0, transno 21474840274 00000100:00100000:1.0:1746143751.613953:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012da20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594226816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.613964:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594227328 00000100:00100000:1.0:1746143751.613966:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594227328 00000100:00100000:1.0:1746143751.613980:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12609 00000100:00100000:1.0:1746143751.613983:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963594227328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143751.614059:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963594227328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (164us total) trans 21474840282 rc 0/0 00000100:00100000:1.0:1746143751.614063:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12609 00000004:00080000:1.0:1746143751.614083:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ef100/2, rc 0, transno 21474840282 00000100:00100000:1.0:1746143751.614086:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594227328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143751.614695:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143751.614726:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0084e00/2, rc 0, transno 17179872967 00000100:00100000:0.0:1746143751.614729:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594225408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143751.614967:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226048 00000100:00100000:1.0:1746143751.614970:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226048 00000004:00080000:0.0:1746143751.616406:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085f80/2, rc 0, transno 17179872972 00000100:00100000:0.0:1746143751.616410:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594226048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143751.616420:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226176 00000100:00100000:0.0:1746143751.616423:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226176 00000100:00100000:0.0:1746143751.616440:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12611 00000100:00100000:0.0:1746143751.616444:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963594226176:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143751.616489:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085c00/2, rc 0, transno 17179872971 00000100:00100000:1.0:1746143751.616493:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594225920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143751.616671:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963594226176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (280us total) trans 17179872973 rc 0/0 00000100:00100000:0.0:1746143751.616676:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12611 00000100:00100000:0.0:1746143751.619810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.619851:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.620007:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593827840 00000100:00100000:1.0:1746143751.620012:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593827840 00000100:00100000:1.0:1746143751.620109:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3822 00000100:00100000:1.0:1746143751.620115:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:30887:x1830963593827840:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143751.620199:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:30887:x1830963593827840:12345-192.168.202.48@tcp:49:cat.0 Request processed in 84us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.620205:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3822 00000100:00100000:0.0:1746143751.625818:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.631050:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.631123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.636966:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.641824:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.644793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.644876:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593828992 00000100:00100000:0.0:1746143751.644880:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593828992 00010000:00010000:0.0:1746143751.644899:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801351b2800/0xe984082ccd72dbd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a646f expref: 28 pid: 12618 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.644927:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6677 00000100:00100000:0.0:1746143751.644934:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963593828992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.644943:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.644960:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801351b2800/0xe984082ccd72dbd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a646f expref: 27 pid: 12618 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.644969:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801351b2800/0xe984082ccd72dbd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a646f expref: 27 pid: 12618 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.644986:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801351b2800/0xe984082ccd72dbd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a646f expref: 27 pid: 12618 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.644998:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.645000:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.645005:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7e600/0xe984082ccd72dc03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->618495) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6499 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.645023:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7e600/0xe984082ccd72dc03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->618495) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6499 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.645049:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd7e600/0xe984082ccd72dc03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->618495) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6499 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.645058:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594227712:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143751.645100:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.649901:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594227712:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143751.649915:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.649937:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593828992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5003us (5147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.649944:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6677 00000100:00100000:0.0:1746143751.657229:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.657294:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.658804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.659778:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.659853:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.660068:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593829888 00000100:00100000:0.0:1746143751.660071:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593829888 00000100:00100000:0.0:1746143751.660102:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3824 00000100:00100000:0.0:1746143751.660108:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:30881:x1830963593829888:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143751.660369:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:30881:x1830963593829888:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 260us (515us total) trans 8589943285 rc 0/0 00000100:00100000:0.0:1746143751.660375:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3824 00000100:00100000:1.0:1746143751.665176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.665215:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.665370:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593830400 00000100:00100000:0.0:1746143751.665374:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593830400 00002000:00100000:0.0:1746143751.665389:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800955b4a80 x1830963593830400/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143751.665396:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800955b4a80 with x1830963593830400 ext(1048576->2097151) 00002000:00010000:0.0:1746143751.665399:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800955b4a80 00000100:00100000:0.0:1746143751.665409:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5816 00000100:00100000:0.0:1746143751.665413:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963593830400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143751.689831:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.691288:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.691463:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593830656 00000100:00100000:1.0:1746143751.691467:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593830656 00000100:00100000:1.0:1746143751.691486:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12616 00000100:00100000:1.0:1746143751.691491:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:30886:x1830963593830656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143751.691497:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.691503:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72dc1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a64b5 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.691513:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143751.691516:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72dc1f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64b5 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.691523:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72dc1f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64b5 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.691531:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b02c200, rc 0) 00000100:00100000:1.0:1746143751.691552:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:30886:x1830963593830656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 60us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.691556:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12616 00000100:00100000:0.0:1746143751.693399:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.701480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.701517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.702178:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5818 00000100:00100000:1.0:1746143751.702185:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963593831296:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143751.719586:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.722755:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963593831296:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20565us (21231us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143751.722819:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5818 00002000:00100000:1.0:1746143751.722829:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009b161500 x1830963593831296/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:147/0 lens 488/440 e 0 to 0 dl 1746143762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.722838:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b161500 with x1830963593831296 ext(1048576->2097151) 00002000:00010000:1.0:1746143751.722843:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b161500 00000100:00100000:0.0:1746143751.730665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.730741:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.730782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.731013:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12618 00000100:00100000:1.0:1746143751.731022:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963593831680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143751.731039:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.731052:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae41200/0xe984082ccd72dc34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a64ca expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.731092:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594228864:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143751.731180:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.731196:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593831808 00000100:00100000:1.0:1746143751.731199:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593831808 00002000:00100000:1.0:1746143751.731222:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x351:0x0] (102400->618495) req@ffff88009b161880 x1830963593831808/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.731230:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b161880 with x1830963593831808 ext(102400->618495) 00010000:00010000:1.0:1746143751.732214:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7e600/0xe984082ccd72dc03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->618495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6499 expref: 29 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.732226:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd7e600/0xe984082ccd72dc03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->618495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6499 expref: 29 pid: 6929 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143751.732234:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b161880 00000100:00100000:1.0:1746143751.732256:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1666 00000100:00100000:1.0:1746143751.732262:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963593831808:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143751.734165:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.734207:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143751.734818:0:8497:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a081da00/0xe984082ccd72db46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a643e expref: 8 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.734835:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594228864:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143751.734851:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae41200/0xe984082ccd72dc34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ca expref: 41 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.734859:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae41200/0xe984082ccd72dc34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ca expref: 41 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.734883:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae41200, rc 0) 00000100:00100000:1.0:1746143751.734914:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963593831680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3893us (4256us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143751.734920:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12618 00000100:00100000:0.0:1746143751.735929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.736459:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593832192 00000100:00100000:1.0:1746143751.736464:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593832192 00000100:00100000:1.0:1746143751.736502:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12622 00000100:00100000:1.0:1746143751.736508:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593832192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143751.736519:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.736528:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fe00/0xe984082ccd72dc49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a64df expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.736564:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594229248:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143751.736625:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.739929:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143751.740062:0:8497:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a081da00/0xe984082ccd72db46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a643e expref: 8 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.740077:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594229248:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143751.740094:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fe00/0xe984082ccd72dc49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64df expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.740101:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fe00/0xe984082ccd72dc49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64df expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.740108:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7fe00, rc 0) 00000100:00100000:1.0:1746143751.740122:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593832192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3616us (4197us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143751.740127:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12622 00000100:00100000:1.0:1746143751.742413:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b161880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963593831808:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 10146us (11625us total) trans 21474840283 rc 0/0 00000100:00100000:1.0:1746143751.742423:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1666 00002000:00100000:1.0:1746143751.742432:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x351:0x0] (102400->618495) req@ffff88009b161880 x1830963593831808/t21474840283(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/448 e 0 to 0 dl 1746143762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.742441:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b161880 with x1830963593831808 ext(102400->618495) 00010000:00010000:1.0:1746143751.742450:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7e600/0xe984082ccd72dc03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->618495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6499 expref: 31 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.742460:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd7e600/0xe984082ccd72dc03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->618495) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6499 expref: 31 pid: 6929 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143751.742466:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b161880 00000100:00100000:0.0:1746143751.744653:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594229376:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143751.744678:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.745018:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba58e00, rc 0) 00000100:00100000:0.0:1746143751.745041:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:30887:x1830963593832320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4877us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.745048:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12623 00000100:00100000:0.0:1746143751.748576:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.749408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.749499:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593832960 00000100:00100000:1.0:1746143751.749503:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593832960 00002000:00100000:1.0:1746143751.749528:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093f02d80 x1830963593832960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.749536:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02d80 with x1830963593832960 ext(2097152->3145727) 00002000:00010000:1.0:1746143751.749540:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02d80 00000100:00100000:1.0:1746143751.749566:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5819 00000100:00100000:1.0:1746143751.749572:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963593832960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143751.752075:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.752826:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.752896:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593833472 00000100:00100000:1.0:1746143751.752900:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593833472 00002000:00100000:1.0:1746143751.752915:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009ff6c700 x1830963593833472/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.752922:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963593833472 ext(2097152->3145727) 00002000:00010000:1.0:1746143751.752925:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6c700 00000100:00100000:1.0:1746143751.752937:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5821 00000100:00100000:1.0:1746143751.752941:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963593833472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143751.771300:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593832960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21719us (21883us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143751.771309:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5819 00002000:00100000:1.0:1746143751.771328:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093f02d80 x1830963593832960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/440 e 0 to 0 dl 1746143762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.771337:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02d80 with x1830963593832960 ext(2097152->3145727) 00002000:00010000:1.0:1746143751.771342:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02d80 00000100:00100000:0.0:1746143751.772546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.777483:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.779277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.779320:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.779334:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593833984 00000100:00100000:0.0:1746143751.779338:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593833984 00010000:00010000:0.0:1746143751.779353:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0c00/0xe984082ccd72dbe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a647d expref: 23 pid: 25369 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.779381:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6683 00000100:00100000:0.0:1746143751.779387:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963593833984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.779394:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.779406:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0c00/0xe984082ccd72dbe7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a647d expref: 23 pid: 25369 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.779414:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0c00/0xe984082ccd72dbe7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a647d expref: 23 pid: 25369 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.779427:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0c00/0xe984082ccd72dbe7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a647d expref: 23 pid: 25369 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.779445:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.779446:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.779453:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa600/0xe984082ccd72dc5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64f4 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.779461:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa600/0xe984082ccd72dc5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64f4 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.779485:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa600/0xe984082ccd72dc5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64f4 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.779495:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594230016:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143751.779543:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.781360:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594230016:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143751.781373:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.781410:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963593833984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2023us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.781417:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6683 00000100:00100000:0.0:1746143751.785631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.785901:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593834112 00000100:00100000:1.0:1746143751.785907:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593834112 00010000:00010000:1.0:1746143751.785926:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081da00/0xe984082ccd72db46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a643e expref: 9 pid: 15784 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.787298:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6684 00000100:00100000:1.0:1746143751.787309:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963593834112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.787328:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.787347:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a081da00/0xe984082ccd72db46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a643e expref: 9 pid: 15784 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.787364:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a081da00/0xe984082ccd72db46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a643e expref: 9 pid: 15784 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.787380:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a081da00/0xe984082ccd72db46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a643e expref: 9 pid: 15784 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.787397:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.787399:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.787405:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fae00/0xe984082ccd72dc65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64fb expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.787412:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fae00/0xe984082ccd72dc65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64fb expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.787418:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.787420:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.787422:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa800/0xe984082ccd72dc6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6502 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.787428:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa800/0xe984082ccd72dc6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6502 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.787457:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa800/0xe984082ccd72dc6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6502 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.787466:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594230272:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143751.787544:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a21fae00/0xe984082ccd72dc65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64fb expref: 39 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.787552:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594230400:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143751.787570:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da590c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.792787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.792826:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.792945:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594230272:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143751.792964:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593834880 00000100:00100000:1.0:1746143751.792968:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593834880 00000100:00100000:1.0:1746143751.793013:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12628 00000100:00100000:1.0:1746143751.793019:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:30890:x1830963593834880:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143751.793033:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.793047:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6510 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.793068:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.793075:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938bb600/0xe984082ccd72dc57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ed expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.793081:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.793082:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.793084:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2842624->2957311] (req 2842624->2957311) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.793107:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938bb600/0xe984082ccd72dc57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ed expref: 23 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.793116:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938bb600/0xe984082ccd72dc57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ed expref: 23 pid: 8496 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.793124:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594230528:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143751.793202:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.793209:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.793216:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594230656:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143751.793228:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.794201:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594230400:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143751.794217:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.794235:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963593834112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6930us (8382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.794242:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6684 00000100:00100000:1.0:1746143751.794821:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594230528:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143751.794828:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594230656:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143751.794845:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2842624->2957311] (req 2842624->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.794856:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7f600, rc 0) 00000100:00100000:1.0:1746143751.794874:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:30890:x1830963593834880:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1855us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.794879:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12628 00000100:00100000:0.0:1746143751.797121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.797270:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593835136 00000100:00100000:1.0:1746143751.797277:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593835136 00010000:00010000:1.0:1746143751.797305:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938bb600/0xe984082ccd72dc57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ed expref: 24 pid: 8496 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.797338:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6685 00000100:00100000:1.0:1746143751.797344:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963593835136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.797355:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.797372:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938bb600/0xe984082ccd72dc57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ed expref: 24 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.797382:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938bb600/0xe984082ccd72dc57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ed expref: 24 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.797398:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938bb600/0xe984082ccd72dc57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ed expref: 24 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.797422:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.797460:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963593835136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.797466:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6685 00000100:00100000:1.0:1746143751.798173:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593835264 00000100:00100000:1.0:1746143751.798176:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593835264 00010000:00010000:1.0:1746143751.798193:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.798217:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6686 00000100:00100000:1.0:1746143751.798222:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963593835264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.798228:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.798236:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.798243:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.798253:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba58e00/0xe984082ccd72dc50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64e6 expref: 30 pid: 9527 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.798507:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.798509:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.798515:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.798523:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.798548:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.798677:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594230784:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143751.798722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.798840:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.798856:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593835648 00000100:00100000:1.0:1746143751.798859:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593835648 00002000:00100000:1.0:1746143751.799065:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a0a94700 x1830963593835648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.799074:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94700 with x1830963593835648 ext(2097152->3145727) 00002000:00010000:1.0:1746143751.799078:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a94700 00000100:00100000:1.0:1746143751.799102:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5823 00000100:00100000:1.0:1746143751.799108:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963593835648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143751.800633:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594230784:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143751.800646:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.801067:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963593835264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2843us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.801075:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6686 00000100:00100000:1.0:1746143751.815746:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963593835648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16632us (17017us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143751.815757:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5823 00002000:00100000:1.0:1746143751.815767:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a0a94700 x1830963593835648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:147/0 lens 488/440 e 0 to 0 dl 1746143762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.815776:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94700 with x1830963593835648 ext(2097152->3145727) 00002000:00010000:1.0:1746143751.815781:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a94700 00000100:00100000:0.0:1746143751.821799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.823994:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.829240:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593837312 00000100:00100000:0.0:1746143751.829248:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593837312 00000100:00100000:0.0:1746143751.829282:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12629 00000100:00100000:0.0:1746143751.829288:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:30886:x1830963593837312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143751.829303:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.829327:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6517 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.829352:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.829359:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143751.829360:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143751.829364:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.829388:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.829400:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 28 pid: 8497 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.829410:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594230912:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143751.829473:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.829598:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593837056 00000100:00100000:1.0:1746143751.829602:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593837056 00002000:00100000:1.0:1746143751.829625:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a07c5180 x1830963593837056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.829633:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c5180 with x1830963593837056 ext(3145728->4194303) 00010000:00010000:1.0:1746143751.829639:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 29 pid: 8497 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.829648:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 29 pid: 8497 timeout: 930 lvb_type: 0 00002000:00010000:1.0:1746143751.829654:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a07c5180 00000100:00100000:1.0:1746143751.829665:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593837184 00000100:00100000:1.0:1746143751.829667:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593837184 00002000:00100000:1.0:1746143751.829678:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a07c7480 x1830963593837184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.829684:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c7480 with x1830963593837184 ext(3145728->4194303) 00002000:00010000:1.0:1746143751.829688:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07c7480 00000100:00100000:1.0:1746143751.829698:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1667 00000100:00100000:1.0:1746143751.829703:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593837056:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143751.831377:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5827 00000100:00100000:0.0:1746143751.831386:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963593837184:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143751.837410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.847153:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963593837184:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15749us (18003us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143751.847164:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5827 00002000:00100000:1.0:1746143751.847175:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a07c7480 x1830963593837184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:147/0 lens 488/440 e 0 to 0 dl 1746143762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.847183:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c7480 with x1830963593837184 ext(3145728->4194303) 00002000:00010000:1.0:1746143751.847189:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a07c7480 00000100:00100000:0.0:1746143751.850490:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.850520:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593837568 00000100:00100000:1.0:1746143751.850528:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593837568 00010000:00010000:1.0:1746143751.850556:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 31 pid: 8497 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.850591:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6687 00000100:00100000:1.0:1746143751.850598:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963593837568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.850616:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143751.850632:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143750 -> 1746143751 00010000:00010000:1.0:1746143751.850638:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 31 pid: 8497 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.850648:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 31 pid: 8497 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.850667:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f600/0xe984082ccd72dc96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->2957311) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6510 expref: 31 pid: 8497 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.850694:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.850696:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.850702:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.850709:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.850737:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.850747:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594231040:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143751.850821:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.851779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.851837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.851920:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.859939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.860026:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593838208 00000100:00100000:1.0:1746143751.860032:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593838208 00002000:00100000:1.0:1746143751.860065:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009e5cc700 x1830963593838208/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:147/0 lens 488/0 e 0 to 0 dl 1746143762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.860073:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc700 with x1830963593838208 ext(3145728->4194303) 00002000:00010000:1.0:1746143751.860077:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cc700 00000100:00100000:1.0:1746143751.860098:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5828 00000100:00100000:1.0:1746143751.860103:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593838208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143751.861202:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.865367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.879868:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593838208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19758us (19923us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143751.879877:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5828 00002000:00100000:1.0:1746143751.879885:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009e5cc700 x1830963593838208/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:147/0 lens 488/440 e 0 to 0 dl 1746143762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143751.879894:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc700 with x1830963593838208 ext(3145728->4194303) 00002000:00010000:1.0:1746143751.879898:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cc700 00000100:00100000:0.0:1746143751.885903:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.886114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.886478:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12634 00000100:00100000:1.0:1746143751.886485:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963593838976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143751.886492:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.886501:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094de9000/0xe984082ccd72dcc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a653a expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.886523:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594231552:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143751.886546:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.886797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.889562:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594231552:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143751.889590:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094de9000/0xe984082ccd72dcc0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a653a expref: 41 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.889610:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094de9000/0xe984082ccd72dcc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a653a expref: 41 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.889623:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094de9000, rc 0) 00000100:00100000:1.0:1746143751.890044:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963593838976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3556us (3926us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143751.890051:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12634 00000100:00100000:0.0:1746143751.895302:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.895346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.895807:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12636 00000100:00100000:1.0:1746143751.895813:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963593839360:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143751.895820:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.895830:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de9200/0xe984082ccd72dcce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6541 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.895870:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594231680:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143751.895956:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.897433:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594231680:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143751.897454:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094de9200/0xe984082ccd72dcce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6541 expref: 32 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.897463:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de9200/0xe984082ccd72dcce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6541 expref: 32 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.897473:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094de9200, rc 0) 00000100:00100000:1.0:1746143751.897499:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963593839360:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1686us (2152us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143751.897505:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12636 00000100:00100000:0.0:1746143751.898530:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.900290:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.907858:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.910973:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.911005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.911030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.911042:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.911044:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593840256 00000100:00100000:1.0:1746143751.911050:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593840256 00000100:00100000:0.0:1746143751.911053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.911073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.911078:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593840512 00000100:00100000:1.0:1746143751.911080:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593840512 00000100:00100000:0.0:1746143751.911085:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593840768 00000100:00100000:0.0:1746143751.911088:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593840768 00000100:00100000:1.0:1746143751.911090:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593840384 00000100:00100000:1.0:1746143751.911091:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593840384 00000100:00100000:1.0:1746143751.911098:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593840640 00000100:00100000:1.0:1746143751.911100:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593840640 00000100:00100000:0.0:1746143751.911670:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593840896 00000100:00100000:0.0:1746143751.911674:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593840896 00000100:00100000:1.0:1746143751.911676:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12637 00000100:00100000:1.0:1746143751.911682:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963593840256:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:0.0:1746143751.911686:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12638 00000100:00100000:0.0:1746143751.911690:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963593840512:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143751.911696:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.911696:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143751.911707:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72dcf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6556 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.911707:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351b3c00/0xe984082ccd72dcf8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6564 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.911723:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.911725:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.911732:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801351b3c00/0xe984082ccd72dcf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6564 expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.911743:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801351b3c00/0xe984082ccd72dcf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6564 expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.911751:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801351b3c00, rc 0) 00000100:00100000:0.0:1746143751.911782:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963593840512:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 91us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.911787:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12638 00000100:00100000:0.0:1746143751.911798:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12639 00000100:00100000:0.0:1746143751.911802:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a71bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963593840384:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143751.911807:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143751.911813:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801351b2800/0xe984082ccd72dcff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a655d expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.911834:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a71bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594232064:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143751.911872:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.913442:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594231936:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143751.913506:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.915678:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594231936:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143751.915696:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72dcf1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6556 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.915705:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72dcf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6556 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.915716:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094de9e00, rc 0) 00000100:00100000:1.0:1746143751.915754:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963593840256:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4071us (4785us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143751.915764:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12637 00000100:00100000:0.0:1746143751.917354:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.919528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.919572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.920375:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6689 00000100:00100000:1.0:1746143751.920383:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593841280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.920391:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.920396:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f034800/0xe984082ccd72dcea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a654f expref: 9 pid: 20509 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.920608:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f034800/0xe984082ccd72dcea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a654f expref: 9 pid: 20509 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.920621:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f034800/0xe984082ccd72dcea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a654f expref: 9 pid: 20509 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.920630:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143751.920633:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fb600/0xe984082ccd72dd22 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143751.920639:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fb600/0xe984082ccd72dd22 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143751.920644:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fb600/0xe984082ccd72dd22 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143751.920670:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.920689:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593841280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 307us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.920694:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6689 00000100:00100000:0.0:1746143751.923850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.927988:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.930918:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593841920 00000100:00100000:1.0:1746143751.930926:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593841920 00000100:00100000:1.0:1746143751.930965:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593842176 00000100:00100000:1.0:1746143751.930967:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593842176 00000100:00100000:1.0:1746143751.931003:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593842432 00000100:00100000:1.0:1746143751.931005:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593842432 00000100:00100000:0.0:1746143751.931508:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12644 00000100:00100000:1.0:1746143751.931515:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12645 00000100:00100000:0.0:1746143751.931516:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593842176:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143751.931523:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593842432:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143751.931535:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ba59200/0xe984082ccd72dd53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.931539:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.931547:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093326e00/0xe984082ccd72dc0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a0 expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.931550:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.931555:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801351b3c00/0xe984082ccd72dcf8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6564 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.931557:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fba00/0xe984082ccd72dd06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6572 expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.931562:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb4800/0xe984082ccd72dc11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a7 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.931563:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21faa00/0xe984082ccd72dcab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a652c expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.931568:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.931568:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.931569:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143751.931569:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.931571:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.931571:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba59200/0xe984082ccd72dd53 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.931585:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21faa00/0xe984082ccd72dcab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a652c expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143751.931586:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdb4800/0xe984082ccd72dc11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a7 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.931593:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21faa00/0xe984082ccd72dcab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a652c expref: 30 pid: 6929 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.931595:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cdb4800/0xe984082ccd72dc11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a7 expref: 22 pid: 9527 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.931603:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594232704:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143751.931605:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594232576:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143751.931651:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a21fba00/0xe984082ccd72dd06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6572 expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143751.931659:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fba00/0xe984082ccd72dd06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6572 expref: 11 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.931659:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801351b3c00/0xe984082ccd72dcf8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6564 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143751.931667:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594232832:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143751.931671:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801351b3c00/0xe984082ccd72dcf8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6564 expref: 10 pid: 21542 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746143751.931683:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594232960:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143751.931689:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.931696:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 23 pid: 8497 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.931703:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594233088:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143751.931708:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093326e00/0xe984082ccd72dc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a0 expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.931716:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093326e00/0xe984082ccd72dc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a0 expref: 39 pid: 6929 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.931718:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.931723:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594233216:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143751.931739:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143751.934473:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12646 00000100:00100000:1.0:1746143751.934481:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593842048:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143751.934511:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.934524:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa600/0xe984082ccd72dc5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64f4 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.934532:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143751.934534:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143751.934536:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.934557:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa600/0xe984082ccd72dc5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64f4 expref: 22 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.934567:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa600/0xe984082ccd72dc5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64f4 expref: 22 pid: 8496 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.934577:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594233344:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143751.934637:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143751.934855:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.938214:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594232576:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143751.946855:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.946898:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594232832:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143751.946921:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593842944 00000100:00100000:1.0:1746143751.946927:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593842944 00000100:00100000:0.0:1746143751.947179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.947209:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.947225:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.947245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.947258:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593843072 00000100:00100000:0.0:1746143751.947261:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593843072 00010000:00010000:0.0:1746143751.947275:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801351b3c00/0xe984082ccd72dcf8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6564 expref: 13 pid: 21542 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746143751.947291:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6690 00000100:00100000:0.0:1746143751.947296:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963593842816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.947308:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.947337:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21faa00/0xe984082ccd72dcab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a652c expref: 31 pid: 6929 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.947347:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21faa00/0xe984082ccd72dcab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a652c expref: 31 pid: 6929 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.947364:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21faa00/0xe984082ccd72dcab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a652c expref: 31 pid: 6929 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.947377:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.947398:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963593842816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 102us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.947403:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6690 00000100:00100000:0.0:1746143751.947416:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6692 00000100:00100000:0.0:1746143751.947421:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963593843200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.947427:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.947435:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cdb4800/0xe984082ccd72dc11 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a7 expref: 23 pid: 9527 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.947442:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cdb4800/0xe984082ccd72dc11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a7 expref: 23 pid: 9527 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.947452:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143751.947601:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fba00/0xe984082ccd72dd06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6572 expref: 13 pid: 4582 timeout: 930 lvb_type: 1 00000100:00100000:1.0:1746143751.947618:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6693 00000100:00100000:1.0:1746143751.947623:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963593842944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.947630:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.947639:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fba00/0xe984082ccd72dd06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6572 expref: 13 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143751.947646:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21fba00/0xe984082ccd72dd06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6572 expref: 13 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143751.947656:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fba00/0xe984082ccd72dd06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6572 expref: 13 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143751.947667:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.948850:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963593843200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1427us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.948852:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963593842944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1227us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.948857:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6692 00000100:00100000:1.0:1746143751.948861:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6693 00000100:00100000:1.0:1746143751.948924:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594233088:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143751.948942:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.948963:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594233344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143751.948971:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.948981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.948997:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593843328 00000100:00100000:1.0:1746143751.949000:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593843328 00000100:00100000:0.0:1746143751.949005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143751.949012:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093326e00/0xe984082ccd72dc0a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a0 expref: 40 pid: 6929 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.949018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.949033:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593843712 00000100:00100000:1.0:1746143751.949035:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593843712 00010000:00010000:1.0:1746143751.949048:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61cba00/0xe984082ccd72dc9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6517 expref: 26 pid: 8497 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.949061:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6694 00000100:00100000:1.0:1746143751.949065:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963593843328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.949071:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.949080:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093326e00/0xe984082ccd72dc0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a0 expref: 40 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.949087:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093326e00/0xe984082ccd72dc0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a0 expref: 40 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.949238:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093326e00/0xe984082ccd72dc0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64a0 expref: 40 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.949250:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.949251:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.949255:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba59200/0xe984082ccd72dd53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.949262:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba59200/0xe984082ccd72dd53 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.949277:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.949294:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963593843328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 228us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.949300:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6694 00010000:00010000:1.0:1746143751.949406:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.949413:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.949709:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.949717:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593843840 00000100:00100000:0.0:1746143751.949720:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593843840 00010000:00010000:0.0:1746143751.949733:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa800/0xe984082ccd72dc6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6502 expref: 23 pid: 8496 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.949745:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6696 00000100:00100000:0.0:1746143751.949749:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963593843840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.949755:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.949763:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa800/0xe984082ccd72dc6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6502 expref: 23 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.949770:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa800/0xe984082ccd72dc6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6502 expref: 23 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.949781:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.949798:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963593843840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.949803:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6696 00000100:00100000:0.0:1746143751.949866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.949876:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593843968 00000100:00100000:0.0:1746143751.949878:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593843968 00010000:00010000:0.0:1746143751.949889:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa200/0xe984082ccd72dd14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6579 expref: 12 pid: 4582 timeout: 930 lvb_type: 1 00000100:00100000:0.0:1746143751.949903:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6697 00000100:00100000:0.0:1746143751.949907:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963593843968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.949913:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.949920:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa200/0xe984082ccd72dd14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6579 expref: 12 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.949927:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa200/0xe984082ccd72dd14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6579 expref: 12 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.949937:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.949951:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963593843968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.949956:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6697 00000100:00100000:0.0:1746143751.950023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.950033:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593843584 00000100:00100000:0.0:1746143751.950036:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593843584 00010000:00010000:0.0:1746143751.950046:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72dc1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64b5 expref: 25 pid: 8496 timeout: 930 lvb_type: 0 00000100:00100000:0.0:1746143751.950059:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6698 00000100:00100000:0.0:1746143751.950063:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963593843584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143751.950068:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143751.950077:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72dc1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64b5 expref: 25 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.950084:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72dc1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64b5 expref: 25 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.950093:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72dc1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64b5 expref: 25 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:0.0:1746143751.950102:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.950117:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593843584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.950122:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6698 00000100:00100000:0.0:1746143751.950179:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.950189:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593844096 00000100:00100000:0.0:1746143751.950191:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593844096 00010000:00010000:0.0:1746143751.950202:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fbe00/0xe984082ccd72dd0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a656b expref: 12 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143751.950212:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950218:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.950222:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6699 00010000:00010000:1.0:1746143751.950224:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143751.950226:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963593844096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.950228:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094de8800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143751.950231:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.950232:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.950237:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.950239:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fbe00/0xe984082ccd72dd0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a656b expref: 12 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143751.950245:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.950247:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21fbe00/0xe984082ccd72dd0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a656b expref: 12 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:1.0:1746143751.950250:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de8800/0xe984082ccd72dd5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143751.950257:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fbe00/0xe984082ccd72dd0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a656b expref: 12 pid: 4582 timeout: 930 lvb_type: 1 00010000:00010000:0.0:1746143751.950265:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143751.950279:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593844096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.950285:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593842432:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 18763us (19305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.950291:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12645 00000100:00100000:1.0:1746143751.950332:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.950361:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143751.950372:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593844224 00000100:00100000:1.0:1746143751.950374:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593844224 00010000:00010000:1.0:1746143751.950385:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093327600/0xe984082ccd72dc18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ae expref: 30 pid: 6929 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.950397:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593844352 00000100:00100000:1.0:1746143751.950399:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593844352 00010000:00010000:1.0:1746143751.950406:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fae00/0xe984082ccd72dc65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64fb expref: 39 pid: 8496 timeout: 930 lvb_type: 0 00000100:00100000:1.0:1746143751.950417:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6700 00000100:00100000:1.0:1746143751.950422:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963593844224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.950428:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.950435:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093327600/0xe984082ccd72dc18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ae expref: 30 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.950442:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093327600/0xe984082ccd72dc18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ae expref: 30 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.950452:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093327600/0xe984082ccd72dc18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64ae expref: 30 pid: 6929 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.950460:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.950462:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.950465:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950470:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd68 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950480:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.950495:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593844224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.950500:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6700 00000100:00100000:1.0:1746143751.950509:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6701 00000100:00100000:1.0:1746143751.950513:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963593844352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143751.950519:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143751.950526:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a21fae00/0xe984082ccd72dc65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64fb expref: 39 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.950533:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a21fae00/0xe984082ccd72dc65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64fb expref: 39 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.950542:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fae00/0xe984082ccd72dc65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a64fb expref: 39 pid: 8496 timeout: 930 lvb_type: 0 00010000:00010000:1.0:1746143751.950549:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.950550:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143751.950552:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950562:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950574:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143751.950596:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963593844352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143751.950603:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6699 00000100:00100000:1.0:1746143751.950841:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6701 00010000:00010000:1.0:1746143751.950858:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950865:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950877:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950883:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950889:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950895:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f034e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143751.950897:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950907:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950917:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.950923:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f034e00/0xe984082ccd72dd6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.950967:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593842560:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 15965us (16110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.950972:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12648 00000100:00100000:0.0:1746143751.963515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.968931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143751.969622:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969636:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969658:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969665:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969671:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969682:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094de8000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143751.969685:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969693:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969702:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143751.969707:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094de8000/0xe984082ccd72dd61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143751.969883:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593842048:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 35403us (35876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143751.969890:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12646 00000100:00100000:1.0:1746143751.977074:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.983964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.983998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143751.984076:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000001:00080000:1.0:1746143752.016104:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943285 is committed 00000001:00080000:1.0:1746143752.016122:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943292 is committed 00000001:00080000:1.0:1746143752.016128:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943289 is committed 00000001:00080000:1.0:1746143752.016131:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943288 is committed 00000001:00080000:1.0:1746143752.016170:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943293 is committed 00000004:00080000:1.0:1746143752.016175:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1956 committed 00000004:00080000:1.0:1746143752.016188:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1931 committed 00000004:00080000:1.0:1746143752.016194:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1930 committed 00000004:00080000:1.0:1746143752.016195:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1929 committed 00000004:00080000:1.0:1746143752.016197:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1928 committed 00000004:00080000:1.0:1746143752.016198:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1955 committed 00000004:00080000:1.0:1746143752.016199:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1927 committed 00000004:00080000:1.0:1746143752.016201:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1954 committed 00000004:00080000:1.0:1746143752.016202:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1926 committed 00000004:00080000:1.0:1746143752.016203:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1953 committed 00000004:00080000:1.0:1746143752.016204:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1952 committed 00000004:00080000:1.0:1746143752.016206:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1951 committed 00000004:00080000:1.0:1746143752.016207:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1925 committed 00000004:00080000:1.0:1746143752.016209:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1924 committed 00000004:00080000:1.0:1746143752.016211:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1950 committed 00000004:00080000:1.0:1746143752.016212:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1949 committed 00000004:00080000:1.0:1746143752.016213:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1923 committed 00000001:00080000:1.0:1746143752.016219:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943290 is committed 00000100:00100000:0.0:1746143752.016421:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594234752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.016579:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143752.016700:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235136 00000100:00100000:1.0:1746143752.016703:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235136 00000100:00100000:1.0:1746143752.016721:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12650 00000100:00100000:1.0:1746143752.016726:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3292:x1830963594235008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.016864:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594235264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.016881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.016893:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594235776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.016905:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.016914:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594236288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.016928:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.016949:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594234880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.016965:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.016972:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594235520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.016984:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.016991:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800955b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594236032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.017003:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.017009:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594236544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.017125:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143752.017163:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235520 00000100:00100000:0.0:1746143752.017166:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235520 00000100:00100000:0.0:1746143752.017177:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236032 00000100:00100000:0.0:1746143752.017179:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236032 00000100:00100000:0.0:1746143752.017184:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236544 00000100:00100000:0.0:1746143752.017185:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236544 00000100:00100000:0.0:1746143752.017192:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12654 00000100:00100000:0.0:1746143752.017196:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3295:x1830963594235776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.017278:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3295:x1830963594235776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (371us total) trans 21474840287 rc 0/0 00000100:00100000:0.0:1746143752.017284:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12654 00000100:00100000:0.0:1746143752.017293:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12656 00000100:00100000:0.0:1746143752.017296:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963594234880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.017382:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3293:x1830963594234880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (416us total) trans 17179872977 rc 0/0 00000100:00100000:0.0:1746143752.017387:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12656 00000100:00100000:1.0:1746143752.017631:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594235008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 904us (1086us total) trans 21474840286 rc 0/0 00000100:00100000:1.0:1746143752.018074:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12650 00000100:00100000:1.0:1746143752.018084:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235648 00000100:00100000:1.0:1746143752.018087:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235648 00000100:00100000:1.0:1746143752.018099:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12658 00000100:00100000:1.0:1746143752.018102:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3293:x1830963594236032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143752.018399:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12661 00000100:00100000:0.0:1746143752.018405:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3294:x1830963594235648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143752.018882:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3294:x1830963594235648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 476us (1403us total) trans 17179872979 rc 0/0 00000100:00100000:0.0:1746143752.018888:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12661 00000100:00100000:0.0:1746143752.018957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143752.019323:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3293:x1830963594236032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1219us (2318us total) trans 21474840292 rc 0/0 00000100:00100000:1.0:1746143752.019328:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12658 00000100:00100000:1.0:1746143752.019341:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236672 00000100:00100000:1.0:1746143752.019344:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236672 00000100:00100000:1.0:1746143752.019358:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12662 00000100:00100000:1.0:1746143752.019362:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3294:x1830963594236672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143752.019440:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3294:x1830963594236672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (266us total) trans 21474840293 rc 0/0 00000100:00100000:1.0:1746143752.019444:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12662 00000100:00080000:0.0:1746143752.019947:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143752.023076:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.026535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.026669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.026702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.026719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143752.026723:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593845632 00000100:00100000:1.0:1746143752.026731:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593845632 00000100:00100000:0.0:1746143752.026731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143752.026783:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593845760 00000100:00100000:1.0:1746143752.026786:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593845760 00000100:00100000:0.0:1746143752.026786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143752.026906:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593846016 00000100:00100000:1.0:1746143752.026909:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593846016 00000100:00100000:0.0:1746143752.027177:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593845888 00000100:00100000:0.0:1746143752.027180:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593845888 00000100:00100000:0.0:1746143752.027197:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593846272 00000100:00100000:0.0:1746143752.027199:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593846272 00000100:00100000:0.0:1746143752.027208:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593846144 00000100:00100000:0.0:1746143752.027209:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593846144 00000100:00100000:0.0:1746143752.027224:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12666 00000100:00100000:0.0:1746143752.027231:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963593845632:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.027246:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.027264:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a65a3 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143752.027289:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a07, atime: 0x68140a07, ctime: 0x68140a07, blocks: 0x7a9 00010000:00010000:0.0:1746143752.027321:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.027323:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.027333:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65a3 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.027350:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65a3 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.027361:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fb800, rc 0) 00000100:00100000:0.0:1746143752.027400:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963593845632:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 169us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.027406:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12666 00000100:00100000:0.0:1746143752.027419:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12667 00000100:00100000:0.0:1746143752.027424:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963593845760:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.027432:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.027443:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa400/0xe984082ccd72dd99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a65aa expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143752.027458:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a07, atime: 0x68140a06, ctime: 0x68140a07, blocks: 0x81f 00010000:00010000:0.0:1746143752.027467:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.027468:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.027472:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa400/0xe984082ccd72dd99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65aa expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.027483:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa400/0xe984082ccd72dd99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65aa expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.027490:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a21fa400, rc 0) 00000100:00100000:0.0:1746143752.027504:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963593845760:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 80us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.027509:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12667 00000100:00100000:0.0:1746143752.027517:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12668 00000100:00100000:0.0:1746143752.027522:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963593846016:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143752.027527:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143752.027536:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd72dda0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a65b8 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143752.027660:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12669 00000100:00100000:1.0:1746143752.027666:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963593845888:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143752.027672:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143752.027681:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094de8800/0xe984082ccd72dda7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a65b1 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143752.027692:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a06, atime: 0x68140a06, ctime: 0x68140a07, blocks: 0x81f 00010000:00010000:1.0:1746143752.027701:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143752.027707:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143752.027712:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094de8800/0xe984082ccd72dda7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b1 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143752.027720:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094de8800/0xe984082ccd72dda7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b1 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143752.027726:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094de8800, rc 0) 00000100:00100000:1.0:1746143752.027742:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963593845888:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 78us (1023us total) trans 0 rc 0/0 00002000:00010000:0.0:1746143752.028207:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a06, atime: 0x68140a06, ctime: 0x68140a07, blocks: 0x821 00010000:00010000:0.0:1746143752.028219:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.028221:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143752.028226:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd72dda0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b8 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.028234:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd72dda0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b8 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143752.028240:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a91f800, rc 0) 00000100:00100000:0.0:1746143752.028257:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963593846016:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 735us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143752.028262:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12668 00000100:00100000:1.0:1746143752.028459:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12669 00000100:00080000:1.0:1746143752.028478:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143752.028482:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143752.640686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.640742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.640773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641787:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641802:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641816:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641927:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143752.641950:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593847296 00000100:00100000:0.0:1746143752.641954:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593847296 00000100:00100000:1.0:1746143752.643471:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593846784 00000100:00100000:1.0:1746143752.643483:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593846784 00000100:00100000:1.0:1746143752.643529:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593847040 00000100:00100000:1.0:1746143752.643531:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593847040 00000100:00100000:1.0:1746143752.643544:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593846656 00000100:00100000:1.0:1746143752.643545:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593846656 00000100:00100000:1.0:1746143752.643557:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593847552 00000100:00100000:1.0:1746143752.643559:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593847552 00000100:00100000:1.0:1746143752.643568:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593847168 00000100:00100000:1.0:1746143752.643570:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593847168 00000100:00100000:1.0:1746143752.643579:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593847424 00000100:00100000:1.0:1746143752.643581:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593847424 00000100:00100000:1.0:1746143752.643595:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 375 00000100:00100000:1.0:1746143752.643601:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963593846784:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143752.643663:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963593846784:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 62us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143752.643669:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 375 00000100:00100000:0.0:1746143752.643680:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593846912 00000100:00100000:1.0:1746143752.643683:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 376 00000100:00100000:0.0:1746143752.643686:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593846912 00000100:00100000:1.0:1746143752.643687:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963593847040:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143752.643703:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963593847040:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 16us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143752.643707:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 376 00000100:00100000:1.0:1746143752.643714:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 377 00000100:00100000:1.0:1746143752.643718:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593846656:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143752.643733:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593846656:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 14us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143752.643737:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 377 00000100:00100000:1.0:1746143752.643743:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 378 00000100:00100000:1.0:1746143752.643746:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593847552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143752.643760:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593847552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 14us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143752.643764:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 378 00000100:00100000:1.0:1746143752.643769:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 379 00000100:00100000:1.0:1746143752.643772:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963593847168:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143752.643784:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963593847168:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 11us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143752.643787:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 379 00000100:00100000:1.0:1746143752.643794:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 380 00000100:00100000:1.0:1746143752.643797:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593847424:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143752.643809:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593847424:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 12us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143752.643813:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 380 00000100:00100000:0.0:1746143753.038618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.041924:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.042212:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593848064 00000100:00100000:1.0:1746143753.042224:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593848064 00000100:00100000:1.0:1746143753.042298:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5833 00000100:00100000:1.0:1746143753.042315:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593848064:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143753.042355:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.042368:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.042370:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.042374:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.042389:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.044175:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593848320 00000100:00100000:0.0:1746143753.044183:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593848320 00000100:00100000:0.0:1746143753.044226:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5834 00000100:00100000:0.0:1746143753.044234:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963593848320:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143753.044260:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c4d1a00/0xe984082ccd72ddca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.044271:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.044273:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.044277:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d1a00/0xe984082ccd72ddca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.044287:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c4d1a00/0xe984082ccd72ddca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.044494:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.044517:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593848576 00000100:00100000:1.0:1746143753.044522:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593848576 00000100:00100000:1.0:1746143753.044556:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593848832 00000100:00100000:1.0:1746143753.044558:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593848832 00000100:00100000:1.0:1746143753.044575:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5835 00000100:00100000:1.0:1746143753.044582:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963593848576:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143753.044606:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.044617:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.044619:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.044623:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.044633:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.048585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.048618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.048640:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593849088 00000100:00100000:0.0:1746143753.048647:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593849088 00000100:00100000:0.0:1746143753.048692:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593849344 00000100:00100000:0.0:1746143753.048694:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593849344 00000100:00100000:0.0:1746143753.048724:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5837 00000100:00100000:0.0:1746143753.048732:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963593849088:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143753.048763:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.048776:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.048778:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.048782:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.048793:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.048835:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5838 00000100:00100000:1.0:1746143753.048846:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1964:x1830963593849344:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143753.048877:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.048888:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.048890:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.048894:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.048906:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.059345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143753.082659:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.082674:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.082681:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.082686:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f06c800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143753.082689:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.082694:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.082711:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.082717:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f06c800/0xe984082ccd72ddc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.082919:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:1965:x1830963593848064:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 40601us (40998us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.082928:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5833 00010000:00010000:0.0:1746143753.089040:0:26145:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.089049:0:26145:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.089055:0:26145:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.089060:0:26145:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4d0800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143753.089063:0:26145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.089069:0:26145:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.089079:0:26145:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.089084:0:26145:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4d0800/0xe984082ccd72dddf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.089125:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963593849088:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 40394us (40549us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143753.089131:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5837 00010000:00010000:1.0:1746143753.097129:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.097164:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.097172:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.097177:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094de9600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143753.097180:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.097187:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.097202:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.097213:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de9600/0xe984082ccd72ddd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.097293:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963593848576:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 52707us (53029us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.097310:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5835 00010000:00010000:1.0:1746143753.106596:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.106609:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.106616:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.106622:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094de8000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143753.106625:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.106630:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.106644:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.106650:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de8000/0xe984082ccd72dde6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.106731:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963593849344:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 57885us (58108us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.106739:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5838 00010000:00010000:1.0:1746143753.118613:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72dded lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.118627:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72dded lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.118634:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72dded lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.118640:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a014da00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143753.118643:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72dded lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.118650:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72dded lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.118664:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72dded lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.118669:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72dded lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.118737:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593849600:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 59046us (59395us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.118747:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5839 00000100:00100000:0.0:1746143753.134632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.134658:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593849728 00000100:00100000:0.0:1746143753.134665:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593849728 00000100:00100000:0.0:1746143753.134705:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 713 00000100:00100000:0.0:1746143753.134711:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:30895:x1830963593849728:12345-192.168.202.48@tcp:103:mirror_io.0 00010000:00010000:0.0:1746143753.134722:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.134742:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a21fb200/0xe984082ccd72dd37 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6587 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.134757:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.134761:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.134796:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30895:x1830963593849728:12345-192.168.202.48@tcp:103:mirror_io.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.134801:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 713 00000100:00100000:0.0:1746143753.148954:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.158257:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.197372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.198804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.201130:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9018 00000100:00100000:0.0:1746143753.201157:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:30905:x1830963593850752:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143753.201166:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.201181:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ddf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a65d4 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.201277:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201290:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201310:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201322:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201327:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201332:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201428:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26200/0xe984082ccd72de09 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201436:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26200/0xe984082ccd72de09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201441:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26200/0xe984082ccd72de09 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143753.201450:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143753.201527:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201533:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201538:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201543:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba26000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143753.201547:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201552:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201562:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143753.201565:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.201568:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201573:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72ddfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201589:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201593:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201598:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201602:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba26400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143753.201604:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201609:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201615:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094924200) 00010000:00010000:0.0:1746143753.201616:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.201618:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201623:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26400/0xe984082ccd72de02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.201653:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ddf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65d4 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.201665:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26200/0xe984082ccd72de09 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65d4 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.201670:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.201673:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143753.201675:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26200, rc 0) 00000100:00100000:0.0:1746143753.201725:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:30905:x1830963593850752:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 588us (2922us total) trans 8589943296 rc 0/0 00000100:00100000:0.0:1746143753.201731:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9018 00000100:00100000:0.0:1746143753.211512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.211545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.227591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.228448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.229542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.229634:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230306:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230321:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230344:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230355:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230367:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230406:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.230422:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593851520 00000100:00100000:1.0:1746143753.230425:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593851520 00000100:00100000:1.0:1746143753.230440:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593851776 00000100:00100000:1.0:1746143753.230441:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593851776 00000100:00100000:1.0:1746143753.230450:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593852032 00000100:00100000:1.0:1746143753.230451:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593852032 00000100:00100000:1.0:1746143753.230458:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12675 00000100:00100000:1.0:1746143753.230463:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963593851520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230469:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230475:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0694800/0xe984082ccd72de79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a65f0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230487:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230488:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230492:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0694800/0xe984082ccd72de79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65f0 expref: 41 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230500:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0694800/0xe984082ccd72de79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65f0 expref: 41 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230506:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694800, rc 0) 00000100:00100000:1.0:1746143753.230523:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963593851520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 60us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230527:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12675 00000100:00100000:1.0:1746143753.230535:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593852160 00000100:00100000:1.0:1746143753.230537:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593852160 00000100:00100000:1.0:1746143753.230543:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593852288 00000100:00100000:1.0:1746143753.230544:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593852288 00000100:00100000:1.0:1746143753.230549:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593852416 00000100:00100000:1.0:1746143753.230551:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593852416 00000100:00100000:1.0:1746143753.230556:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593852544 00000100:00100000:1.0:1746143753.230557:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593852544 00000100:00100000:1.0:1746143753.230562:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593852672 00000100:00100000:1.0:1746143753.230564:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593852672 00000100:00100000:1.0:1746143753.230569:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593852800 00000100:00100000:1.0:1746143753.230570:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593852800 00000100:00100000:1.0:1746143753.230577:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12676 00000100:00100000:1.0:1746143753.230580:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963593851776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230585:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230591:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0695400/0xe984082ccd72de80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a65fe expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230600:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230601:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230604:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0695400/0xe984082ccd72de80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65fe expref: 32 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230611:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0695400/0xe984082ccd72de80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65fe expref: 32 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230617:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0695400, rc 0) 00000100:00100000:1.0:1746143753.230628:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963593851776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230632:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12676 00000100:00100000:1.0:1746143753.230639:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12677 00000100:00100000:1.0:1746143753.230642:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963593852032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230646:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230650:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0694400/0xe984082ccd72de87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a660c expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230657:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230658:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230661:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0694400/0xe984082ccd72de87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a660c expref: 41 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230668:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0694400/0xe984082ccd72de87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a660c expref: 41 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230677:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694400, rc 0) 00000100:00100000:1.0:1746143753.230687:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963593852032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 44us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230691:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12677 00000100:00100000:1.0:1746143753.230697:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12678 00000100:00100000:1.0:1746143753.230700:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593852160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230704:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230708:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0694600/0xe984082ccd72de8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6613 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230715:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230716:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230719:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0694600/0xe984082ccd72de8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6613 expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230725:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0694600/0xe984082ccd72de8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6613 expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230729:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694600, rc 0) 00000100:00100000:1.0:1746143753.230738:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963593852160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 38us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230742:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12678 00000100:00100000:1.0:1746143753.230748:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12679 00000100:00100000:1.0:1746143753.230751:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963593852288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230757:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230760:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0694200/0xe984082ccd72de95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a661a expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230768:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230769:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230771:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0694200/0xe984082ccd72de95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a661a expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230778:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0694200/0xe984082ccd72de95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a661a expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230783:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694200, rc 0) 00000100:00100000:1.0:1746143753.230793:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593852288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 41us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230797:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12679 00000100:00100000:1.0:1746143753.230803:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12680 00000100:00100000:1.0:1746143753.230807:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963593852416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230811:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230814:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0694a00/0xe984082ccd72de9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6621 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230821:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230822:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230826:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0694a00/0xe984082ccd72de9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6621 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230832:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0694a00/0xe984082ccd72de9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6621 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230838:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694a00, rc 0) 00000100:00100000:1.0:1746143753.230848:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593852416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 41us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230852:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12680 00000100:00100000:1.0:1746143753.230859:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12681 00000100:00100000:1.0:1746143753.230863:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593852544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230867:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230870:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0694c00/0xe984082ccd72dea3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6628 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230876:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230877:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230880:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0694c00/0xe984082ccd72dea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6628 expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230888:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0694c00/0xe984082ccd72dea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6628 expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230893:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694c00, rc 0) 00000100:00100000:1.0:1746143753.230905:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963593852544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230908:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12681 00000100:00100000:1.0:1746143753.230915:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12682 00000100:00100000:1.0:1746143753.230919:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012da20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593852672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230926:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230931:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0694e00/0xe984082ccd72deaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a662f expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.230939:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230940:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.230943:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0694e00/0xe984082ccd72deaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a662f expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230950:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0694e00/0xe984082ccd72deaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a662f expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.230956:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694e00, rc 0) 00000100:00100000:1.0:1746143753.230970:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012da20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963593852672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.230975:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12682 00000100:00100000:1.0:1746143753.230983:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12683 00000100:00100000:1.0:1746143753.230987:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963593852800:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.230992:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.230996:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72deb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6636 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.231003:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.231005:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.231008:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72deb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6636 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.231016:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72deb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6636 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.231022:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0695000, rc 0) 00000100:00100000:1.0:1746143753.231032:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593852800:12345-192.168.202.48@tcp:101:cat.0 Request processed in 45us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.231036:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12683 00000100:00100000:0.0:1746143753.254823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.260098:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.260190:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593853184 00000100:00100000:1.0:1746143753.260198:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593853184 00002000:00100000:1.0:1746143753.260242:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a0a95500 x1830963593853184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.260256:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95500 with x1830963593853184 ext(0->1048575) 00002000:00010000:1.0:1746143753.260261:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95500 00000100:00100000:1.0:1746143753.260278:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5840 00000100:00100000:1.0:1746143753.260283:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963593853184:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143753.261540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.261580:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.261606:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.261667:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593853568 00000100:00100000:0.0:1746143753.261671:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593853568 00002000:00100000:0.0:1746143753.261695:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0a95f80 x1830963593853568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.261702:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95f80 with x1830963593853568 ext(1048576->2097151) 00002000:00010000:0.0:1746143753.261706:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a95f80 00000100:00100000:0.0:1746143753.261716:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593853824 00000100:00100000:0.0:1746143753.261718:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593853824 00002000:00100000:0.0:1746143753.261727:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0a97100 x1830963593853824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.261738:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97100 with x1830963593853824 ext(1048576->2097151) 00002000:00010000:0.0:1746143753.261741:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a97100 00000100:00100000:0.0:1746143753.261749:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593854080 00000100:00100000:0.0:1746143753.261752:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593854080 00002000:00100000:0.0:1746143753.261761:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a07c5c00 x1830963593854080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.261767:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c5c00 with x1830963593854080 ext(1048576->2097151) 00002000:00010000:0.0:1746143753.261770:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07c5c00 00000100:00100000:0.0:1746143753.261779:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5841 00000100:00100000:0.0:1746143753.261784:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963593853568:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143753.268948:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.268965:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.268991:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.269012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.269036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.269055:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593854336 00000100:00100000:1.0:1746143753.269060:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593854336 00010000:00010000:1.0:1746143753.269084:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f034400/0xe984082ccd72dd8b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a659c expref: 10 pid: 20509 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.269105:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593854592 00000100:00100000:1.0:1746143753.269107:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593854592 00010000:00010000:1.0:1746143753.269114:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f035000/0xe984082ccd72dd7d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6595 expref: 11 pid: 14762 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.269126:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6708 00000100:00100000:1.0:1746143753.269131:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593854336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.269161:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.269166:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f034400/0xe984082ccd72dd8b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a659c expref: 11 pid: 20509 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269423:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f034400/0xe984082ccd72dd8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a659c expref: 11 pid: 20509 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269441:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f034400/0xe984082ccd72dd8b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a659c expref: 11 pid: 20509 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269456:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143753.269464:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013125ba00/0xe984082ccd72debf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.269471:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013125ba00/0xe984082ccd72debf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.269476:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.269508:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593854336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 373us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.269513:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6708 00000100:00100000:1.0:1746143753.269527:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6709 00000100:00100000:1.0:1746143753.269532:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963593854464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.269538:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.269541:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dbc00/0xe984082ccd72de56 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65e2 expref: 10 pid: 20509 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269551:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dbc00/0xe984082ccd72de56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65e2 expref: 10 pid: 20509 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269561:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6dbc00/0xe984082ccd72de56 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65e2 expref: 10 pid: 20509 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269568:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143753.269571:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013125ba00/0xe984082ccd72debf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.269575:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013125ba00/0xe984082ccd72debf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.269579:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.269588:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1963:x1830963593854464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 57us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.269595:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6709 00000100:00100000:1.0:1746143753.269602:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6710 00000100:00100000:1.0:1746143753.269605:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963593854592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.269610:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.269613:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f035000/0xe984082ccd72dd7d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6595 expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269620:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f035000/0xe984082ccd72dd7d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6595 expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269633:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f035000/0xe984082ccd72dd7d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6595 expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.269639:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143753.269642:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013125ba00/0xe984082ccd72debf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.269647:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013125ba00/0xe984082ccd72debf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.269652:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013125ba00/0xe984082ccd72debf lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.269664:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.269673:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963593854592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.269676:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6710 00000100:00100000:0.0:1746143753.273351:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593854848 00000100:00100000:0.0:1746143753.273360:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593854848 00002000:00100000:0.0:1746143753.273403:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009e5cd880 x1830963593854848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.273414:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cd880 with x1830963593854848 ext(0->1048575) 00002000:00010000:0.0:1746143753.273419:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cd880 00000100:00100000:0.0:1746143753.273438:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5844 00000100:00100000:0.0:1746143753.273444:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1963:x1830963593854848:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143753.279319:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.279341:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.279360:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.279378:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593855232 00000100:00100000:1.0:1746143753.279383:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593855232 00002000:00100000:1.0:1746143753.279418:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a0085880 x1830963593855232/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.279427:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085880 with x1830963593855232 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.279433:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0085880 00000100:00100000:1.0:1746143753.279444:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593855360 00000100:00100000:1.0:1746143753.279446:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593855360 00002000:00100000:1.0:1746143753.279454:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0084a80 x1830963593855360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.279460:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084a80 with x1830963593855360 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.279463:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084a80 00000100:00100000:1.0:1746143753.279469:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593855488 00000100:00100000:1.0:1746143753.279470:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593855488 00002000:00100000:1.0:1746143753.279477:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0084380 x1830963593855488/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.279481:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084380 with x1830963593855488 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.279483:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084380 00000100:00100000:1.0:1746143753.279490:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5845 00000100:00100000:1.0:1746143753.279496:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963593855232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143753.283454:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5847 00000100:00100000:1.0:1746143753.283467:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963593855488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143753.284543:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963593853184:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 24257us (29727us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.284561:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5840 00002000:00100000:1.0:1746143753.284568:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a0a95500 x1830963593853184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.284577:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95500 with x1830963593853184 ext(0->1048575) 00002000:00010000:1.0:1746143753.284582:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95500 00000100:00100000:1.0:1746143753.303277:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.303950:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963593853568:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 42163us (42409us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143753.303959:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5841 00002000:00100000:0.0:1746143753.303970:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0a95f80 x1830963593853568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.303984:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95f80 with x1830963593853568 ext(1048576->2097151) 00002000:00010000:0.0:1746143753.303989:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a95f80 00000100:00100000:1.0:1746143753.317098:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963593854848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 43645us (48051us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.317113:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5844 00002000:00100000:1.0:1746143753.317123:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009e5cd880 x1830963593854848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.317132:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cd880 with x1830963593854848 ext(0->1048575) 00002000:00010000:1.0:1746143753.317137:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cd880 00000001:00080000:1.0:1746143753.332730:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943296 is committed 00000001:00080000:1.0:1746143753.332746:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943300 is committed 00000004:00080000:1.0:1746143753.332751:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1964 committed 00000004:00080000:1.0:1746143753.332759:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1940 committed 00000004:00080000:1.0:1746143753.332763:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1939 committed 00000004:00080000:1.0:1746143753.332765:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1938 committed 00000004:00080000:1.0:1746143753.332767:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1937 committed 00000004:00080000:1.0:1746143753.332769:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1963 committed 00000004:00080000:1.0:1746143753.332770:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1936 committed 00000004:00080000:1.0:1746143753.332771:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1962 committed 00000004:00080000:1.0:1746143753.332773:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1935 committed 00000004:00080000:1.0:1746143753.332774:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1961 committed 00000004:00080000:1.0:1746143753.332775:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1960 committed 00000004:00080000:1.0:1746143753.332777:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1959 committed 00000004:00080000:1.0:1746143753.332778:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1934 committed 00000004:00080000:1.0:1746143753.332779:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1933 committed 00000004:00080000:1.0:1746143753.332781:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1958 committed 00000004:00080000:1.0:1746143753.332782:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1957 committed 00000004:00080000:1.0:1746143753.332783:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1932 committed 00000001:00080000:1.0:1746143753.332787:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943299 is committed 00000001:00080000:1.0:1746143753.332797:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943295 is committed 00000100:00100000:1.0:1746143753.332955:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238336:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333017:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333062:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333076:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333093:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143753.333097:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333109:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333117:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333129:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333166:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594238592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333182:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333200:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594239104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333212:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333221:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143753.333225:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594238464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333236:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333245:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594238976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333256:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143753.333277:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238336 00000100:00100000:1.0:1746143753.333285:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238336 00000100:00100000:1.0:1746143753.333329:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238848 00000100:00100000:1.0:1746143753.333331:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238848 00000100:00100000:1.0:1746143753.333340:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238208 00000100:00100000:1.0:1746143753.333341:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238208 00000100:00100000:1.0:1746143753.333349:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238720 00000100:00100000:1.0:1746143753.333350:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238720 00000100:00100000:1.0:1746143753.333357:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238592 00000100:00100000:1.0:1746143753.333359:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238592 00000100:00100000:1.0:1746143753.333364:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594239104 00000100:00100000:1.0:1746143753.333365:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594239104 00000100:00100000:1.0:1746143753.333371:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238464 00000100:00100000:1.0:1746143753.333373:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238464 00000100:00100000:1.0:1746143753.333378:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238976 00000100:00100000:1.0:1746143753.333380:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238976 00000100:00100000:1.0:1746143753.333388:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12684 00000100:00100000:1.0:1746143753.333394:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963594238336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143753.333558:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143753.333561:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143753.333563:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143753.333565:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143753.333567:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143753.333595:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963594238336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (578us total) trans 17179872983 rc 0/0 00000100:00100000:1.0:1746143753.333601:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12684 00000100:00100000:1.0:1746143753.333613:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12685 00000100:00100000:1.0:1746143753.333618:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963594238848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333685:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963594238848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (609us total) trans 17179872984 rc 0/0 00000100:00100000:1.0:1746143753.333690:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12685 00000100:00100000:1.0:1746143753.333698:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12686 00000100:00100000:1.0:1746143753.333702:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963594238208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143753.333770:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143753.333772:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143753.333774:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143753.333776:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143753.333778:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143753.333793:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963594238208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (683us total) trans 17179872985 rc 0/0 00000100:00100000:1.0:1746143753.333798:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12686 00000100:00100000:1.0:1746143753.333805:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12687 00000100:00100000:1.0:1746143753.333809:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963594238720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.333868:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963594238720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (738us total) trans 17179872986 rc 0/0 00000100:00100000:1.0:1746143753.333873:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12687 00000100:00100000:1.0:1746143753.333881:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12688 00000100:00100000:1.0:1746143753.333885:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963594238592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143753.333937:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143753.333939:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143753.333941:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143753.333943:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143753.333944:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143753.333963:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963594238592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (781us total) trans 17179872987 rc 0/0 00000100:00100000:1.0:1746143753.333967:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12688 00000100:00100000:1.0:1746143753.333975:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12689 00000100:00100000:1.0:1746143753.333979:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963594239104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.334038:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963594239104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (825us total) trans 17179872988 rc 0/0 00000100:00100000:1.0:1746143753.334043:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12689 00000100:00100000:1.0:1746143753.334049:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12690 00000100:00100000:1.0:1746143753.334053:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963594238464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143753.334107:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143753.334109:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143753.334111:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143750 -> 1746143750 00002000:00010000:1.0:1746143753.334113:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143751 -> 1746143751 00002000:00010000:1.0:1746143753.334115:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143753.334129:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963594238464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (891us total) trans 17179872989 rc 0/0 00000100:00100000:1.0:1746143753.334133:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12690 00000100:00100000:1.0:1746143753.334163:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12691 00000100:00100000:1.0:1746143753.334167:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963594238976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143753.334229:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963594238976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (971us total) trans 17179872990 rc 0/0 00000100:00100000:1.0:1746143753.334234:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12691 00000004:00080000:1.0:1746143753.334285:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6f800/2, rc 0, transno 17179872989 00000100:00100000:1.0:1746143753.334290:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594238464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143753.334309:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c11c00/2, rc 0, transno 17179872990 00000100:00100000:1.0:1746143753.334312:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594238976:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143753.334319:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6dc00/2, rc 0, transno 17179872987 00000100:00100000:1.0:1746143753.334321:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594238592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143753.334326:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c13100/2, rc 0, transno 17179872988 00000100:00100000:1.0:1746143753.334328:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594239104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143753.334342:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6f100/2, rc 0, transno 17179872985 00000100:00100000:1.0:1746143753.334344:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143753.334349:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f03100/2, rc 0, transno 17179872986 00000100:00100000:1.0:1746143753.334352:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238720:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143753.334358:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6c000/2, rc 0, transno 17179872983 00000100:00100000:1.0:1746143753.334360:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143753.334366:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f02300/2, rc 0, transno 17179872984 00000100:00100000:1.0:1746143753.334368:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594238848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143753.337289:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.337322:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593855872 00000100:00100000:0.0:1746143753.337326:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593855872 00000100:00100000:0.0:1746143753.337354:0:14764:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9023 00000100:00100000:0.0:1746143753.337359:0:14764:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:30909:x1830963593855872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143753.337376:0:14764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.337392:0:14764:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72decd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a664b expref: -99 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.337436:0:14764:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72decd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a664b expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.337449:0:14764:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26000/0xe984082ccd72decd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a664b expref: 7 pid: 14764 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.337473:0:14764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.337476:0:14764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143753.337479:0:14764:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26000, rc 0) 00000100:00100000:0.0:1746143753.337506:0:14764:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:30909:x1830963593855872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 148us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.337512:0:14764:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9023 00000100:00100000:1.0:1746143753.337951:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963593855232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 58454us (58638us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.337960:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5845 00002000:00100000:1.0:1746143753.337968:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a0085880 x1830963593855232/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.337976:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085880 with x1830963593855232 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.337981:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0085880 00000100:00100000:0.0:1746143753.340928:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593856000 00000100:00100000:0.0:1746143753.340937:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593856000 00000100:00100000:0.0:1746143753.341284:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593856128 00000100:00100000:0.0:1746143753.341287:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593856128 00000100:00100000:0.0:1746143753.341325:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3831 00000100:00100000:0.0:1746143753.341333:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:30907:x1830963593856000:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143753.341442:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:30907:x1830963593856000:12345-192.168.202.48@tcp:49:cat.0 Request processed in 111us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.341448:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3831 00000100:00100000:0.0:1746143753.341474:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3832 00000100:00100000:0.0:1746143753.341478:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:30903:x1830963593856128:12345-192.168.202.48@tcp:49:multiop.0 00000100:00100000:0.0:1746143753.341514:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:30903:x1830963593856128:12345-192.168.202.48@tcp:49:multiop.0 Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.341520:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3832 00000100:00100000:0.0:1746143753.348770:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.349775:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593856512 00000100:00100000:0.0:1746143753.349778:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593856512 00002000:00100000:0.0:1746143753.349805:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009c3fb800 x1830963593856512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.349813:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963593856512 ext(1048576->2097151) 00002000:00010000:0.0:1746143753.349817:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:0.0:1746143753.349830:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5848 00000100:00100000:0.0:1746143753.349834:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963593856512:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:0.0:1746143753.353805:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955b3200/0xe984082ccd72de72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6605 expref: 17 pid: 25369 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143753.353829:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b160000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594240512:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143753.353839:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0694e00/0xe984082ccd72deaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a662f expref: 7 pid: 15784 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143753.353847:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b162a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594240640:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143753.353855:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594240768:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143753.353880:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2617344->2957311] (req 2617344->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.353890:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b02c200, rc 0) 00000100:00100000:0.0:1746143753.353920:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:30903:x1830963593856256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4801us (5162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.353926:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12701 00000100:00100000:0.0:1746143753.354910:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.354985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.355043:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593856896 00000100:00100000:1.0:1746143753.355046:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593856896 00010000:00010000:1.0:1746143753.355061:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801314e9e00/0xe984082ccd72ddb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65bf expref: 8 pid: 8496 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746143753.355670:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6713 00000100:00100000:1.0:1746143753.355677:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593856896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.355688:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.355706:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801314e9e00/0xe984082ccd72ddb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65bf expref: 8 pid: 8496 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.355715:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801314e9e00/0xe984082ccd72ddb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65bf expref: 8 pid: 8496 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.355737:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801314e9e00/0xe984082ccd72ddb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65bf expref: 8 pid: 8496 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.355755:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.355758:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.355765:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.355772:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.355800:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.355810:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594240896:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143753.355871:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.358121:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963593856512:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8275us (8457us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.358132:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5848 00002000:00100000:1.0:1746143753.358172:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009c3fb800 x1830963593856512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.358181:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963593856512 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.358187:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:1.0:1746143753.358255:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ace6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594240896:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.358276:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.358307:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593856896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2620us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.358314:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6713 00000100:00100000:0.0:1746143753.360658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.360766:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593857408 00000100:00100000:1.0:1746143753.360775:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593857408 00002000:00100000:1.0:1746143753.360987:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2953216->2957311) req@ffff8800a07c4380 x1830963593857408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.360996:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c4380 with x1830963593857408 ext(2953216->2957311) 00002000:00010000:1.0:1746143753.361001:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07c4380 00000100:00100000:1.0:1746143753.361035:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5850 00000100:00100000:1.0:1746143753.361044:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963593857408:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143753.361370:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963593857408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 326us (723us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143753.361376:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5850 00002000:00100000:1.0:1746143753.361382:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2953216->2957311) req@ffff8800a07c4380 x1830963593857408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.361389:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c4380 with x1830963593857408 ext(2953216->2957311) 00002000:00010000:1.0:1746143753.361391:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07c4380 00000100:00100000:0.0:1746143753.362951:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.363578:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.363724:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593857920 00000100:00100000:1.0:1746143753.363728:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593857920 00000100:00100000:1.0:1746143753.363759:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3833 00000100:00100000:1.0:1746143753.363764:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:30903:x1830963593857920:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143753.364197:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:30903:x1830963593857920:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 432us (619us total) trans 8589943301 rc 0/0 00000100:00100000:1.0:1746143753.364203:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3833 00000100:00100000:0.0:1746143753.367103:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.367203:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593858176 00000100:00100000:1.0:1746143753.367213:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593858176 00002000:00100000:1.0:1746143753.367265:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a07c7b80 x1830963593858176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.367275:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c7b80 with x1830963593858176 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.367281:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07c7b80 00000100:00100000:1.0:1746143753.367328:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5852 00000100:00100000:1.0:1746143753.367336:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963593858176:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143753.372100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.381983:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963593858176:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14636us (14878us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.381996:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5852 00002000:00100000:1.0:1746143753.382008:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a07c7b80 x1830963593858176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.382017:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a07c7b80 with x1830963593858176 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.382023:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a07c7b80 00000100:00100000:0.0:1746143753.397972:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.402197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.403412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.403548:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593859072 00000100:00100000:1.0:1746143753.403553:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593859072 00002000:00100000:1.0:1746143753.403590:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3485695) req@ffff88012fd1b800 x1830963593859072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 504/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.403599:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fd1b800 with x1830963593859072 ext(2097152->3485695) 00002000:00010000:1.0:1746143753.403604:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fd1b800 00000100:00100000:1.0:1746143753.403662:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5855 00000100:00100000:1.0:1746143753.403670:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963593859072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143753.405603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.405971:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593859840 00000100:00100000:1.0:1746143753.405975:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593859840 00002000:00100000:1.0:1746143753.405988:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009b160000 x1830963593859840/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.405995:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b160000 with x1830963593859840 ext(3145728->4194303) 00002000:00010000:1.0:1746143753.405998:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b160000 00000100:00100000:1.0:1746143753.406009:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5858 00000100:00100000:1.0:1746143753.406013:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963593859840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143753.411502:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.411534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.411556:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593859968 00000100:00100000:1.0:1746143753.411557:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593860096 00000100:00100000:1.0:1746143753.411564:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593860096 00000100:00100000:0.0:1746143753.411564:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593859968 00010000:00010000:1.0:1746143753.411603:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0694a00/0xe984082ccd72de9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6621 expref: 27 pid: 15784 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746143753.411642:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6714 00000100:00100000:1.0:1746143753.411649:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963593860096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.411665:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.411689:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0694a00/0xe984082ccd72de9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6621 expref: 27 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.411701:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0694a00/0xe984082ccd72de9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6621 expref: 27 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.411728:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.411770:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963593860096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.411781:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6714 00010000:00010000:0.0:1746143753.412410:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094de8800/0xe984082ccd72dda7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b1 expref: 11 pid: 8497 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143753.412433:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6715 00000100:00100000:0.0:1746143753.412439:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593859968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.412447:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.412459:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094de8800/0xe984082ccd72dda7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b1 expref: 11 pid: 8497 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.412468:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094de8800/0xe984082ccd72dda7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b1 expref: 11 pid: 8497 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.412481:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.412500:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963593859968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.412505:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6715 00000100:00100000:1.0:1746143753.420500:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963593859072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16830us (17088us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.420506:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5855 00002000:00100000:1.0:1746143753.420512:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3485695) req@ffff88012fd1b800 x1830963593859072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 504/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.420519:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fd1b800 with x1830963593859072 ext(2097152->3485695) 00002000:00010000:1.0:1746143753.420522:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fd1b800 00000100:00100000:0.0:1746143753.423754:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.427474:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963593859840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21445us (21537us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.427486:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5858 00002000:00100000:1.0:1746143753.427498:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009b160000 x1830963593859840/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.427506:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b160000 with x1830963593859840 ext(3145728->4194303) 00002000:00010000:1.0:1746143753.427512:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b160000 00000100:00100000:0.0:1746143753.431730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.435848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.435889:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.436641:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12706 00000100:00100000:1.0:1746143753.436650:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963593860992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.436659:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.436669:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72def7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6675 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.436700:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594242176:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143753.437664:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.438011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.438048:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.438104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.438154:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593861120 00000100:00100000:0.0:1746143753.438159:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593861120 00010000:00010000:0.0:1746143753.438187:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0695400/0xe984082ccd72de80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65fe expref: 16 pid: 15784 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143753.438213:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593861248 00000100:00100000:0.0:1746143753.438215:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593861248 00010000:00010000:0.0:1746143753.438224:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0694c00/0xe984082ccd72dea3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6628 expref: 11 pid: 15784 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143753.438236:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593861376 00000100:00100000:0.0:1746143753.438238:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593861376 00010000:00010000:0.0:1746143753.438249:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd72dda0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b8 expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143753.438262:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6717 00000100:00100000:0.0:1746143753.438267:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963593861120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.438277:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.438310:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0695400/0xe984082ccd72de80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65fe expref: 16 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.438321:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0695400/0xe984082ccd72de80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65fe expref: 16 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.438342:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.438364:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1965:x1830963593861120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.438370:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6717 00000100:00100000:0.0:1746143753.438397:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6718 00000100:00100000:0.0:1746143753.438406:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963593861248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.438415:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.438422:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0694c00/0xe984082ccd72dea3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6628 expref: 11 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.438430:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0694c00/0xe984082ccd72dea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6628 expref: 11 pid: 15784 timeout: 932 lvb_type: 1 00000100:00100000:1.0:1746143753.438814:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6719 00000100:00100000:1.0:1746143753.438822:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593861376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.438829:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.439008:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd72dda0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b8 expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.439010:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0694c00/0xe984082ccd72dea3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6628 expref: 10 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.439018:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd72dda0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b8 expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.439029:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd72dda0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65b8 expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.439040:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.439043:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.439050:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 9 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.439057:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 9 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.439082:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 9 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.439093:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594242304:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143753.439135:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00010000:00010000:1.0:1746143753.439323:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.439343:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593861376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 522us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.439349:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6719 00002000:00010000:1.0:1746143753.439384:0:9527:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143750 -> 1746143753 00002000:00010000:1.0:1746143753.439387:0:9527:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143750 -> 1746143753 00002000:00010000:1.0:1746143753.439389:0:9527:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143751 -> 1746143753 00000100:00100000:1.0:1746143753.439401:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ace6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594242176:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143753.439419:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72def7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6675 expref: 41 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.439427:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72def7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6675 expref: 41 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.439438:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81a600, rc 0) 00000100:00100000:1.0:1746143753.439454:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963593860992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2807us (3564us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143753.439459:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12706 00000100:00100000:0.0:1746143753.440491:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.440596:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594242304:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.440608:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.440642:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963593861248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2240us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.440650:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6718 00000100:00100000:0.0:1746143753.441181:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.445125:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.445253:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593861888 00000100:00100000:0.0:1746143753.445263:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593861888 00002000:00100000:0.0:1746143753.445317:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1757184->1761279) req@ffff88009ace6300 x1830963593861888/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.445326:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ace6300 with x1830963593861888 ext(1757184->1761279) 00002000:00010000:0.0:1746143753.445331:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ace6300 00000100:00100000:0.0:1746143753.445350:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5860 00000100:00100000:0.0:1746143753.445357:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963593861888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143753.445551:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963593861888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 194us (439us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143753.445557:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5860 00002000:00100000:0.0:1746143753.445562:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1757184->1761279) req@ffff88009ace6300 x1830963593861888/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.445566:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ace6300 with x1830963593861888 ext(1757184->1761279) 00002000:00010000:0.0:1746143753.445568:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ace6300 00000100:00100000:1.0:1746143753.448321:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593862144 00000100:00100000:1.0:1746143753.448329:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593862144 00000100:00100000:1.0:1746143753.448364:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3834 00000100:00100000:1.0:1746143753.448371:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6308450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:30905:x1830963593862144:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143753.448542:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6308450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:30905:x1830963593862144:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 171us (321us total) trans 8589943302 rc 0/0 00000100:00100000:1.0:1746143753.448549:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3834 00000100:00100000:0.0:1746143753.451219:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963593861504:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10257us (10721us total) trans 21474840304 rc 0/0 00000100:00100000:0.0:1746143753.451231:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1671 00002000:00100000:0.0:1746143753.451243:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2617344->2957311) req@ffff88012b79e680 x1830963593861504/t21474840304(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/448 e 0 to 0 dl 1746143764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.451252:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79e680 with x1830963593861504 ext(2617344->2957311) 00010000:00010000:0.0:1746143753.451263:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 18 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.451280:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 18 pid: 8495 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746143753.451293:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79e680 00000100:00100000:0.0:1746143753.457070:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.457456:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593862272 00000100:00100000:1.0:1746143753.457467:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593862272 00010000:00010000:1.0:1746143753.457507:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 18 pid: 8495 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.457549:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6720 00000100:00100000:1.0:1746143753.457557:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963593862272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.457572:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.457596:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 18 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.457609:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 18 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.457635:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b02c200/0xe984082ccd72ded4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2617344->2957311) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6652 expref: 18 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.457654:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.457656:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.457663:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.457672:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.457680:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.457681:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.457684:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014dc00/0xe984082ccd72defe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a667c expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.457691:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014dc00/0xe984082ccd72defe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a667c expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.457723:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014dc00/0xe984082ccd72defe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a667c expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.457741:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ace7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594242432:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.457837:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 7 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.457845:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594242560:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143753.457865:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.459857:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ace7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594242432:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143753.460629:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594242560:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.460653:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.460708:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963593862272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3150us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.460722:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6720 00000100:00100000:0.0:1746143753.460832:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593862528 00000100:00100000:0.0:1746143753.460838:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593862528 00002000:00100000:0.0:1746143753.460878:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88009c3fbb80 x1830963593862528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.460887:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963593862528 ext(4194304->4755455) 00002000:00010000:0.0:1746143753.460892:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:0.0:1746143753.461171:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5861 00000100:00100000:0.0:1746143753.461178:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963593862528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143753.470734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.470773:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.470801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.470830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.470891:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593863040 00000100:00100000:1.0:1746143753.470902:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593863040 00002000:00100000:1.0:1746143753.470951:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b79ce00 x1830963593863040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.470961:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ce00 with x1830963593863040 ext(3145728->4194303) 00002000:00010000:1.0:1746143753.470966:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79ce00 00000100:00100000:1.0:1746143753.470983:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593863296 00000100:00100000:1.0:1746143753.470986:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593863296 00002000:00100000:1.0:1746143753.471000:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c277b80 x1830963593863296/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.471007:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277b80 with x1830963593863296 ext(2097152->3145727) 00002000:00010000:1.0:1746143753.471010:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c277b80 00000100:00100000:1.0:1746143753.471020:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593863424 00000100:00100000:1.0:1746143753.471021:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593863424 00002000:00100000:1.0:1746143753.471030:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009bfe3b80 x1830963593863424/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.471035:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830963593863424 ext(3145728->4194303) 00002000:00010000:1.0:1746143753.471037:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3b80 00000100:00100000:1.0:1746143753.471055:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5863 00000100:00100000:1.0:1746143753.471059:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963593863296:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143753.474399:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593863680 00000100:00100000:0.0:1746143753.474408:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593863680 00000100:00100000:0.0:1746143753.474444:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593863808 00000100:00100000:0.0:1746143753.474446:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593863808 00000100:00100000:0.0:1746143753.474463:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12708 00000100:00100000:0.0:1746143753.474475:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963593863680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143753.474491:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.474512:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cff7c00/0xe984082ccd72df05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6683 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.474570:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594242688:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143753.474630:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.474648:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12709 00000100:00100000:0.0:1746143753.474653:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963593863808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143753.474660:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.474671:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009505f400/0xe984082ccd72df0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a668a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.474696:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594242816:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143753.474716:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f000 going to sleep for 11 seconds 00002000:00010000:1.0:1746143753.480333:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime: 1746143750 -> 1746143753 00002000:00010000:1.0:1746143753.480337:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143750 -> 1746143753 00002000:00010000:1.0:1746143753.480339:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime: 1746143751 -> 1746143753 00000100:00100000:1.0:1746143753.480353:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594242816:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143753.480372:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009505f400/0xe984082ccd72df0c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a668a expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.480386:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009505f400/0xe984082ccd72df0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a668a expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.480398:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009505f400, rc 0) 00000100:00100000:1.0:1746143753.480418:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963593863808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5764us (6048us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143753.480424:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12709 00000100:00100000:0.0:1746143753.482935:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593862784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11670us (12119us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143753.482948:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5864 00002000:00100000:0.0:1746143753.482963:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009bfe3800 x1830963593862784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.482973:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963593862784 ext(2097152->3145727) 00002000:00010000:0.0:1746143753.482979:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3800 00000100:00100000:0.0:1746143753.491359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.497559:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963593863296:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26495us (26781us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.497571:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5863 00002000:00100000:1.0:1746143753.497581:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c277b80 x1830963593863296/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.497590:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277b80 with x1830963593863296 ext(2097152->3145727) 00002000:00010000:1.0:1746143753.497596:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c277b80 00000100:00100000:0.0:1746143753.502636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.512440:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.512509:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593864832 00000100:00100000:1.0:1746143753.512521:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593864832 00002000:00100000:1.0:1746143753.512577:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88008f3cad80 x1830963593864832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.512588:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cad80 with x1830963593864832 ext(4194304->4755455) 00002000:00010000:1.0:1746143753.512594:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cad80 00000100:00100000:1.0:1746143753.512632:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5866 00000100:00100000:1.0:1746143753.512640:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963593864832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143753.524114:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963593864832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11460us (11669us total) trans 0 rc 561152/561152 00000100:00100000:1.0:1746143753.524128:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5866 00002000:00100000:1.0:1746143753.524151:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88008f3cad80 x1830963593864832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.524161:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cad80 with x1830963593864832 ext(4194304->4755455) 00002000:00010000:1.0:1746143753.524168:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cad80 00000100:00100000:0.0:1746143753.529692:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.529910:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593865088 00000100:00100000:1.0:1746143753.529921:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593865088 00000100:00100000:1.0:1746143753.530577:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3836 00000100:00100000:1.0:1746143753.530588:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:30909:x1830963593865088:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143753.534559:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:30909:x1830963593865088:12345-192.168.202.48@tcp:35:cat.0 Request processed in 3963us (4867us total) trans 8589943305 rc 0/0 00000100:00100000:1.0:1746143753.534571:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3836 00000100:00100000:0.0:1746143753.577952:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593865216 00000100:00100000:0.0:1746143753.577962:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593865216 00000100:00100000:0.0:1746143753.578005:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12712 00000100:00100000:0.0:1746143753.578013:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:30914:x1830963593865216:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143753.578030:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.578054:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66a6 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.578083:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.578091:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143753.578092:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143753.578095:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1384448->2076671] (req 1384448->2076671) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 41 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.578125:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.578136:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 24 pid: 8495 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143753.578164:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594243200:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143753.578257:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.586318:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.586374:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594243200:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143753.586404:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1384448->2076671] (req 1384448->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 41 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.586422:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a6a00, rc 0) 00000100:00100000:0.0:1746143753.586470:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:30914:x1830963593865216:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8458us (8940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.586483:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12712 00000100:00100000:0.0:1746143753.586531:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593865344 00000100:00100000:0.0:1746143753.586537:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593865344 00002000:00100000:0.0:1746143753.586573:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1888256->2097151) req@ffff88008f3caa00 x1830963593865344/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.588092:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3caa00 with x1830963593865344 ext(1888256->2097151) 00010000:00010000:0.0:1746143753.588102:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 25 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.588115:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 25 pid: 8495 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746143753.588121:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3caa00 00000100:00100000:0.0:1746143753.588265:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1672 00000100:00100000:0.0:1746143753.588273:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963593865344:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143753.596406:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963593865344:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8122us (10088us total) trans 17179872991 rc 0/0 00000100:00100000:0.0:1746143753.596420:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1672 00002000:00100000:0.0:1746143753.596433:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1888256->2097151) req@ffff88008f3caa00 x1830963593865344/t17179872991(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/448 e 0 to 0 dl 1746143764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.596443:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3caa00 with x1830963593865344 ext(1888256->2097151) 00010000:00010000:0.0:1746143753.596454:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 27 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.596476:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 27 pid: 8495 timeout: 932 lvb_type: 0 00002000:00010000:0.0:1746143753.596483:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3caa00 00000100:00100000:0.0:1746143753.600487:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.600523:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593865472 00000100:00100000:0.0:1746143753.600533:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593865472 00000100:00100000:0.0:1746143753.600580:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9025 00000100:00100000:0.0:1746143753.600587:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:30917:x1830963593865472:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143753.600611:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.600631:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d0c00/0xe984082ccd72df4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66ad expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.604202:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604226:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604239:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604252:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604258:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604262:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604403:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604411:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604416:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143753.604449:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:0.0:1746143753.604453:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143753.604469:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604477:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604485:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604489:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604494:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604499:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4d1c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143753.604503:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604509:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604519:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143753.604522:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.604526:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604530:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1c00/0xe984082ccd72df52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604554:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604557:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604561:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604565:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4d1e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143753.604567:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604572:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604577:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009322f600) 00010000:00010000:0.0:1746143753.604579:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.604581:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604584:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d1e00/0xe984082ccd72df59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.604620:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4d0c00/0xe984082ccd72df4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ad expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.604638:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ad expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.604644:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.604646:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143753.604648:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a6c00, rc 0) 00000100:00100000:0.0:1746143753.604715:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:30917:x1830963593865472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4126us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.604723:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9025 00000100:00100000:0.0:1746143753.608413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.610083:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593865600 00000100:00100000:0.0:1746143753.610095:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593865600 00010000:00010000:0.0:1746143753.610136:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 27 pid: 8495 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143753.610176:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6721 00000100:00100000:0.0:1746143753.610184:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963593865600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.610197:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.610218:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 27 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.610230:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 27 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.610253:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72dedb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6659 expref: 27 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.610270:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.610272:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.610280:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2076671) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 40 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.610287:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2076671) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 40 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.610349:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 40 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.610363:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594243328:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143753.610438:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.620094:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.620117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.620132:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.620166:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593865984 00000100:00100000:0.0:1746143753.620174:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593865984 00000100:00100000:0.0:1746143753.620212:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593866112 00000100:00100000:0.0:1746143753.620214:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593866112 00000100:00100000:0.0:1746143753.620238:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12713 00000100:00100000:0.0:1746143753.620245:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593865984:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143753.620263:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.620289:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095610800/0xe984082ccd72df67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66b4 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.620364:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b038a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594243456:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143753.620431:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.620451:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12714 00000100:00100000:0.0:1746143753.620456:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593866112:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143753.620465:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.620474:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72df6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66bb expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.620499:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b03a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594243584:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143753.620519:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.620553:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b039f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594243328:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143753.620568:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.620603:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963593865600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10420us (12202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.620612:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6721 00000100:00100000:0.0:1746143753.620666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.624860:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b03a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594243584:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143753.624893:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72df6e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66bb expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.624907:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd72df6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66bb expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.624926:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095611e00, rc 0) 00000100:00100000:0.0:1746143753.624978:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593866112:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4519us (4843us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143753.624985:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12714 00000100:00100000:0.0:1746143753.625120:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593865856 00000100:00100000:1.0:1746143753.625241:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b038a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594243456:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143753.625261:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095610800/0xe984082ccd72df67 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66b4 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.625270:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095610800/0xe984082ccd72df67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66b4 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.625283:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095610800, rc 0) 00000100:00100000:1.0:1746143753.625316:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593865984:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5072us (5197us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143753.625322:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12713 00000100:00100000:0.0:1746143753.627329:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593865856 00002000:00100000:0.0:1746143753.627375:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1384448->1388543) req@ffff88009b03bb80 x1830963593865856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.627385:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b03bb80 with x1830963593865856 ext(1384448->1388543) 00002000:00010000:0.0:1746143753.627389:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b03bb80 00000100:00100000:0.0:1746143753.627409:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5867 00000100:00100000:0.0:1746143753.627416:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963593865856:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143753.627578:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b03bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963593865856:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 162us (7496us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143753.627584:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5867 00002000:00100000:0.0:1746143753.627589:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1384448->1388543) req@ffff88009b03bb80 x1830963593865856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.627596:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b03bb80 with x1830963593865856 ext(1384448->1388543) 00002000:00010000:0.0:1746143753.627599:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b03bb80 00000100:00100000:0.0:1746143753.639225:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593867136 00000100:00100000:0.0:1746143753.639230:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593867136 00010000:00010000:0.0:1746143753.639282:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ad expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143753.639320:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6722 00000100:00100000:0.0:1746143753.639325:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963593867136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.639336:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.639342:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ad expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.639352:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ad expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.639371:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a6c00/0xe984082ccd72df60 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ad expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.639397:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.639402:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.639409:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.639413:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.639440:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593867136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.639445:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6722 00000100:00100000:0.0:1746143753.644791:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593867264 00000100:00100000:0.0:1746143753.644798:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593867264 00010000:00010000:0.0:1746143753.644830:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c600/0xe984082ccd72df36 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a669f expref: 248 pid: 14762 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143753.644862:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6723 00000100:00100000:0.0:1746143753.644869:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1964:x1830963593867264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.644881:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.644887:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c600/0xe984082ccd72df36 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a669f expref: 248 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.644896:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c600/0xe984082ccd72df36 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a669f expref: 248 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.644917:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c600/0xe984082ccd72df36 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a669f expref: 248 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.644928:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.644933:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.644942:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.644949:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.644969:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.645005:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1964:x1830963593867264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 137us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.645010:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6723 00000100:00100000:1.0:1746143753.647085:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593867520 00000100:00100000:1.0:1746143753.647094:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593867520 00000100:00100000:1.0:1746143753.647133:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3837 00000100:00100000:1.0:1746143753.647150:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:30914:x1830963593867520:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143753.647284:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:30914:x1830963593867520:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 145us (2716us total) trans 8589943308 rc 0/0 00000100:00100000:1.0:1746143753.647290:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3837 00000100:00100000:1.0:1746143753.647321:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593867648 00000100:00100000:1.0:1746143753.647324:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593867648 00000100:00100000:1.0:1746143753.647354:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12716 00000100:00100000:1.0:1746143753.647359:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963593867648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.647369:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.647382:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b145800/0xe984082ccd72dfa6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66d7 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.647423:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594243968:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143753.647474:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.655264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.655304:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593867776 00000100:00100000:1.0:1746143753.655312:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593867776 00000100:00100000:1.0:1746143753.655352:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9028 00000100:00100000:1.0:1746143753.655359:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30917:x1830963593867776:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143753.655390:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.655408:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500fa00/0xe984082ccd72dfad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66de expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.655482:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.655495:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d0 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.655502:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.655543:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d0 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.655557:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d0 expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.655578:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a07c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594244096:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143753.655660:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.657715:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594243968:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143753.657746:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b145800/0xe984082ccd72dfa6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d7 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.657761:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b145800/0xe984082ccd72dfa6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d7 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.657771:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b145800, rc 0) 00000100:00100000:1.0:1746143753.657808:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963593867648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10448us (13155us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143753.657815:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12716 00000100:00100000:0.0:1746143753.661382:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a07c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594244096:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143753.661409:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143753.664511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.665545:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593867904 00000100:00100000:0.0:1746143753.665555:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593867904 00010000:00010000:0.0:1746143753.665594:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d0 expref: 10 pid: 14762 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143753.665623:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6724 00000100:00100000:0.0:1746143753.665631:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593867904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.665643:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.665649:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d0 expref: 10 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.665660:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d0 expref: 10 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.665687:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6200/0xe984082ccd72df98 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66d0 expref: 10 pid: 14762 timeout: 932 lvb_type: 0 00010000:00010000:0.0:1746143753.665703:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.665709:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.665717:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.665724:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.665746:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.666452:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593867904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 820us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.666459:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6724 00010000:00010000:1.0:1746143753.668028:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.668038:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143753.668080:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143753.668084:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143753.668101:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143753.668134:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500fa00/0xe984082ccd72dfad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66de expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.668168:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66de expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.668176:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143753.668179:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143753.668182:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e92200, rc 0) 00000100:00100000:1.0:1746143753.668229:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30917:x1830963593867776:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 12869us (12971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.668237:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9028 00000100:00100000:1.0:1746143753.677912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.678722:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593868160 00000100:00100000:0.0:1746143753.678732:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593868160 00000100:00100000:1.0:1746143753.678852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.678870:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.678889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.678912:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.678928:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593868672 00000100:00100000:1.0:1746143753.678931:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593868672 00000100:00100000:1.0:1746143753.678952:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593868544 00000100:00100000:1.0:1746143753.678953:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593868544 00000100:00100000:1.0:1746143753.678967:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12717 00000100:00100000:1.0:1746143753.678974:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593868672:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143753.678992:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.679009:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd72dfbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66f3 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.679062:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594244224:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143753.679133:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.679169:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12718 00000100:00100000:1.0:1746143753.679174:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593868544:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143753.679179:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.679189:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a630ea00/0xe984082ccd72dfc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66ec expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.679212:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ce8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594244352:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143753.679234:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.679573:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9029 00000100:00100000:0.0:1746143753.679580:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a07c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:30923:x1830963593868160:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143753.679594:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.679604:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3200/0xe984082ccd72dfc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66e5 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.679681:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679693:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679703:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679712:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679717:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679721:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679804:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2a00/0xe984082ccd72dfde lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679812:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2a00/0xe984082ccd72dfde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679818:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2a00/0xe984082ccd72dfde lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143753.679824:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143753.679891:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679897:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679902:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679907:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d2800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143753.679910:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679916:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679926:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143753.679929:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.679932:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679937:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72dfd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679961:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679968:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679972:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679976:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d3000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143753.679978:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679983:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.679989:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091057d00) 00010000:00010000:0.0:1746143753.679996:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143753.679998:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.680002:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72dfd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143753.680035:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3200/0xe984082ccd72dfc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66e5 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.680046:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2a00/0xe984082ccd72dfde lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66e5 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.680052:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.680054:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143753.680055:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d2a00, rc 0) 00000100:00100000:0.0:1746143753.680083:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a07c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:30923:x1830963593868160:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 505us (2182us total) trans 8589943309 rc 0/0 00000100:00100000:0.0:1746143753.680090:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9029 00000100:00100000:0.0:1746143753.680118:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5870 00000100:00100000:0.0:1746143753.680123:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963593868928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143753.695431:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594244224:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143753.695465:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd72dfbb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66f3 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.695480:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a630f600/0xe984082ccd72dfbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66f3 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143753.695488:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630f600, rc 0) 00000100:00100000:0.0:1746143753.696807:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ce8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594244352:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143753.696837:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a630ea00/0xe984082ccd72dfc2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ec expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.696850:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a630ea00/0xe984082ccd72dfc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66ec expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.696860:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630ea00, rc 0) 00000100:00100000:0.0:1746143753.696903:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593868544:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 17728us (18031us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143753.696911:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12718 00000100:00100000:1.0:1746143753.697024:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593868672:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 18045us (18168us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143753.697032:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12717 00000100:00100000:0.0:1746143753.710472:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593869184 00000100:00100000:0.0:1746143753.710483:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593869184 00000100:00100000:0.0:1746143753.710524:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9030 00000100:00100000:0.0:1746143753.710530:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30917:x1830963593869184:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143753.710546:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.710560:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc4a00/0xe984082ccd72dfec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a66fa expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.710639:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710653:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710662:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710673:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710678:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710684:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710689:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129dc5400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143753.710693:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710698:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710707:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143753.710709:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143753.710712:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710717:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc5400/0xe984082ccd72dff3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143753.710748:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc4a00/0xe984082ccd72dfec lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66fa expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.710758:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc4a00/0xe984082ccd72dfec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66fa expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.710765:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc4a00, rc 0) 00000100:00100000:0.0:1746143753.710808:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:30917:x1830963593869184:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 278us (380us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143753.710813:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9030 00000100:00100000:0.0:1746143753.717709:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.724521:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593869568 00000100:00100000:1.0:1746143753.724531:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593869568 00000100:00100000:1.0:1746143753.724579:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12719 00000100:00100000:1.0:1746143753.724586:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:30920:x1830963593869568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143753.724601:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143753.724617:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6701 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.724647:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 7 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.724654:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143753.724655:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143753.724658:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.724683:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 7 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.724692:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 7 pid: 8495 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.724702:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ce8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594244480:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143753.724793:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.734306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.734338:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593869696 00000100:00100000:1.0:1746143753.734346:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593869696 00002000:00100000:1.0:1746143753.734392:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1761279) req@ffff88009cdc3100 x1830963593869696/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.734402:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3100 with x1830963593869696 ext(1048576->1761279) 00010000:00010000:1.0:1746143753.734411:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 8 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.734425:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 8 pid: 8495 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143753.734432:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc3100 00000100:00100000:1.0:1746143753.734464:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1673 00000100:00100000:1.0:1746143753.734472:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963593869696:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143753.736157:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ce8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594244480:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143753.736184:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.736201:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7eb000, rc 0) 00000100:00100000:0.0:1746143753.736231:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:30920:x1830963593869568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 11646us (11939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.736239:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12719 00000100:00100000:1.0:1746143753.752133:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593869696:12345-192.168.202.48@tcp:4:cat.0 Request processed in 17650us (17833us total) trans 21474840305 rc 0/0 00000100:00100000:1.0:1746143753.752164:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1673 00002000:00100000:1.0:1746143753.752178:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1761279) req@ffff88009cdc3100 x1830963593869696/t21474840305(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/448 e 0 to 0 dl 1746143764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.752187:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3100 with x1830963593869696 ext(1048576->1761279) 00010000:00010000:1.0:1746143753.752198:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 10 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.752215:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 10 pid: 8495 timeout: 932 lvb_type: 0 00002000:00010000:1.0:1746143753.752222:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc3100 00000100:00100000:0.0:1746143753.767781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.768625:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.769414:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593869824 00000100:00100000:1.0:1746143753.769421:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593869824 00010000:00010000:1.0:1746143753.769443:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 10 pid: 8495 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.769464:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6725 00000100:00100000:1.0:1746143753.769470:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593869824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.769482:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.769500:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 10 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.769509:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 10 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.769524:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014ce00/0xe984082ccd72dee9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1761279) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6667 expref: 10 pid: 8495 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.769539:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.769541:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.769547:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.769555:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.769588:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.769600:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594244608:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143753.769669:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.772118:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594244608:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.772311:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.772374:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593869824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2902us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.772386:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6725 00000100:00100000:0.0:1746143753.780129:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.780198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.780245:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.780269:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593870464 00000100:00100000:0.0:1746143753.780276:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593870464 00000100:00100000:0.0:1746143753.780327:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593870592 00000100:00100000:0.0:1746143753.780330:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593870592 00000100:00100000:0.0:1746143753.780344:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12720 00000100:00100000:0.0:1746143753.780350:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963593870464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143753.780364:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.780377:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6566200/0xe984082ccd72e016 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a670f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.780417:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594244736:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143753.780484:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.780500:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12721 00000100:00100000:0.0:1746143753.780506:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963593870592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143753.780513:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143753.780521:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6716 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143753.780530:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.780532:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143753.780538:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.780550:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.780559:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7eac00, rc 0) 00000100:00100000:0.0:1746143753.780578:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963593870592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.780583:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12721 00000100:00100000:1.0:1746143753.781075:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593870336 00000100:00100000:1.0:1746143753.781079:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593870336 00002000:00100000:1.0:1746143753.781104:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009b038a80 x1830963593870336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.781112:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b038a80 with x1830963593870336 ext(1048576->2097151) 00002000:00010000:1.0:1746143753.781116:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b038a80 00000100:00100000:0.0:1746143753.790637:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.794018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.796219:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963593870336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15017us (16091us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143753.796228:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5871 00002000:00100000:0.0:1746143753.796239:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009b038a80 x1830963593870336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.796248:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b038a80 with x1830963593870336 ext(1048576->2097151) 00002000:00010000:0.0:1746143753.796253:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b038a80 00000100:00100000:1.0:1746143753.797451:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.797841:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593871104 00000100:00100000:0.0:1746143753.797848:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593871104 00010000:00010000:0.0:1746143753.797874:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa400/0xe984082ccd72dd99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65aa expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00000100:00100000:0.0:1746143753.797895:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6726 00000100:00100000:0.0:1746143753.797900:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593871104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.797911:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.797930:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa400/0xe984082ccd72dd99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65aa expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.797939:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa400/0xe984082ccd72dd99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65aa expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.797972:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a21fa400/0xe984082ccd72dd99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65aa expref: 7 pid: 8495 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.797985:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143753.798854:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593871104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 952us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143753.798861:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6726 00000100:00100000:0.0:1746143753.800592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.802827:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.802857:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.802928:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.802957:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593871744 00000100:00100000:0.0:1746143753.802966:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593871744 00002000:00100000:0.0:1746143753.803011:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012b7cca80 x1830963593871744/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.803021:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cca80 with x1830963593871744 ext(0->1048575) 00002000:00010000:0.0:1746143753.803026:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cca80 00000100:00100000:0.0:1746143753.803045:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5872 00000100:00100000:0.0:1746143753.803051:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963593871744:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143753.814288:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6729 00000100:00100000:0.0:1746143753.814309:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963593871872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143753.814322:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143753.814323:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6731 00000100:00100000:1.0:1746143753.814332:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800955b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593872000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.814339:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143753.814343:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72deb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6636 expref: 11 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.814350:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801314e8e00/0xe984082ccd72ddae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65c6 expref: 6 pid: 8496 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.814522:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72deb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6636 expref: 11 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.814543:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72deb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6636 expref: 11 pid: 15784 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.814561:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801314e8e00/0xe984082ccd72ddae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65c6 expref: 6 pid: 8496 timeout: 932 lvb_type: 1 00010000:00010000:0.0:1746143753.814747:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143753.814756:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801314e8e00/0xe984082ccd72ddae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65c6 expref: 6 pid: 8496 timeout: 932 lvb_type: 1 00010000:00010000:1.0:1746143753.814777:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.814779:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143753.814788:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593871872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 483us (709us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143753.814790:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014d600/0xe984082ccd72e04e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a672b expref: 20 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.814797:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014d600/0xe984082ccd72e04e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4038655) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a672b expref: 20 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143753.814797:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6729 00010000:00010000:1.0:1746143753.814832:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014d600/0xe984082ccd72e04e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4038655) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a672b expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.814844:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594245760:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143753.814913:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a58233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.816251:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.825823:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963593871744:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22759us (22881us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143753.825836:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5872 00002000:00100000:1.0:1746143753.825850:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012b7cca80 x1830963593871744/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.825860:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cca80 with x1830963593871744 ext(0->1048575) 00002000:00010000:1.0:1746143753.825866:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cca80 00000100:00100000:1.0:1746143753.827048:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594245760:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.827069:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.827095:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800955b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593872000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12765us (12926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.827104:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6731 00000100:00100000:0.0:1746143753.835061:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.835186:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593872896 00000100:00100000:1.0:1746143753.835197:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593872896 00002000:00100000:1.0:1746143753.835242:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3866624->3870719) req@ffff88012b7cdc00 x1830963593872896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.835385:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdc00 with x1830963593872896 ext(3866624->3870719) 00002000:00010000:1.0:1746143753.835392:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cdc00 00000100:00100000:1.0:1746143753.836578:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5875 00000100:00100000:1.0:1746143753.836590:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963593872896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143753.836783:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963593872896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 196us (1734us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143753.836791:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5875 00002000:00100000:1.0:1746143753.836797:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3866624->3870719) req@ffff88012b7cdc00 x1830963593872896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143753.836805:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdc00 with x1830963593872896 ext(3866624->3870719) 00002000:00010000:1.0:1746143753.836809:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cdc00 00000100:00100000:0.0:1746143753.839506:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.842005:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.842675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.842715:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.843437:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5879 00000100:00100000:1.0:1746143753.843447:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963593873920:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143753.844925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.845201:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593874176 00000100:00100000:0.0:1746143753.845207:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593874176 00002000:00100000:0.0:1746143753.845237:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b7cf480 x1830963593874176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/0 e 0 to 0 dl 1746143764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.845245:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf480 with x1830963593874176 ext(3145728->4194303) 00002000:00010000:0.0:1746143753.845249:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cf480 00000100:00100000:0.0:1746143753.845275:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5880 00000100:00100000:0.0:1746143753.845281:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963593874176:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143753.851613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.851789:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.854526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.859341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.862510:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963593873920:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19052us (19781us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143753.862521:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5879 00002000:00100000:0.0:1746143753.862532:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012b7ce680 x1830963593873920/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:149/0 lens 488/440 e 0 to 0 dl 1746143764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143753.862547:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ce680 with x1830963593873920 ext(2097152->3145727) 00002000:00010000:0.0:1746143753.862554:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7ce680 00000100:00100000:0.0:1746143753.870412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.875110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.883597:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.884212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.889000:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.889038:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.889049:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593876096 00000100:00100000:1.0:1746143753.889058:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593876096 00000100:00100000:0.0:1746143753.889078:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143753.889096:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 22 pid: 9527 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.889125:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6732 00000100:00100000:1.0:1746143753.889132:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963593876096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.889160:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143753.889182:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 23 pid: 9527 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.889199:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2076671) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 24 pid: 9527 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.889219:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6a00/0xe984082ccd72df44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2076671) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66a6 expref: 24 pid: 9527 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.889233:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.889235:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.889243:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72e055 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6732 expref: 9 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.889250:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72e055 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6732 expref: 9 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.889279:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72e055 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6732 expref: 9 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.889286:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594246400:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143753.889551:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a58233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143753.891852:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594246272:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143753.891882:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc000/0xe984082ccd72e06a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6747 expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.891894:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc000/0xe984082ccd72e06a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6747 expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143753.891917:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dc000, rc 0) 00000100:00100000:0.0:1746143753.891956:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963593876224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2758us (2915us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143753.891963:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12727 00000100:00100000:1.0:1746143753.895519:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594246400:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.895541:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.895600:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963593876096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6467us (6608us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.895612:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6732 00000100:00100000:0.0:1746143753.895920:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.895955:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.896764:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.918573:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.921325:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.935889:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143753.936004:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593877376 00000100:00100000:1.0:1746143753.936014:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593877376 00010000:00010000:1.0:1746143753.936176:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014d600/0xe984082ccd72e04e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3866624->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a672b expref: 24 pid: 9527 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143753.936205:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6733 00000100:00100000:1.0:1746143753.936214:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963593877376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143753.936232:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143753.936254:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143750 -> 1746143753 00002000:00010000:1.0:1746143753.936257:0:7151:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143750 -> 1746143753 00002000:00010000:1.0:1746143753.936259:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143751 -> 1746143753 00010000:00010000:1.0:1746143753.936264:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014d600/0xe984082ccd72e04e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4038655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a672b expref: 24 pid: 9527 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.936276:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014d600/0xe984082ccd72e04e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4038655) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a672b expref: 24 pid: 9527 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.936312:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014d600/0xe984082ccd72e04e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3866624->4038655) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a672b expref: 24 pid: 9527 timeout: 932 lvb_type: 0 00010000:00010000:1.0:1746143753.936397:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.936399:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143753.936408:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a07dde00/0xe984082ccd72e07f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a675c expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.936416:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07dde00/0xe984082ccd72e07f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a675c expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143753.936460:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a07dde00/0xe984082ccd72e07f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a675c expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143753.936473:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594246784:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143753.936663:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143753.938092:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594246784:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143753.938108:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143753.938174:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963593877376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1960us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143753.938185:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6733 00000100:00100000:0.0:1746143753.942870:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.942925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.988815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143753.999404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.000519:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.000553:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.000650:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593878272 00000100:00100000:1.0:1746143754.000654:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593878272 00010000:00010000:1.0:1746143754.000672:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6800/0xe984082ccd72e040 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6724 expref: 253 pid: 14762 timeout: 932 lvb_type: 0 00000100:00100000:1.0:1746143754.000699:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593878528 00000100:00100000:1.0:1746143754.000701:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593878528 00010000:00010000:1.0:1746143754.000712:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e92200/0xe984082ccd72dfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66de expref: 9 pid: 14762 timeout: 932 lvb_type: 0 00000100:00100000:0.0:1746143754.009315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143754.010169:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143754.015358:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594247296:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143754.015369:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594247424:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143754.015374:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594247552:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143754.015401:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [274432->462847] (req 274432->462847) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.015417:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dc000, rc 0) 00000100:00100000:0.0:1746143754.015468:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:30936:x1830963593878656:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5672us (6175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.015475:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12731 00000100:00100000:0.0:1746143754.016198:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593878784 00000100:00100000:0.0:1746143754.016204:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593878784 00010000:00010000:0.0:1746143754.016319:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0694600/0xe984082ccd72de8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6613 expref: 10 pid: 15784 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143754.016856:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593879040 00000100:00100000:1.0:1746143754.016860:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593879040 00010000:00010000:1.0:1746143754.016876:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800955b3600/0xe984082ccd72de64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65e9 expref: 19 pid: 25369 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143754.017066:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6737 00000100:00100000:0.0:1746143754.017073:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593878784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.017321:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.017347:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0694600/0xe984082ccd72de8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6613 expref: 10 pid: 15784 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143754.017358:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0694600/0xe984082ccd72de8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6613 expref: 10 pid: 15784 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143754.017381:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0694600/0xe984082ccd72de8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6613 expref: 10 pid: 15784 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143754.017405:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.017438:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963593878784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 365us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.017443:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6737 00000100:00100000:1.0:1746143754.017533:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593878912 00000100:00100000:1.0:1746143754.017537:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593878912 00010000:00010000:1.0:1746143754.017569:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65a3 expref: 7 pid: 8495 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143754.017590:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6738 00000100:00100000:1.0:1746143754.017596:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963593879040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.017602:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.017611:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800955b3600/0xe984082ccd72de64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65e9 expref: 19 pid: 25369 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.017618:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800955b3600/0xe984082ccd72de64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65e9 expref: 19 pid: 25369 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.017629:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800955b3600/0xe984082ccd72de64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65e9 expref: 19 pid: 25369 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.017640:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.017656:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963593879040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.017661:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6738 00000100:00100000:1.0:1746143754.017671:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6739 00000100:00100000:1.0:1746143754.017682:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593878912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.017688:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.017695:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65a3 expref: 7 pid: 8495 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.017703:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65a3 expref: 7 pid: 8495 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.017713:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a21fb800/0xe984082ccd72dd92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a65a3 expref: 7 pid: 8495 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.017722:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.017723:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.017730:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->462847) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.017737:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->462847) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.017768:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->462847) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.017780:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594247680:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143754.017824:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5823240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.021185:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594247680:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143754.021207:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.021642:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593878912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3956us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.021654:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6739 00000100:00100000:0.0:1746143754.021885:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.089840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.096995:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.097587:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12732 00000100:00100000:1.0:1746143754.097598:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:30939:x1830963593879680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143754.097616:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.097636:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72e0c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6778 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.097666:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.097675:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72df75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66c2 expref: 5 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.097682:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014dc00/0xe984082ccd72defe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a667c expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.097688:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.097690:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.097693:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72e0c5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3624960->3747839] (req 3624960->3747839) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6778 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.097726:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014dc00/0xe984082ccd72defe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a667c expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.097737:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a014dc00/0xe984082ccd72defe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a667c expref: 17 pid: 12618 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.097749:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594247808:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.097864:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72df75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66c2 expref: 5 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.097873:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72df75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66c2 expref: 5 pid: 8495 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143754.097882:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594247936:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.097922:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.097928:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 10 pid: 12618 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.097936:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594248064:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.097954:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.100212:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594247808:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.101175:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594247936:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.101185:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594248064:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.101215:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72e0c5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3624960->3747839] (req 3624960->3747839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6778 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.101235:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938baa00, rc 0) 00000100:00100000:1.0:1746143754.101279:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:30939:x1830963593879680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3682us (4292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.101287:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12732 00000100:00100000:0.0:1746143754.103909:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.103959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.104524:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593879936 00000100:00100000:1.0:1746143754.104534:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593879936 00010000:00010000:1.0:1746143754.104572:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 10 pid: 12618 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.104607:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6740 00000100:00100000:1.0:1746143754.104615:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963593879936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.104727:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.104751:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 10 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.104887:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 10 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.105058:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130ee7000/0xe984082ccd72def0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a666e expref: 10 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.105393:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.105438:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593879936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 823us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.105444:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6740 00000100:00100000:0.0:1746143754.107766:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.118046:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.127191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.128008:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593880576 00000100:00100000:0.0:1746143754.128018:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593880576 00002000:00100000:0.0:1746143754.128064:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3743744->3747839) req@ffff88009e5ce680 x1830963593880576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.128073:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ce680 with x1830963593880576 ext(3743744->3747839) 00002000:00010000:0.0:1746143754.128079:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5ce680 00000100:00100000:0.0:1746143754.128101:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5890 00000100:00100000:0.0:1746143754.128108:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593880576:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143754.128284:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593880832 00000100:00100000:1.0:1746143754.128288:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593880832 00000100:00100000:1.0:1746143754.128340:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9035 00000100:00100000:1.0:1746143754.128345:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:30942:x1830963593880832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.128360:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.128381:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72e0cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a677f expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.128470:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128484:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128495:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128507:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128512:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128517:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128612:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd72e0e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128621:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd72e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128627:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd72e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143754.128635:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143754.128710:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128717:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128723:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128731:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143754.128735:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128741:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128751:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143754.128753:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143754.128757:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128762:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e0d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128782:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128788:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128792:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128796:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143754.128798:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128803:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128809:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009322ff00) 00010000:00010000:1.0:1746143754.128811:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143754.128814:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128818:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb400/0xe984082ccd72e0da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.128854:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72e0cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a677f expref: 255 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.128864:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd72e0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a677f expref: 254 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.128869:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143754.128871:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143754.128874:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bac00, rc 0) 00000100:00100000:1.0:1746143754.128919:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:30942:x1830963593880832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 573us (1738us total) trans 8589943317 rc 0/0 00000100:00100000:1.0:1746143754.128925:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9035 00000100:00100000:0.0:1746143754.130084:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593880576:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1971us (2736us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143754.130093:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5890 00002000:00100000:0.0:1746143754.130101:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3743744->3747839) req@ffff88009e5ce680 x1830963593880576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.130110:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ce680 with x1830963593880576 ext(3743744->3747839) 00002000:00010000:0.0:1746143754.130114:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5ce680 00000100:00100000:0.0:1746143754.132989:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.137129:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.145575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.145611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.148569:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593881600 00000100:00100000:1.0:1746143754.148582:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593881600 00000100:00100000:0.0:1746143754.149108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.150847:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593881728 00000100:00100000:1.0:1746143754.150856:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593881728 00000100:00100000:1.0:1746143754.150899:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12734 00000100:00100000:1.0:1746143754.150906:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963593881600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.150921:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.150934:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938ba400/0xe984082ccd72e0f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a678d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.150980:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594248448:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143754.151054:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.151234:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594248320:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143754.151256:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc200/0xe984082ccd72e0ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6786 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.151265:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc200/0xe984082ccd72e0ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6786 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.151277:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dc200, rc 0) 00000100:00100000:1.0:1746143754.151305:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593881472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2650us (5692us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143754.151310:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12733 00000100:00100000:1.0:1746143754.158077:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594248448:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143754.158111:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938ba400/0xe984082ccd72e0f6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a678d expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.158125:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938ba400/0xe984082ccd72e0f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a678d expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.158176:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba400, rc 0) 00000100:00100000:1.0:1746143754.158229:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963593881600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7322us (12661us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143754.158238:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12734 00000100:00100000:0.0:1746143754.164082:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.171880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.179482:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.179526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.208096:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.208912:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.208931:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593883008 00000100:00100000:1.0:1746143754.208934:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593883008 00000100:00100000:1.0:1746143754.208960:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9037 00000100:00100000:1.0:1746143754.208966:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:30948:x1830963593883008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.208980:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.208992:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e12e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a67a9 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.209095:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209113:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209124:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209166:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209172:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209178:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209300:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72e143 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209309:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72e143 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209314:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72e143 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143754.209324:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143754.209404:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209411:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209416:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209422:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143754.209425:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209431:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209442:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143754.209444:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143754.209448:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209452:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72e135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209467:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209472:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209476:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209483:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143754.209484:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209488:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209493:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009322f600) 00010000:00010000:1.0:1746143754.209495:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143754.209497:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209502:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72e13c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143754.209536:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72e12e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a9 expref: 19 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.209551:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72e143 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a9 expref: 18 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.209557:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143754.209559:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143754.209561:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba400, rc 0) 00000100:00100000:1.0:1746143754.209585:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:30948:x1830963593883008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 619us (673us total) trans 8589943322 rc 0/0 00000100:00100000:1.0:1746143754.209591:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9037 00000100:00100000:1.0:1746143754.222344:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.222380:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.222754:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.222818:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593883520 00000100:00100000:0.0:1746143754.222823:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593883520 00000100:00100000:0.0:1746143754.222859:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 715 00000100:00100000:0.0:1746143754.222866:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963593883520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.222875:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.222898:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72e143 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a9 expref: 19 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.222920:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143754.222925:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.222942:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963593883520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.222947:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 715 00000100:00080000:0.0:1746143754.223992:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143754.226960:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.227003:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.241865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.274051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.274090:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.274130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.274200:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593884288 00000100:00100000:0.0:1746143754.274207:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593884288 00000100:00100000:0.0:1746143754.274247:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12740 00000100:00100000:0.0:1746143754.274253:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:30944:x1830963593884288:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143754.274268:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.274283:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2120a00/0xe984082ccd72e166 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a67c5 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.274310:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593884160 00000100:00100000:1.0:1746143754.274315:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593884160 00010000:00010000:0.0:1746143754.274319:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.274327:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.274337:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.274339:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.274342:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2120a00/0xe984082ccd72e166 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1372160->1961983] (req 1372160->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67c5 expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143754.274347:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (274432->462847) req@ffff880094c10e00 x1830963593884160/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.274357:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963593884160 ext(274432->462847) 00010000:00010000:1.0:1746143754.274363:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->462847) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 19 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.274368:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.274374:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->462847) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 19 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.274379:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 9 pid: 6929 timeout: 933 lvb_type: 1 00002000:00010000:1.0:1746143754.274380:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c10e00 00000100:00100000:0.0:1746143754.274390:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594249088:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.274400:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1677 00000100:00100000:1.0:1746143754.274406:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963593884160:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:0.0:1746143754.274447:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.274454:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7eb000/0xe984082ccd72dffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6701 expref: 19 pid: 9527 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143754.274461:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594249216:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143754.274493:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.280187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.280213:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593884416 00000100:00100000:0.0:1746143754.280221:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593884416 00010000:00010000:0.0:1746143754.280255:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 10 pid: 6929 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143754.280300:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6744 00000100:00100000:0.0:1746143754.280309:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963593884416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.280323:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.280347:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 10 pid: 6929 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143754.280358:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 10 pid: 6929 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143754.280380:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7eac00/0xe984082ccd72e01d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6716 expref: 10 pid: 6929 timeout: 933 lvb_type: 1 00010000:00010000:0.0:1746143754.280411:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.280446:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963593884416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 139us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.280453:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6744 00000100:00100000:1.0:1746143754.281722:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963593884160:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7311us (7626us total) trans 21474840306 rc 0/0 00000100:00100000:1.0:1746143754.281731:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1677 00002000:00100000:1.0:1746143754.281741:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (274432->462847) req@ffff880094c10e00 x1830963593884160/t21474840306(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/448 e 0 to 0 dl 1746143765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.281750:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963593884160 ext(274432->462847) 00010000:00010000:1.0:1746143754.281758:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->462847) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 20 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.281767:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72e09b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 274432->462847) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a676a expref: 20 pid: 12618 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143754.281774:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c10e00 00000100:00100000:0.0:1746143754.283024:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.292045:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593884800 00000100:00100000:1.0:1746143754.292056:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593884800 00002000:00100000:1.0:1746143754.292107:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009e5cd500 x1830963593884800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.292118:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cd500 with x1830963593884800 ext(1048576->2097151) 00002000:00010000:1.0:1746143754.292122:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cd500 00000100:00100000:1.0:1746143754.292156:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593885056 00000100:00100000:1.0:1746143754.292159:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593885056 00002000:00100000:1.0:1746143754.292171:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009e5cd180 x1830963593885056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.292177:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cd180 with x1830963593885056 ext(1048576->2097151) 00002000:00010000:1.0:1746143754.292180:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cd180 00000100:00100000:1.0:1746143754.292199:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5892 00000100:00100000:1.0:1746143754.292207:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593884800:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143754.293620:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5894 00000100:00100000:1.0:1746143754.293629:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963593885312:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143754.293722:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963593885312:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 94us (1610us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143754.293728:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5894 00002000:00100000:1.0:1746143754.293734:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1372160->1376255) req@ffff88009e5cc700 x1830963593885312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.293748:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc700 with x1830963593885312 ext(1372160->1376255) 00002000:00010000:1.0:1746143754.293752:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cc700 00000100:00100000:0.0:1746143754.314510:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.316598:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963593884800:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 24390us (24615us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143754.316608:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5892 00002000:00100000:1.0:1746143754.316617:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009e5cd500 x1830963593884800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/440 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.316627:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cd500 with x1830963593884800 ext(1048576->2097151) 00002000:00010000:1.0:1746143754.316631:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cd500 00000100:00100000:1.0:1746143754.326366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.326456:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.327591:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.327945:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5896 00000100:00100000:1.0:1746143754.327954:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963593885952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143754.336881:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963593886208:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7976us (9279us total) trans 0 rc 147456/147456 00000100:00100000:0.0:1746143754.336896:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5897 00002000:00100000:0.0:1746143754.336909:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1949696->2097151) req@ffff88008f3cb480 x1830963593886208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/440 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 147456/147456 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.336918:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb480 with x1830963593886208 ext(1949696->2097151) 00002000:00010000:0.0:1746143754.336926:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb480 00000100:00100000:1.0:1746143754.345350:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963593885952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17385us (18882us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143754.345369:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5896 00002000:00100000:1.0:1746143754.345382:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88008f3c8380 x1830963593885952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/440 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.345397:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8380 with x1830963593885952 ext(0->1048575) 00002000:00010000:1.0:1746143754.345403:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8380 00000100:00100000:0.0:1746143754.351101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.354898:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.354965:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593886464 00000100:00100000:1.0:1746143754.354972:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593886464 00002000:00100000:1.0:1746143754.355015:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3624960->3747839) req@ffff880094c11500 x1830963593886464/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.355024:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963593886464 ext(3624960->3747839) 00010000:00010000:1.0:1746143754.355030:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72e0c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6778 expref: 9 pid: 9527 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.355041:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72e0c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6778 expref: 9 pid: 9527 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143754.355047:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11500 00000100:00100000:1.0:1746143754.355075:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1678 00000100:00100000:1.0:1746143754.355082:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963593886464:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143754.357635:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963593886464:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2545us (2730us total) trans 21474840307 rc 0/0 00000100:00100000:1.0:1746143754.357646:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1678 00002000:00100000:1.0:1746143754.357656:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3624960->3747839) req@ffff880094c11500 x1830963593886464/t21474840307(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/448 e 0 to 0 dl 1746143765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.357664:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963593886464 ext(3624960->3747839) 00010000:00010000:1.0:1746143754.357672:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72e0c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6778 expref: 11 pid: 9527 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.357684:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800938baa00/0xe984082ccd72e0c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3624960->3747839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6778 expref: 11 pid: 9527 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143754.357690:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c11500 00000100:00100000:0.0:1746143754.358076:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.362367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.365613:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.365702:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593886976 00000100:00100000:1.0:1746143754.365719:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593886976 00002000:00100000:1.0:1746143754.365770:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094c10700 x1830963593886976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.365781:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10700 with x1830963593886976 ext(1048576->2097151) 00002000:00010000:1.0:1746143754.365786:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10700 00000100:00100000:1.0:1746143754.365828:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5898 00000100:00100000:1.0:1746143754.365836:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963593886976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143754.382471:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.382500:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.383265:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5900 00000100:00100000:0.0:1746143754.383276:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963593887360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143754.385743:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.394439:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.397566:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.397592:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593888384 00000100:00100000:0.0:1746143754.397598:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593888384 00000100:00100000:0.0:1746143754.397641:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12743 00000100:00100000:0.0:1746143754.397648:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:30948:x1830963593888384:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143754.397666:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.397680:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a67e1 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.397706:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2120a00/0xe984082ccd72e166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67c5 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.397714:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143754.397716:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143754.397719:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 11 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.397752:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2120a00/0xe984082ccd72e166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67c5 expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.397763:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2120a00/0xe984082ccd72e166 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67c5 expref: 22 pid: 12618 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143754.397776:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136b9f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594249984:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143754.397839:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.435803:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.435917:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.445225:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.450829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.450915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.461116:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.463868:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.470733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.470779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.475597:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.475620:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593890304 00000100:00100000:0.0:1746143754.475627:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593890304 00000100:00100000:0.0:1746143754.475675:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12746 00000100:00100000:0.0:1746143754.475681:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:30948:x1830963593890304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143754.477739:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.477760:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff97400/0xe984082ccd72e1d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a67fd expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.477788:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.477791:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.477800:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97400/0xe984082ccd72e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67fd expref: 12 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.477818:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff97400/0xe984082ccd72e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67fd expref: 12 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.477829:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff97400, rc 0) 00000100:00100000:0.0:1746143754.477903:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:30948:x1830963593890304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2218us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.477911:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12746 00000100:00100000:0.0:1746143754.485920:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.491004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.491039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.491076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.526500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.527333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.527744:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593891200 00000100:00100000:1.0:1746143754.527750:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593891200 00010000:00010000:1.0:1746143754.527771:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97400/0xe984082ccd72e1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67fd expref: 13 pid: 4581 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.528686:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6750 00000100:00100000:1.0:1746143754.528694:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963593891200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.528703:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.528722:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff97400/0xe984082ccd72e1d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67fd expref: 13 pid: 4581 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.528731:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff97400/0xe984082ccd72e1d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67fd expref: 13 pid: 4581 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.528744:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff97400/0xe984082ccd72e1d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67fd expref: 13 pid: 4581 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.528770:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.528772:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.528778:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.528785:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.528806:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.529222:0:9890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 21 pid: 4581 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.529235:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594250624:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143754.529819:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.531930:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594250624:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143754.531956:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.532021:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963593891200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3325us (4685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.532031:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6750 00000100:00100000:0.0:1746143754.536915:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.541383:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.547722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.554794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.556298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.556449:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593892352 00000100:00100000:1.0:1746143754.556454:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593892352 00010000:00010000:1.0:1746143754.556473:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 24 pid: 4581 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.556491:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6751 00000100:00100000:1.0:1746143754.556496:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963593892352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.556504:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143754.556516:0:9890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143753 -> 1746143754 00002000:00010000:1.0:1746143754.556518:0:9890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143753 -> 1746143754 00010000:00010000:1.0:1746143754.556523:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 24 pid: 4581 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.556531:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 24 pid: 4581 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.556549:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd72e1dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3805183) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6804 expref: 24 pid: 4581 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.556574:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.556576:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.556585:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd72e1e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a680b expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.556594:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd72e1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a680b expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.556618:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd72e1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a680b expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.556628:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594250880:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143754.557645:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.560322:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.562369:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594250880:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143754.562382:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.562416:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963593892352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5914us (6123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.562424:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6751 00000100:00100000:0.0:1746143754.563076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.563119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.563208:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593892992 00000100:00100000:1.0:1746143754.563217:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593892992 00000100:00100000:1.0:1746143754.563243:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12749 00000100:00100000:1.0:1746143754.563249:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:30951:x1830963593892992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143754.563261:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.563277:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6819 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.563310:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc400/0xe984082ccd72e127 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a2 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.563319:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6d800/0xe984082ccd72e174 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67d3 expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.563325:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.563326:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.563329:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1826816->2097151] (req 1826816->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.563354:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6d800/0xe984082ccd72e174 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67d3 expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.563363:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6d800/0xe984082ccd72e174 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67d3 expref: 14 pid: 12618 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.563373:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594251008:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.563432:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc400/0xe984082ccd72e127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a2 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.563444:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc400/0xe984082ccd72e127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a2 expref: 24 pid: 6929 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.563457:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594251136:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.563479:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.564800:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.564885:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593893120 00000100:00100000:1.0:1746143754.564889:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593893120 00010000:00010000:1.0:1746143754.564907:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07ddc00/0xe984082ccd72e08d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6763 expref: 260 pid: 14763 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.564927:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6752 00000100:00100000:1.0:1746143754.564933:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1964:x1830963593893120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.564942:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.564947:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07ddc00/0xe984082ccd72e08d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6763 expref: 260 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.564955:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07ddc00/0xe984082ccd72e08d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6763 expref: 260 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.564972:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07ddc00/0xe984082ccd72e08d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6763 expref: 260 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.564983:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143754.564987:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd72e200 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143754.564994:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd72e200 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143754.565000:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd72e200 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143754.565013:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.565033:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1964:x1830963593893120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.565039:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6752 00000100:00100000:0.0:1746143754.568995:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569182:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593893504 00000100:00100000:0.0:1746143754.569187:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593893504 00000100:00100000:0.0:1746143754.569215:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12750 00000100:00100000:0.0:1746143754.569221:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593893504:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143754.569236:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.569248:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff97e00/0xe984082ccd72e20e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6820 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.569265:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569267:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569274:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97e00/0xe984082ccd72e20e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6820 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569298:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff97e00/0xe984082ccd72e20e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6820 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569308:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff97e00, rc 0) 00000100:00100000:0.0:1746143754.569333:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593893504:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 112us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.569338:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12750 00000100:00100000:0.0:1746143754.569372:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569380:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593893632 00000100:00100000:0.0:1746143754.569382:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593893632 00000100:00100000:0.0:1746143754.569400:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12751 00000100:00100000:0.0:1746143754.569405:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593893632:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143754.569411:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.569418:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0xe984082ccd72e215 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6827 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.569432:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569439:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0xe984082ccd72e215 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6827 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569447:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0xe984082ccd72e215 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6827 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569457:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff96a00, rc 0) 00000100:00100000:0.0:1746143754.569469:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593893632:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 64us (97us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143754.569474:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12751 00000100:00080000:0.0:1746143754.569486:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143754.569511:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569520:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593893760 00000100:00100000:0.0:1746143754.569522:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593893760 00000100:00100000:0.0:1746143754.569532:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12752 00000100:00100000:0.0:1746143754.569536:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593893760:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143754.569541:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.569546:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff96400/0xe984082ccd72e21c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a682e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.569554:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569555:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569559:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96400/0xe984082ccd72e21c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a682e expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569567:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff96400/0xe984082ccd72e21c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a682e expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569573:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff96400, rc 0) 00000100:00100000:0.0:1746143754.569585:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593893760:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 49us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.569589:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12752 00000100:00100000:0.0:1746143754.569616:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569624:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593893888 00000100:00100000:0.0:1746143754.569626:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593893888 00000100:00100000:0.0:1746143754.569637:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12753 00000100:00100000:0.0:1746143754.569641:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593893888:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143754.569646:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.569651:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6835 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.569660:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569661:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569665:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569672:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569678:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff97800, rc 0) 00000100:00100000:0.0:1746143754.569689:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593893888:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 48us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.569693:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12753 00000100:00100000:0.0:1746143754.569717:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569724:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593894016 00000100:00100000:0.0:1746143754.569726:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593894016 00000100:00100000:0.0:1746143754.569736:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12754 00000100:00100000:0.0:1746143754.569740:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593894016:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143754.569745:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.569751:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72e22a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a683c expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.569758:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569760:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569763:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a683c expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569771:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a683c expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569776:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130ee7400, rc 0) 00000100:00100000:0.0:1746143754.569787:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593894016:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 47us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.569792:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12754 00000100:00100000:0.0:1746143754.569824:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.569832:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593894144 00000100:00100000:0.0:1746143754.569834:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593894144 00000100:00100000:0.0:1746143754.569846:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12755 00000100:00100000:0.0:1746143754.569849:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593894144:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143754.569854:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.569860:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130ee6400/0xe984082ccd72e231 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6843 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.569868:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569869:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.569872:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130ee6400/0xe984082ccd72e231 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6843 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569880:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130ee6400/0xe984082ccd72e231 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6843 expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.569886:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130ee6400, rc 0) 00000100:00100000:0.0:1746143754.569896:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593894144:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 46us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.569900:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12755 00000100:00100000:1.0:1746143754.570047:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594251008:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.570057:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594251136:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.570074:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1826816->2097151] (req 1826816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.570083:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093213400, rc 0) 00000100:00100000:1.0:1746143754.570100:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:30951:x1830963593892992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6852us (6982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.570106:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12749 00000100:00100000:1.0:1746143754.570127:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593893376 00000100:00100000:1.0:1746143754.570130:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593893376 00010000:00010000:1.0:1746143754.570160:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc400/0xe984082ccd72e127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a2 expref: 25 pid: 6929 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.570175:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593893248 00000100:00100000:1.0:1746143754.570177:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593893248 00010000:00010000:1.0:1746143754.570183:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6d800/0xe984082ccd72e174 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67d3 expref: 14 pid: 12618 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.570194:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6753 00000100:00100000:1.0:1746143754.570198:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963593893376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.570205:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.570222:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc400/0xe984082ccd72e127 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a2 expref: 25 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.570229:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc400/0xe984082ccd72e127 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a2 expref: 25 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.570242:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07dc400/0xe984082ccd72e127 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67a2 expref: 25 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.570250:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.570263:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963593893376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.570271:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6753 00000100:00100000:1.0:1746143754.570281:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6754 00000100:00100000:1.0:1746143754.570295:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963593893248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.570302:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.570308:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6d800/0xe984082ccd72e174 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67d3 expref: 14 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.570317:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6d800/0xe984082ccd72e174 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67d3 expref: 14 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.570327:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e6d800/0xe984082ccd72e174 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67d3 expref: 14 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.570334:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.570335:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.570339:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.570346:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.570366:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.570376:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594251264:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143754.570423:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.576372:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594251264:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143754.576394:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.576435:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963593893248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6148us (7414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.576445:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6754 00000100:00100000:0.0:1746143754.578244:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.585283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.585361:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593894912 00000100:00100000:1.0:1746143754.585367:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593894912 00000100:00100000:0.0:1746143754.585375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143754.585394:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd72e200 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6812 expref: 11 pid: 14763 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.585625:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6755 00000100:00100000:1.0:1746143754.585632:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963593894912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.585643:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.585649:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd72e200 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6812 expref: 11 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.585659:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd72e200 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6812 expref: 11 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.585675:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af200/0xe984082ccd72e200 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6812 expref: 11 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.585801:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143754.585805:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57afe00/0xe984082ccd72e23f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143754.586071:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57afe00/0xe984082ccd72e23f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143754.586082:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57afe00/0xe984082ccd72e23f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143754.586095:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.586127:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963593894912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 495us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.586133:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6755 00000100:00100000:0.0:1746143754.589312:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.589356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.589914:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593895168 00000100:00100000:1.0:1746143754.589917:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593895168 00002000:00100000:1.0:1746143754.589942:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff8800930d1c00 x1830963593895168/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.589949:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1c00 with x1830963593895168 ext(4194304->4755455) 00002000:00010000:1.0:1746143754.589953:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1c00 00000100:00100000:1.0:1746143754.589964:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5907 00000100:00100000:1.0:1746143754.589968:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963593895168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143754.590168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.592044:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.594033:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.596431:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963593895168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6457us (7122us total) trans 0 rc 561152/561152 00000100:00100000:1.0:1746143754.596439:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5907 00002000:00100000:1.0:1746143754.596447:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff8800930d1c00 x1830963593895168/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/440 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.596455:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1c00 with x1830963593895168 ext(4194304->4755455) 00002000:00010000:1.0:1746143754.596459:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1c00 00000100:00100000:0.0:1746143754.601821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.604941:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.605076:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593896320 00000100:00100000:1.0:1746143754.605083:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593896320 00002000:00100000:1.0:1746143754.605118:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1617920->1622015) req@ffff8800930d2300 x1830963593896320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.605130:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2300 with x1830963593896320 ext(1617920->1622015) 00002000:00010000:1.0:1746143754.605134:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d2300 00000100:00100000:1.0:1746143754.605707:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5908 00000100:00100000:1.0:1746143754.605715:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963593896320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143754.605857:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963593896320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 143us (919us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143754.605863:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5908 00002000:00100000:1.0:1746143754.605868:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1617920->1622015) req@ffff8800930d2300 x1830963593896320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.605875:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2300 with x1830963593896320 ext(1617920->1622015) 00002000:00010000:1.0:1746143754.605877:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d2300 00000100:00100000:0.0:1746143754.609931:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.672973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.717062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.717104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.717181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.717213:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593896960 00000100:00100000:0.0:1746143754.717220:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593896960 00000100:00100000:0.0:1746143754.717257:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593897088 00000100:00100000:0.0:1746143754.717259:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593897088 00000100:00100000:0.0:1746143754.717269:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593897216 00000100:00100000:0.0:1746143754.717271:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593897216 00000100:00100000:0.0:1746143754.717512:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12758 00000100:00100000:0.0:1746143754.717518:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963593897088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143754.717525:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.717532:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d52c00/0xe984082ccd72e28c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a686d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.717555:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594252160:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143754.717576:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.717723:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12759 00000100:00100000:1.0:1746143754.717730:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963593897216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.717738:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.717746:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd72e293 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6874 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.717757:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.717759:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.717766:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd72e293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6874 expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.717784:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd72e293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6874 expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.717798:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093212e00, rc 0) 00000100:00100000:1.0:1746143754.717818:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593897216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 89us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.717823:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12759 00002000:00010000:1.0:1746143754.724982:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143753 -> 1746143754 00002000:00010000:1.0:1746143754.724985:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143753 -> 1746143754 00002000:00010000:1.0:1746143754.724986:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143753 -> 1746143754 00000100:00100000:1.0:1746143754.724994:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594252160:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143754.725009:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d52c00/0xe984082ccd72e28c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a686d expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.725016:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d52c00/0xe984082ccd72e28c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a686d expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.725027:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d52c00, rc 0) 00000100:00100000:1.0:1746143754.725060:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963593897088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7541us (7955us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143754.725065:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12758 00000100:00100000:0.0:1746143754.728558:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.728890:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593897472 00000100:00100000:1.0:1746143754.728897:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593897472 00002000:00100000:1.0:1746143754.728930:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800930ded80 x1830963593897472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.728939:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ded80 with x1830963593897472 ext(0->1048575) 00002000:00010000:1.0:1746143754.728943:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ded80 00000100:00100000:1.0:1746143754.728991:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5909 00000100:00100000:1.0:1746143754.728997:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963593897472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143754.740585:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963593897472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11577us (12022us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143754.740595:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5909 00002000:00100000:1.0:1746143754.740608:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800930ded80 x1830963593897472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/440 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.740616:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ded80 with x1830963593897472 ext(0->1048575) 00002000:00010000:1.0:1746143754.740621:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ded80 00000100:00100000:0.0:1746143754.746751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.746832:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593897600 00000100:00100000:1.0:1746143754.746840:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593897600 00000100:00100000:1.0:1746143754.746887:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12760 00000100:00100000:1.0:1746143754.746894:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:30965:x1830963593897600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.746908:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.746922:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093213a00/0xe984082ccd72e29a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a687b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.746943:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.746949:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143754.746950:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143754.746953:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093213a00/0xe984082ccd72e29a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a687b expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.746977:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 12 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.746988:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 12 pid: 12618 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.746998:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594252288:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.749344:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00010000:00010000:1.0:1746143754.749895:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143754.750954:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594252288:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.750990:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093213a00/0xe984082ccd72e29a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a687b expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.751006:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093213a00, rc 0) 00000100:00100000:1.0:1746143754.751079:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:30965:x1830963593897600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4184us (4334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.751086:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12760 00000100:00100000:0.0:1746143754.752161:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.752222:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593897728 00000100:00100000:1.0:1746143754.752226:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593897728 00002000:00100000:1.0:1746143754.752254:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1826816->2097151) req@ffff8800930dc700 x1830963593897728/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.752263:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc700 with x1830963593897728 ext(1826816->2097151) 00010000:00010000:1.0:1746143754.752269:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 13 pid: 12618 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.752280:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093213400/0xe984082ccd72e207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1826816->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6819 expref: 13 pid: 12618 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143754.752300:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dc700 00000100:00100000:1.0:1746143754.752468:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1685 00000100:00100000:1.0:1746143754.752474:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963593897728:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143754.757710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.757797:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593897856 00000100:00100000:1.0:1746143754.757805:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593897856 00000100:00100000:1.0:1746143754.758869:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12761 00000100:00100000:1.0:1746143754.758878:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:30962:x1830963593897856:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143754.758890:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.758903:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6882 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.758926:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd72e1e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a680b expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.758934:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd72e293 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6874 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.758940:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72e22a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a683c expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.758945:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.758947:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.758950:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3293184->3895295] (req 3293184->3895295) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.758978:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a683c expref: 7 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.758987:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130ee7400/0xe984082ccd72e22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a683c expref: 7 pid: 4581 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143754.758997:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594252416:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.759064:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd72e293 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6874 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.759071:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093212e00/0xe984082ccd72e293 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6874 expref: 25 pid: 12618 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143754.759078:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594252544:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.759098:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd72e1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a680b expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.759105:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d400/0xe984082ccd72e1e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a680b expref: 11 pid: 4581 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.759111:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594252672:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.759125:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.763625:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594252416:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143754.765612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.765637:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594252544:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143754.765641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.765647:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594252672:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.765681:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3293184->3895295] (req 3293184->3895295) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.765695:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093213800, rc 0) 00000100:00100000:1.0:1746143754.765733:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:30962:x1830963593897856:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6855us (8029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.765739:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12761 00000100:00100000:0.0:1746143754.767908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.767934:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.773089:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594252800:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143754.773104:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.773124:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963593898112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5156us (5215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.773134:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6761 00000100:00100000:0.0:1746143754.780182:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.780220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.780875:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5912 00000100:00100000:0.0:1746143754.780881:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593899136:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143754.780994:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593899136:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 113us (773us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143754.780998:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5912 00002000:00100000:0.0:1746143754.781002:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3891200->3895295) req@ffff8800930dfb80 x1830963593899136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.781008:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dfb80 with x1830963593899136 ext(3891200->3895295) 00002000:00010000:0.0:1746143754.781010:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dfb80 00000100:00100000:0.0:1746143754.790230:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.799224:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.799270:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593899520 00000100:00100000:1.0:1746143754.799277:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593899520 00000100:00100000:1.0:1746143754.799882:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12762 00000100:00100000:1.0:1746143754.799890:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:30965:x1830963593899520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.799905:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.799917:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72e2a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6889 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.801369:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57afc00/0xe984082ccd72e246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6851 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.801375:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143754.801377:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143754.801380:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72e2a8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6889 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.801408:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57afc00/0xe984082ccd72e246 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6851 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.801419:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57afc00/0xe984082ccd72e246 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6851 expref: 13 pid: 8497 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.801430:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594253056:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.801511:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.808105:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.810435:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594253056:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.810459:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72e2a8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6889 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.810473:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6164a00, rc 0) 00000100:00100000:1.0:1746143754.810525:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:30965:x1830963593899520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10634us (11309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.810532:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12762 00000100:00100000:0.0:1746143754.833593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.835636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.842231:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.845977:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.847639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.852642:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.852676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.854225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.854262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.862243:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.862725:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6764 00000100:00100000:0.0:1746143754.862734:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:1962:x1830963593901696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.862746:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.862752:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af800/0xe984082ccd72e277 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a685f expref: 262 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.862761:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af800/0xe984082ccd72e277 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a685f expref: 262 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.863464:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a57af800/0xe984082ccd72e277 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a685f expref: 262 pid: 14763 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.863486:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143754.863494:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143754.863500:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143754.863505:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143754.863518:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.863541:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1962:x1830963593901696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 804us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.863546:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6764 00000100:00100000:0.0:1746143754.875808:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.875856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.882701:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.882738:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.882811:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593902464 00000100:00100000:1.0:1746143754.882819:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593902464 00002000:00100000:1.0:1746143754.882853:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094c0df80 x1830963593902464/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.882862:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0df80 with x1830963593902464 ext(2097152->3145727) 00002000:00010000:1.0:1746143754.882866:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0df80 00000100:00100000:1.0:1746143754.882894:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593902592 00000100:00100000:1.0:1746143754.882896:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593902592 00002000:00100000:1.0:1746143754.882907:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c0c000 x1830963593902592/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 504/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.882919:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c000 with x1830963593902592 ext(3145728->4194303) 00002000:00010000:1.0:1746143754.882921:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0c000 00000100:00100000:1.0:1746143754.882933:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5917 00000100:00100000:1.0:1746143754.882940:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963593902464:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143754.904803:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593902464:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21854us (22102us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143754.904812:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5917 00002000:00100000:1.0:1746143754.904821:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094c0df80 x1830963593902464/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/440 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.904829:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0df80 with x1830963593902464 ext(2097152->3145727) 00002000:00010000:1.0:1746143754.904834:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0df80 00000100:00100000:0.0:1746143754.907535:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.912119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.912215:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593902976 00000100:00100000:1.0:1746143754.912226:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593902976 00002000:00100000:1.0:1746143754.912270:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3293184->3895295) req@ffff880094c0ce00 x1830963593902976/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143754.912279:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ce00 with x1830963593902976 ext(3293184->3895295) 00010000:00010000:1.0:1746143754.912299:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 24 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.912311:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 24 pid: 6929 timeout: 933 lvb_type: 0 00002000:00010000:1.0:1746143754.912317:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0ce00 00000100:00100000:1.0:1746143754.912355:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1687 00000100:00100000:1.0:1746143754.912364:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963593902976:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143754.912892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.923487:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593902976:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11110us (11360us total) trans 21474840310 rc 0/0 00000100:00100000:0.0:1746143754.923502:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1687 00002000:00100000:0.0:1746143754.923515:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3293184->3895295) req@ffff880094c0ce00 x1830963593902976/t21474840310(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:150/0 lens 488/448 e 0 to 0 dl 1746143765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.923526:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ce00 with x1830963593902976 ext(3293184->3895295) 00010000:00010000:0.0:1746143754.923536:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 26 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.923552:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 26 pid: 6929 timeout: 933 lvb_type: 0 00002000:00010000:0.0:1746143754.923560:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0ce00 00000100:00100000:1.0:1746143754.930628:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.930701:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593903360 00000100:00100000:0.0:1746143754.930712:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593903360 00010000:00010000:0.0:1746143754.930751:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 27 pid: 6929 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143754.930788:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6766 00000100:00100000:0.0:1746143754.930796:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963593903360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143754.930808:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143754.930834:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 27 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.930852:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 27 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.930875:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093213800/0xe984082ccd72e2a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3293184->3895295) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6882 expref: 27 pid: 6929 timeout: 933 lvb_type: 0 00010000:00010000:0.0:1746143754.930952:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.930955:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.930963:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e15ce00/0xe984082ccd72e2fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68b3 expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.930969:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e15ce00/0xe984082ccd72e2fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68b3 expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.930977:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.930978:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.930980:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd72e30a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c1 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.930985:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd72e30a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c1 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.931014:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd72e30a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c1 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.931025:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594253952:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143754.931785:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e15ce00/0xe984082ccd72e2fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68b3 expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143754.931794:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594254080:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143754.931816:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.934559:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594253952:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143754.934568:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594254080:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143754.934588:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143754.934632:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593903360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3836us (4014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143754.934643:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6766 00000100:00100000:1.0:1746143754.934776:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593903488 00000100:00100000:1.0:1746143754.934783:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593903488 00000100:00100000:1.0:1746143754.934831:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12769 00000100:00100000:1.0:1746143754.934838:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:30971:x1830963593903488:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143754.934855:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.934871:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a68c8 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.934898:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72e2a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6889 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.934907:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf13600/0xe984082ccd72e2ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a689e expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.934913:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.934915:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.934918:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.934943:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf13600/0xe984082ccd72e2ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a689e expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.934954:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf13600/0xe984082ccd72e2ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a689e expref: 18 pid: 8495 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143754.934972:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254208:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.935023:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72e2a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6889 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.935030:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd72e2a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6889 expref: 24 pid: 6929 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.935038:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254336:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.935052:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.939970:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.940074:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254208:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.942397:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.942448:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1650688->2097151] (req 1650688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.942468:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91200, rc 0) 00000100:00100000:1.0:1746143754.942509:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:30971:x1830963593903488:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7671us (8837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.942517:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12769 00000100:00100000:0.0:1746143754.942954:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.943005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.945948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.945987:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.948848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.949088:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593904768 00000100:00100000:0.0:1746143754.949094:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593904768 00002000:00100000:0.0:1746143754.949127:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1650688->1654783) req@ffff88008f3cbb80 x1830963593904768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/0 e 0 to 0 dl 1746143765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.949137:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963593904768 ext(1650688->1654783) 00002000:00010000:0.0:1746143754.949160:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cbb80 00000100:00100000:0.0:1746143754.949180:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5922 00000100:00100000:0.0:1746143754.949186:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963593904768:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143754.949333:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963593904768:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 146us (488us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143754.949339:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5922 00002000:00100000:0.0:1746143754.949344:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1650688->1654783) req@ffff88008f3cbb80 x1830963593904768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746143765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143754.949352:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963593904768 ext(1650688->1654783) 00002000:00010000:0.0:1746143754.949355:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cbb80 00000100:00100000:0.0:1746143754.951545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.952210:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593904896 00000100:00100000:1.0:1746143754.952219:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593904896 00000100:00100000:1.0:1746143754.952364:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12770 00000100:00100000:1.0:1746143754.952375:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593904896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.952396:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.952416:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e90c00/0xe984082ccd72e318 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a68cf expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.952484:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254592:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143754.952556:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143754.959359:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254592:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143754.959390:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e90c00/0xe984082ccd72e318 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68cf expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.959404:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e90c00/0xe984082ccd72e318 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68cf expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143754.959428:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e90c00, rc 0) 00000100:00100000:1.0:1746143754.959454:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593904896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7082us (7918us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143754.959460:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12770 00000100:00100000:0.0:1746143754.965081:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.966041:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593905024 00000100:00100000:1.0:1746143754.966052:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593905024 00000100:00100000:1.0:1746143754.966098:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12771 00000100:00100000:1.0:1746143754.966105:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593905024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143754.966124:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143754.966156:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72e31f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a68d6 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.966218:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254720:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143754.967345:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.968235:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593905152 00000100:00100000:0.0:1746143754.968240:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593905152 00000100:00100000:0.0:1746143754.968273:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12772 00000100:00100000:0.0:1746143754.968279:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:30971:x1830963593905152:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143754.968301:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143754.968313:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a68dd expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.968337:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.968345:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.968423:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd72e1ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67ef expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.968434:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.968435:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143754.968439:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.968463:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd72e1ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67ef expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.968474:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6ca00/0xe984082ccd72e1ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67ef expref: 25 pid: 8495 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143754.968485:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594254848:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143754.968504:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594254720:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143754.968526:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72e31f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68d6 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.968544:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143754.968552:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 6 pid: 4581 timeout: 933 lvb_type: 1 00000100:00100000:0.0:1746143754.968560:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594254976:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143754.968584:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143754.968591:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 13 pid: 8495 timeout: 933 lvb_type: 0 00000100:00100000:0.0:1746143754.968604:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594255104:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143754.968607:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72e31f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68d6 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143754.968619:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143754.969196:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91600, rc 0) 00000100:00100000:1.0:1746143754.969224:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963593905024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3118us (4154us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143754.969232:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12771 00000100:00100000:0.0:1746143754.971981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.975073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143754.975109:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.975220:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593905792 00000100:00100000:1.0:1746143754.975228:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593905792 00010000:00010000:1.0:1746143754.975260:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 7 pid: 4581 timeout: 933 lvb_type: 1 00000100:00100000:1.0:1746143754.975296:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6770 00000100:00100000:1.0:1746143754.975303:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593905792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.975317:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.975340:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 7 pid: 4581 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.975350:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd72e223 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6835 expref: 7 pid: 4581 timeout: 933 lvb_type: 1 00010000:00010000:1.0:1746143754.975376:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.975415:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593905792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.975421:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6770 00000100:00100000:0.0:1746143754.975603:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.976870:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593905664 00000100:00100000:1.0:1746143754.976876:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593905664 00010000:00010000:1.0:1746143754.976892:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 15 pid: 8495 timeout: 933 lvb_type: 0 00000100:00100000:1.0:1746143754.976910:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6771 00000100:00100000:1.0:1746143754.976915:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963593905664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143754.976922:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143754.976934:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 15 pid: 8495 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.976943:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 15 pid: 8495 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.976959:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093b5d200/0xe984082ccd72e19e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a67e1 expref: 15 pid: 8495 timeout: 933 lvb_type: 0 00010000:00010000:1.0:1746143754.976978:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.976980:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143754.976986:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.976999:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143754.977028:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 14 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143754.977038:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594255232:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143754.977683:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143754.980899:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143754.981004:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594255232:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143754.981024:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143754.981066:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963593905664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4149us (5927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143754.981077:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6771 00000100:00100000:0.0:1746143755.013467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.022460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.027463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.027836:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593906560 00000100:00100000:1.0:1746143755.027842:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593906560 00010000:00010000:1.0:1746143755.027863:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd72e30a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c1 expref: 26 pid: 12618 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.027881:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6772 00000100:00100000:1.0:1746143755.027886:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593906560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143755.027896:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143755.027913:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd72e30a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c1 expref: 26 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.027927:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd72e30a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c1 expref: 26 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.027945:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b144200/0xe984082ccd72e30a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c1 expref: 26 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.027972:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143755.028760:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963593906560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 870us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.028768:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6772 00000100:00100000:0.0:1746143755.031642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.034748:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593906688 00000100:00100000:1.0:1746143755.034762:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593906688 00010000:00010000:1.0:1746143755.034804:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e15ce00/0xe984082ccd72e2fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68b3 expref: 12 pid: 12618 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.034852:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6773 00000100:00100000:1.0:1746143755.034858:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963593906688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143755.034873:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143755.034895:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e15ce00/0xe984082ccd72e2fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68b3 expref: 12 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.034908:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e15ce00/0xe984082ccd72e2fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68b3 expref: 12 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.034932:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e15ce00/0xe984082ccd72e2fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68b3 expref: 12 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.034962:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.034964:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.034972:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0xe984082ccd72e342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68eb expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.034979:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0xe984082ccd72e342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3088383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68eb expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.035010:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c8fa00/0xe984082ccd72e342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3088383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68eb expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.035029:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594255616:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143755.035126:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.040030:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.040867:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594255616:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143755.040888:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143755.040938:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963593906688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6079us (9305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.040949:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6773 00000100:00100000:0.0:1746143755.045565:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.106944:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.107037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.124677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.127863:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.127974:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593907712 00000100:00100000:1.0:1746143755.127982:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593907712 00002000:00100000:1.0:1746143755.128030:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1650688->2097151) req@ffff88012b79dc00 x1830963593907712/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.128040:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79dc00 with x1830963593907712 ext(1650688->2097151) 00010000:00010000:1.0:1746143755.128049:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 17 pid: 8497 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.128067:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 17 pid: 8497 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746143755.128073:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79dc00 00000100:00100000:0.0:1746143755.137258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.137340:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593907840 00000100:00100000:1.0:1746143755.137351:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593907840 00010000:00010000:1.0:1746143755.137390:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 19 pid: 8497 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.137429:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6774 00000100:00100000:1.0:1746143755.137436:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963593907840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143755.137450:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143755.137470:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 19 pid: 8497 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.137481:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 19 pid: 8497 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.137507:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131e91200/0xe984082ccd72e311 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68c8 expref: 19 pid: 8497 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.137537:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.137539:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.137547:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e400/0xe984082ccd72e357 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6900 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.137559:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8e400/0xe984082ccd72e357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6900 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.137591:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c8e400/0xe984082ccd72e357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6900 expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.137602:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594256128:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143755.137686:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.139319:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594256128:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143755.139336:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143755.139367:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963593907840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1930us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.139375:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6774 00000100:00100000:0.0:1746143755.140908:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.156515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.162416:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.172415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.174310:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593908480 00000100:00100000:1.0:1746143755.174323:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593908480 00010000:00010000:1.0:1746143755.174367:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 13 pid: 12618 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.174472:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6775 00000100:00100000:1.0:1746143755.174481:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963593908480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143755.174497:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143755.174519:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 13 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.174537:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 13 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.174560:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff25400/0xe984082ccd72e326 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68dd expref: 13 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.175354:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.175357:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.175365:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c8e800/0xe984082ccd72e35e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6907 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.175375:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8e800/0xe984082ccd72e35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6907 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.175413:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c8e800/0xe984082ccd72e35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6907 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.175425:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594256384:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143755.175531:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.180277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.180434:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594256384:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143755.180456:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143755.180500:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963593908480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6020us (8092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.180511:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6775 00000100:00100000:0.0:1746143755.211916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.211969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.213203:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593909120 00000100:00100000:1.0:1746143755.213208:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593909120 00002000:00100000:1.0:1746143755.213239:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3330048->4194303) req@ffff88009bfe2680 x1830963593909120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.213248:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830963593909120 ext(3330048->4194303) 00002000:00010000:1.0:1746143755.213253:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:1.0:1746143755.213295:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5929 00000100:00100000:1.0:1746143755.213302:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963593909120:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143755.218787:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.218837:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.218974:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12779 00000100:00100000:1.0:1746143755.218980:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963593909376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.218986:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.218994:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91000/0xe984082ccd72e36c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a690e expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.219009:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.219011:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.219016:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91000/0xe984082ccd72e36c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a690e expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.219028:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91000/0xe984082ccd72e36c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a690e expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.219037:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91000, rc 0) 00000100:00100000:1.0:1746143755.219091:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963593909376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 110us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.219098:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12779 00000100:00100000:0.0:1746143755.222821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.224163:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593909120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10859us (12192us total) trans 0 rc 864256/864256 00000100:00100000:1.0:1746143755.224170:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5929 00002000:00100000:1.0:1746143755.224176:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3330048->4194303) req@ffff88009bfe2680 x1830963593909120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 864256/864256 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.224183:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830963593909120 ext(3330048->4194303) 00002000:00010000:1.0:1746143755.224186:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:1.0:1746143755.238591:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593909888 00000100:00100000:1.0:1746143755.238608:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593909888 00002000:00100000:1.0:1746143755.238645:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88009e5cfb80 x1830963593909888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.238653:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cfb80 with x1830963593909888 ext(4194304->4755455) 00002000:00010000:1.0:1746143755.238657:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cfb80 00000100:00100000:1.0:1746143755.238683:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5931 00000100:00100000:1.0:1746143755.238690:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593909888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143755.249799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.250583:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593909888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11893us (12692us total) trans 0 rc 561152/561152 00000100:00100000:1.0:1746143755.250591:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5931 00002000:00100000:1.0:1746143755.250599:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88009e5cfb80 x1830963593909888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.250607:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cfb80 with x1830963593909888 ext(4194304->4755455) 00002000:00010000:1.0:1746143755.250611:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cfb80 00000100:00100000:0.0:1746143755.257126:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.257193:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.257269:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593910144 00000100:00100000:1.0:1746143755.257286:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593910144 00010000:00010000:1.0:1746143755.257323:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97e00/0xe984082ccd72e20e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6820 expref: 6 pid: 4581 timeout: 934 lvb_type: 1 00000100:00100000:0.0:1746143755.259809:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.262274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.262324:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.262403:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593910912 00000100:00100000:1.0:1746143755.262408:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593910912 00002000:00100000:1.0:1746143755.262444:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009bfe3800 x1830963593910912/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.262453:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3800 with x1830963593910912 ext(1048576->2097151) 00002000:00010000:1.0:1746143755.262459:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3800 00000100:00100000:1.0:1746143755.268964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.280265:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963593910784:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17746us (17996us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143755.280274:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5933 00002000:00100000:0.0:1746143755.280292:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009bfe1880 x1830963593910784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.280300:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830963593910784 ext(1048576->2097151) 00002000:00010000:0.0:1746143755.280304:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1880 00000100:00100000:1.0:1746143755.287194:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.292635:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.296745:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.297182:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593911680 00000100:00100000:1.0:1746143755.297191:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593911680 00000100:00100000:1.0:1746143755.297246:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12785 00000100:00100000:1.0:1746143755.297254:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:30983:x1830963593911680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143755.297272:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.297300:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72e396 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a693f expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.297331:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093213a00/0xe984082ccd72e29a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a687b expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.297340:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf13c00/0xe984082ccd72e2e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6897 expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.297346:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.297348:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.297351:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72e396 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a693f expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.297383:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf13c00/0xe984082ccd72e2e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6897 expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.297394:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf13c00/0xe984082ccd72e2e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6897 expref: 20 pid: 12618 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746143755.297405:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594257280:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.297485:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093213a00/0xe984082ccd72e29a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a687b expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.297493:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093213a00/0xe984082ccd72e29a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a687b expref: 24 pid: 6929 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.297500:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594257408:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.297517:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.298930:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594257280:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.298938:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594257408:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.298952:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131e91600/0xe984082ccd72e396 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a693f expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.298960:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131e91600, rc 0) 00000100:00100000:1.0:1746143755.298978:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:30983:x1830963593911680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1726us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.298986:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12785 00000100:00100000:0.0:1746143755.301420:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.301462:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.301499:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.307671:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593912320 00000100:00100000:0.0:1746143755.307681:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593912320 00002000:00100000:0.0:1746143755.307727:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1245184->1249279) req@ffff88009e5ce300 x1830963593912320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.307738:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ce300 with x1830963593912320 ext(1245184->1249279) 00002000:00010000:0.0:1746143755.307744:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5ce300 00000100:00100000:0.0:1746143755.309078:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5935 00000100:00100000:0.0:1746143755.309089:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963593912320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143755.309247:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963593912320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 161us (1786us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143755.309254:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5935 00002000:00100000:0.0:1746143755.309260:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1245184->1249279) req@ffff88009e5ce300 x1830963593912320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.309268:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ce300 with x1830963593912320 ext(1245184->1249279) 00002000:00010000:0.0:1746143755.309272:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5ce300 00000100:00100000:0.0:1746143755.322792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.330271:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.331517:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.331611:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593912832 00000100:00100000:1.0:1746143755.331620:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593912832 00002000:00100000:1.0:1746143755.331669:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f532a00 x1830963593912832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.331679:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532a00 with x1830963593912832 ext(3145728->4194303) 00002000:00010000:1.0:1746143755.331685:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f532a00 00000100:00100000:1.0:1746143755.331707:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593912704 00000100:00100000:1.0:1746143755.331709:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593912704 00002000:00100000:1.0:1746143755.331719:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f531500 x1830963593912704/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.331725:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531500 with x1830963593912704 ext(2097152->3145727) 00002000:00010000:1.0:1746143755.331728:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f531500 00000100:00100000:1.0:1746143755.331755:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5936 00000100:00100000:1.0:1746143755.331764:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963593912832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143755.349958:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963593912832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18184us (19688us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143755.349970:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5936 00002000:00100000:1.0:1746143755.349981:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f532a00 x1830963593912832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.349990:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532a00 with x1830963593912832 ext(3145728->4194303) 00002000:00010000:1.0:1746143755.349997:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f532a00 00000100:00100000:0.0:1746143755.364474:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.427915:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.429198:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593913344 00000100:00100000:1.0:1746143755.429210:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593913344 00000100:00100000:1.0:1746143755.429444:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9047 00000100:00100000:1.0:1746143755.429453:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:30992:x1830963593913344:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143755.429479:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.429498:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e39d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6946 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.429780:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429793:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429803:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429816:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429821:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429826:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429931:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429942:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68ac expref: 23 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.429949:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd72e334 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68e4 expref: 262 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.429959:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.429990:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd72e334 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68e4 expref: 262 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.430001:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd72e334 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68e4 expref: 262 pid: 14763 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.430012:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594257792:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.430406:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68ac expref: 23 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.430414:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68ac expref: 23 pid: 14763 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.430424:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594257920:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.430669:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.434036:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594257792:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.434048:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594257920:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.434075:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143755.434524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.434584:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.438406:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.438438:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593913984 00000100:00100000:1.0:1746143755.438442:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593913984 00010000:00010000:1.0:1746143755.438463:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd72e334 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68e4 expref: 264 pid: 14763 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143755.438466:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.438480:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593914112 00000100:00100000:1.0:1746143755.438481:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593914112 00000100:00100000:0.0:1746143755.438485:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6782 00010000:00010000:1.0:1746143755.438489:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68ac expref: 27 pid: 14763 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143755.438493:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:1964:x1830963593913984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143755.438501:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6783 00010000:00010000:0.0:1746143755.438504:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143755.438506:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963593914112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.438509:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd72e334 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68e4 expref: 264 pid: 14763 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.438514:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143755.438519:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68ac expref: 27 pid: 14763 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.438526:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd72e334 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68e4 expref: 264 pid: 14763 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.438628:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68ac expref: 27 pid: 14763 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.438646:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938c0200/0xe984082ccd72e2d9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68ac expref: 27 pid: 14763 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.438670:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b51fd600/0xe984082ccd72e334 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a68e4 expref: 264 pid: 14763 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.438687:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143755.438695:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438708:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438714:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.438721:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143755.438725:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143755.438734:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143755.438778:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963593914112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 270us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.438778:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:1964:x1830963593913984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 287us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.438784:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6783 00000100:00100000:0.0:1746143755.438787:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6782 00010000:00010000:1.0:1746143755.438807:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438814:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143755.438849:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143755.438852:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143755.438866:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438873:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438881:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438886:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438891:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438897:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009500b400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143755.438900:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438906:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438914:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143755.438917:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143755.438920:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438924:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e3a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438933:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438938:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438942:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438946:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009500be00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143755.438948:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438953:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438960:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b898200) 00010000:00010000:1.0:1746143755.438961:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143755.438963:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.438967:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500be00/0xe984082ccd72e3ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.439727:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6946 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.439743:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6946 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.439749:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143755.441251:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143755.441255:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009500a000, rc 0) 00000100:00100000:1.0:1746143755.441318:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:30992:x1830963593913344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 11864us (13414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.441327:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9047 00000100:00100000:0.0:1746143755.445052:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593914496 00000100:00100000:0.0:1746143755.445057:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593914496 00000100:00100000:0.0:1746143755.446637:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9049 00000100:00100000:0.0:1746143755.446647:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:30992:x1830963593914496:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143755.446665:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.446679:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08400/0xe984082ccd72e3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6954 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.446732:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.446739:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c8f400/0xe984082ccd72e3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143755.446744:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.446755:0:14762:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094c8f400/0xe984082ccd72e3c0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143755.446762:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143755.451371:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143755.454555:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.454562:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143755.454603:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143755.454606:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143755.454621:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.454630:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.454653:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08400/0xe984082ccd72e3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6954 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.454678:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6954 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.454688:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143755.454691:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143755.454693:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08600, rc 0) 00000100:00100000:1.0:1746143755.454730:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:30992:x1830963593914496:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 8086us (10029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.454736:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9049 00000100:00100000:0.0:1746143755.459506:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.459542:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.459567:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.459593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.459606:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.459630:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.459694:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593914880 00000100:00100000:1.0:1746143755.459703:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593914880 00000100:00100000:0.0:1746143755.459807:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593915392 00000100:00100000:0.0:1746143755.459809:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593915392 00000100:00100000:1.0:1746143755.459849:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593915520 00000100:00100000:1.0:1746143755.459851:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593915520 00000100:00100000:1.0:1746143755.459869:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12787 00000100:00100000:1.0:1746143755.459874:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:30994:x1830963593914880:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143755.459882:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.459899:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a695b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.459925:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c8e800/0xe984082ccd72e35e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6907 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.459934:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c8ec00/0xe984082ccd72e365 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6915 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.459940:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.459941:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.459945:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1617920->1851391] (req 1617920->1851391) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.459969:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c8ec00/0xe984082ccd72e365 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6915 expref: 15 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.459980:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c8ec00/0xe984082ccd72e365 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6915 expref: 15 pid: 4582 timeout: 934 lvb_type: 1 00000100:00100000:1.0:1746143755.459988:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594258304:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.460023:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12788 00000100:00100000:1.0:1746143755.460028:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593915136:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143755.460036:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.460045:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009500be00/0xe984082ccd72e3ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6969 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.460070:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594258432:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143755.460090:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00010000:00010000:1.0:1746143755.460112:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c8e800/0xe984082ccd72e35e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6907 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.460121:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c8e800/0xe984082ccd72e35e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6907 expref: 25 pid: 12618 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.460129:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594258560:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.460171:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.460422:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12791 00000100:00100000:0.0:1746143755.460428:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593915392:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143755.460434:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.460441:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e3ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6977 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.460451:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.460458:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e3ff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6977 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.460466:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e3ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6977 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.460484:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09c00, rc 0) 00000100:00100000:0.0:1746143755.460501:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593915392:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 74us (893us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143755.460507:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12791 00002000:00010000:1.0:1746143755.464047:0:8496:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime: 1746143754 -> 1746143755 00002000:00010000:1.0:1746143755.464055:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143754 -> 1746143755 00002000:00010000:1.0:1746143755.464057:0:8496:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime: 1746143754 -> 1746143755 00000100:00100000:1.0:1746143755.464081:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594258432:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143755.464112:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009500be00/0xe984082ccd72e3ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6969 expref: 8 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.464125:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009500be00/0xe984082ccd72e3ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6969 expref: 8 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.464169:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009500be00, rc 0) 00000100:00100000:1.0:1746143755.464227:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593915136:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4196us (4657us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143755.464236:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12788 00000100:00100000:1.0:1746143755.464290:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594258304:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.464300:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594258560:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.464320:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1617920->1851391] (req 1617920->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.464334:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5548200, rc 0) 00000100:00100000:1.0:1746143755.464352:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:30994:x1830963593914880:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4478us (4860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.464357:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12787 00000100:00100000:0.0:1746143755.469266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.469813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.469837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.469914:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593916032 00000100:00100000:1.0:1746143755.469924:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593916032 00000100:00100000:1.0:1746143755.470519:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9050 00000100:00100000:1.0:1746143755.470525:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:30992:x1830963593916032:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143755.470540:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.470553:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a800/0xe984082ccd72e406 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6985 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.470651:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470662:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470670:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470682:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470687:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470691:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470789:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e41b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470798:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e41b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470803:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e41b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143755.470810:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143755.470892:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470902:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470908:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470913:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009500b800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143755.470915:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470920:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470927:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143755.470929:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143755.470932:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470936:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b800/0xe984082ccd72e40d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470945:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470949:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470953:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470957:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009500b400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143755.470959:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470967:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470972:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f600) 00010000:00010000:1.0:1746143755.470973:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143755.470975:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.470979:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500b400/0xe984082ccd72e414 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.471010:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a800/0xe984082ccd72e406 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6985 expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.471019:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009500a000/0xe984082ccd72e41b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6985 expref: 13 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.471024:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143755.471026:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143755.471028:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009500a000, rc 0) 00000100:00100000:1.0:1746143755.471052:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:30992:x1830963593916032:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 528us (1240us total) trans 8589943340 rc 0/0 00000100:00100000:1.0:1746143755.471058:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9050 00000100:00100000:0.0:1746143755.478343:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.478387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.478421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.479293:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593916288 00000100:00100000:1.0:1746143755.479298:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593916288 00000100:00100000:1.0:1746143755.479324:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593916416 00000100:00100000:1.0:1746143755.479325:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593916416 00000100:00100000:1.0:1746143755.479343:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12792 00000100:00100000:1.0:1746143755.479348:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593916288:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143755.479366:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.479381:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136489e00/0xe984082ccd72e429 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a698c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.479432:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594258816:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143755.479488:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.479513:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12793 00000100:00100000:1.0:1746143755.479519:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593916416:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143755.479528:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.479538:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009133c800/0xe984082ccd72e430 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6993 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.479561:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594258944:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143755.479582:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.479674:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.479742:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.481167:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594258816:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143755.481189:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136489e00/0xe984082ccd72e429 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a698c expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.481199:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136489e00/0xe984082ccd72e429 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a698c expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.481208:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489e00, rc 0) 00000100:00100000:1.0:1746143755.481239:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593916288:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1891us (2852us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143755.481245:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12792 00000100:00100000:0.0:1746143755.481319:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594258944:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143755.481332:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009133c800/0xe984082ccd72e430 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6993 expref: 8 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.481340:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009133c800/0xe984082ccd72e430 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6993 expref: 8 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.481349:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133c800, rc 0) 00000100:00100000:0.0:1746143755.481363:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593916416:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1845us (2942us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143755.481368:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12793 00000100:00100000:0.0:1746143755.489197:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593917056 00000100:00100000:0.0:1746143755.489207:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593917056 00002000:00100000:0.0:1746143755.489251:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1847296->1851391) req@ffff88009c3faa00 x1830963593917056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.489261:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963593917056 ext(1847296->1851391) 00002000:00010000:0.0:1746143755.489267:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:0.0:1746143755.489298:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5940 00000100:00100000:0.0:1746143755.489306:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963593917056:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143755.489492:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963593917056:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 186us (447us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143755.489498:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5940 00002000:00100000:0.0:1746143755.489504:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1847296->1851391) req@ffff88009c3faa00 x1830963593917056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.489510:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963593917056 ext(1847296->1851391) 00002000:00010000:0.0:1746143755.489513:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3faa00 00000100:00100000:0.0:1746143755.497451:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.497547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.497611:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593917824 00000100:00100000:1.0:1746143755.497617:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593917824 00000100:00100000:1.0:1746143755.497711:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3854 00000100:00100000:1.0:1746143755.497716:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:30994:x1830963593917568:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143755.498123:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:30994:x1830963593917568:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 406us (681us total) trans 8589943342 rc 0/0 00000100:00100000:1.0:1746143755.498130:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3854 00000100:00100000:0.0:1746143755.512103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.512188:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.512210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.512305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.513340:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12797 00000100:00100000:1.0:1746143755.513348:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963593918208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.513356:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.513375:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133da00/0xe984082ccd72e45a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a69b6 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.513401:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594259456:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143755.513436:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.513452:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12798 00000100:00100000:1.0:1746143755.513457:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593918336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.513463:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.513470:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133d200/0xe984082ccd72e461 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a69bd expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.513481:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.513483:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.513491:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009133d200/0xe984082ccd72e461 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69bd expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.513510:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133d200/0xe984082ccd72e461 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69bd expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.513519:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133d200, rc 0) 00000100:00100000:1.0:1746143755.513541:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963593918336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 84us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.513546:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12798 00000100:00100000:1.0:1746143755.516341:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594259456:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143755.516377:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133da00/0xe984082ccd72e45a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69b6 expref: 29 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.516391:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009133da00/0xe984082ccd72e45a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69b6 expref: 29 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.516405:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133da00, rc 0) 00000100:00100000:1.0:1746143755.516461:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963593918208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3113us (4247us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143755.516469:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12797 00000100:00100000:0.0:1746143755.518673:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.518858:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593918720 00000100:00100000:1.0:1746143755.518867:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593918720 00000100:00100000:1.0:1746143755.518911:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9052 00000100:00100000:1.0:1746143755.518918:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:31001:x1830963593918720:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143755.518939:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.518956:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d600/0xe984082ccd72e468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a69cb expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.519044:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.519056:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6954 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.519063:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.519093:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6954 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.519103:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e3ce lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6954 expref: 12 pid: 14762 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.519114:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594259584:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.519194:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.520877:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594259584:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.520896:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143755.521243:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143755.521890:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.521896:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143755.521915:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143755.522057:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d600/0xe984082ccd72e468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69cb expref: 266 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.522070:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69cb expref: 265 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.522076:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143755.522078:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143755.522080:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133ca00, rc 0) 00000100:00100000:1.0:1746143755.522102:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:31001:x1830963593918720:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3185us (3334us total) trans 8589943343 rc 0/0 00000100:00100000:1.0:1746143755.522108:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9052 00000100:00100000:0.0:1746143755.522903:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.537848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.544518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.565781:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.571867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.582956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.590728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.618837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.619600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.620170:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.620855:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593920128 00000100:00100000:1.0:1746143755.620866:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593920128 00000100:00100000:1.0:1746143755.620906:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593920384 00000100:00100000:1.0:1746143755.620908:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593920384 00000100:00100000:1.0:1746143755.620920:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593920256 00000100:00100000:1.0:1746143755.620922:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593920256 00000100:00100000:1.0:1746143755.620938:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12801 00000100:00100000:1.0:1746143755.620944:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:30997:x1830963593920128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.620959:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.620972:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133d800/0xe984082ccd72e48b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a69d9 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.620995:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.621001:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143755.621004:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143755.621007:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009133d800/0xe984082ccd72e48b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69d9 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.621034:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->1851391) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.621045:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->1851391) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 15 pid: 6929 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.621055:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594260224:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.621122:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12802 00000100:00100000:1.0:1746143755.621126:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963593920384:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.621133:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.621158:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009133c600/0xe984082ccd72e492 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a69e7 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.621169:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.621171:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.621176:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009133c600/0xe984082ccd72e492 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69e7 expref: 21 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.621186:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009133c600/0xe984082ccd72e492 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69e7 expref: 21 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.621194:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133c600, rc 0) 00000100:00100000:1.0:1746143755.621213:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963593920384:12345-192.168.202.48@tcp:101:cat.0 Request processed in 86us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.621219:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12802 00000100:00100000:1.0:1746143755.621231:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12803 00000100:00100000:1.0:1746143755.621235:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963593920256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.621240:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.621245:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133da00/0xe984082ccd72e499 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a69e0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.621253:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.621255:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.621258:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009133da00/0xe984082ccd72e499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69e0 expref: 16 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.621267:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133da00/0xe984082ccd72e499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69e0 expref: 16 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.621272:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133da00, rc 0) 00000100:00100000:1.0:1746143755.621299:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963593920256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 63us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.621304:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12803 00000100:00100000:1.0:1746143755.625501:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.625735:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.626013:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594260224:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143755.626043:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133d800/0xe984082ccd72e48b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69d9 expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.626063:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133d800, rc 0) 00000100:00100000:0.0:1746143755.626113:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:30997:x1830963593920128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5168us (7289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.626121:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12801 00000100:00100000:0.0:1746143755.633292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.633521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.633699:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593921024 00000100:00100000:1.0:1746143755.633705:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593921024 00002000:00100000:1.0:1746143755.633733:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880094307800 x1830963593921024/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.633740:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307800 with x1830963593921024 ext(0->1048575) 00002000:00010000:1.0:1746143755.633744:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307800 00000100:00100000:1.0:1746143755.634378:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5944 00000100:00100000:1.0:1746143755.634386:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963593921024:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143755.637737:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593921152 00000100:00100000:0.0:1746143755.637744:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593921152 00010000:00010000:0.0:1746143755.637773:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 20 pid: 6929 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143755.637807:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6791 00000100:00100000:0.0:1746143755.637814:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963593921152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.637825:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.637843:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 20 pid: 6929 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.637855:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->1851391) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 20 pid: 6929 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.637874:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5548200/0xe984082ccd72e3e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->1851391) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a695b expref: 20 pid: 6929 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.637941:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.637943:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.637949:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009133d800/0xe984082ccd72e48b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69d9 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.637960:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009133d800/0xe984082ccd72e48b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69d9 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.637986:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009133d800/0xe984082ccd72e48b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69d9 expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143755.637997:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594260352:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143755.638064:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.647466:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.648054:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963593921024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13663us (14526us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143755.648065:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5944 00002000:00100000:1.0:1746143755.648075:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880094307800 x1830963593921024/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.648087:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307800 with x1830963593921024 ext(0->1048575) 00002000:00010000:1.0:1746143755.648092:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307800 00000100:00100000:0.0:1746143755.664902:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.672989:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.673025:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.676781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.717678:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.717724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.717853:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593922560 00000100:00100000:1.0:1746143755.717862:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593922560 00000100:00100000:1.0:1746143755.717902:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9053 00000100:00100000:1.0:1746143755.717908:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31007:x1830963593922560:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143755.717930:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.717947:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d000/0xe984082ccd72e4a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a69f5 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.718023:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c800/0xe984082ccd72e4ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.718035:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c800/0xe984082ccd72e4ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.718043:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c800/0xe984082ccd72e4ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143755.718050:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143755.718135:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d000/0xe984082ccd72e4a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69f5 expref: 29 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.718176:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c800/0xe984082ccd72e4ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69f5 expref: 28 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.718181:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143755.718183:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143755.718185:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133c800, rc 0) 00000100:00100000:1.0:1746143755.718222:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31007:x1830963593922560:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 315us (555us total) trans 8589943344 rc 0/0 00000100:00100000:1.0:1746143755.718226:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9053 00000100:00100000:0.0:1746143755.720371:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.725960:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.727063:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.729312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.730265:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.730948:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.733325:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.733355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.733382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.734266:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.737017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.737401:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593924480 00000100:00100000:0.0:1746143755.737408:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593924480 00002000:00100000:0.0:1746143755.737453:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1998848->2002943) req@ffff880094304e00 x1830963593924480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.737461:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963593924480 ext(1998848->2002943) 00002000:00010000:0.0:1746143755.737466:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746143755.737485:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5951 00000100:00100000:0.0:1746143755.737491:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963593924480:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143755.737653:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963593924480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 162us (647us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143755.737659:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5951 00002000:00100000:0.0:1746143755.737663:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1998848->2002943) req@ffff880094304e00 x1830963593924480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.737670:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963593924480 ext(1998848->2002943) 00002000:00010000:0.0:1746143755.737673:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746143755.738186:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1694 00000100:00100000:0.0:1746143755.738193:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963593924736:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143755.738290:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963593924736:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 96us (490us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143755.738295:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1694 00002000:00100000:0.0:1746143755.738301:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2555904->2559999) req@ffff88009e5cea00 x1830963593924736/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746143766 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.738307:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cea00 with x1830963593924736 ext(2555904->2559999) 00010000:00010000:0.0:1746143755.738312:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff96a00/0xe984082ccd72e4bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69fc expref: 18 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.738322:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff96a00/0xe984082ccd72e4bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69fc expref: 18 pid: 4582 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746143755.738328:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e5cea00 00000100:00100000:0.0:1746143755.741568:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.741622:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.748126:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.748814:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.751053:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.751101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.751345:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6800 00000100:00100000:1.0:1746143755.751354:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963593925632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143755.751361:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143755.751373:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c8e400/0xe984082ccd72e357 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6900 expref: 26 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.751383:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c8e400/0xe984082ccd72e357 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6900 expref: 26 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.751396:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e400/0xe984082ccd72e357 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6900 expref: 26 pid: 12618 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.751408:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.751409:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143755.751414:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.751421:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.751443:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.751454:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594262016:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143755.751513:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.755931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.763827:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.819123:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.819356:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593926272 00000100:00100000:1.0:1746143755.819366:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593926272 00000100:00100000:1.0:1746143755.819429:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9054 00000100:00100000:1.0:1746143755.819437:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31011:x1830963593926272:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143755.819463:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.819482:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133dc00/0xe984082ccd72e4df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6a1f expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.819712:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72e4e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819724:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72e4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819736:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c400/0xe984082ccd72e4e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819751:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d600/0xe984082ccd72e4ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819761:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d600/0xe984082ccd72e4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819766:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009133d600/0xe984082ccd72e4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819874:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819883:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69cb expref: 264 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.819890:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c800/0xe984082ccd72e4ae lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69f5 expref: 27 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.819896:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.819927:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c800/0xe984082ccd72e4ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69f5 expref: 27 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.819940:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c800/0xe984082ccd72e4ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69f5 expref: 27 pid: 14762 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.819953:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594262144:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.820051:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69cb expref: 264 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.820059:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133ca00/0xe984082ccd72e46f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69cb expref: 264 pid: 14762 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.820070:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594262272:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.820089:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.823130:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.823208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.823318:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594262144:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.823330:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594262272:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.823352:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143755.823468:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3856 00000100:00100000:0.0:1746143755.823477:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:23698:x1830963593926784:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143755.823624:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:23698:x1830963593926784:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 149us (415us total) trans 8589943346 rc 0/0 00000100:00100000:0.0:1746143755.823631:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3856 00000100:00100000:0.0:1746143755.827951:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.828002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.836887:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.838468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.838492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.838521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.838558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.838590:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593927296 00000100:00100000:0.0:1746143755.838594:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593927296 00000100:00100000:0.0:1746143755.838615:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593927424 00000100:00100000:0.0:1746143755.838617:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593927424 00000100:00100000:0.0:1746143755.838635:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12810 00000100:00100000:0.0:1746143755.839891:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593927168:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143755.840025:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.840035:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd72e517 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6a26 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.840196:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.840198:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.841130:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd72e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a26 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.841164:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd72e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a26 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.841173:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09e00, rc 0) 00000100:00100000:0.0:1746143755.841209:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593927168:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2568us (4334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.841215:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12810 00000100:00100000:0.0:1746143755.842967:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594262400:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143755.842981:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e36800/0xe984082ccd72e4fb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a2d expref: 7 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.842989:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e36800/0xe984082ccd72e4fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a2d expref: 7 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.843006:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e36800, rc 0) 00000100:00100000:0.0:1746143755.843024:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593927296:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4347us (4562us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143755.843029:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12811 00000100:00100000:0.0:1746143755.845620:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.845714:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.845933:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.846091:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593927808 00000100:00100000:1.0:1746143755.846104:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593927808 00000100:00100000:1.0:1746143755.846195:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12815 00000100:00100000:1.0:1746143755.846205:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963593927936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.846221:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.846235:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff97400/0xe984082ccd72e51e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6a50 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.846294:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594262656:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143755.846365:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12817 00000100:00100000:0.0:1746143755.846372:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963593928064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143755.846380:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.846389:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e52c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6a57 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.846402:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.846404:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.846412:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e52c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a57 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.846428:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e52c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a57 expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143755.846443:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09c00, rc 0) 00000100:00100000:0.0:1746143755.847309:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963593928064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 935us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.847316:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.847316:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12817 00000100:00100000:0.0:1746143755.847445:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593928320 00000100:00100000:0.0:1746143755.847449:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593928320 00000100:00100000:0.0:1746143755.847485:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9055 00000100:00100000:0.0:1746143755.847490:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31011:x1830963593928320:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143755.847501:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.847512:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72e533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6a5e expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.847599:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.847613:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a1f expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.847958:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.847984:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a1f expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.848508:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a1f expref: 14 pid: 14762 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143755.848528:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594262912:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143755.848593:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.856984:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594262912:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143755.857013:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143755.857067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.857091:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593928448 00000100:00100000:0.0:1746143755.857098:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593928448 00010000:00010000:0.0:1746143755.857133:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a1f expref: 15 pid: 14762 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143755.857189:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6803 00000100:00100000:0.0:1746143755.857196:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963593928448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.857208:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.857214:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a1f expref: 15 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.857224:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a1f expref: 15 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.857244:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009133c200/0xe984082ccd72e4f4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a1f expref: 15 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.857260:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143755.857264:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.857282:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.857289:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.857303:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143755.857338:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963593928448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 143us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.857344:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6803 00010000:00010000:0.0:1746143755.857374:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143755.857379:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143755.857396:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143755.857524:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08c00/0xe984082ccd72e533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a5e expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.857536:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a5e expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.857541:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143755.857544:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143755.857546:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08600, rc 0) 00000100:00100000:0.0:1746143755.857572:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31011:x1830963593928320:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10082us (10199us total) trans 8589943347 rc 0/0 00000100:00100000:0.0:1746143755.857578:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9055 00000100:00100000:0.0:1746143755.861633:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.862102:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593928576 00000100:00100000:1.0:1746143755.862110:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593928576 00000100:00100000:1.0:1746143755.862193:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9056 00000100:00100000:1.0:1746143755.862201:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31011:x1830963593928576:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143755.862227:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.862246:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff97c00/0xe984082ccd72e548 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6a65 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.862337:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.862350:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a5e expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.862357:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.862387:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a5e expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.862397:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08600/0xe984082ccd72e53a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a5e expref: 15 pid: 14762 timeout: 934 lvb_type: 0 00000100:00100000:1.0:1746143755.862408:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594263040:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143755.863671:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.867558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.868073:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594263040:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143755.868790:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143755.871029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.871122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143755.871753:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.871760:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143755.871796:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143755.871800:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143755.871813:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143755.871839:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff97c00/0xe984082ccd72e548 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a65 expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143755.871858:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a65 expref: 14 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.871864:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a65 expref: 14 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.871870:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff96e00, rc 0) 00000100:00100000:1.0:1746143755.871897:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31011:x1830963593928576:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 9698us (10273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.871903:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9056 00000100:00100000:0.0:1746143755.876249:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.876293:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.876322:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.876340:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593929472 00000100:00100000:0.0:1746143755.876347:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593929472 00010000:00010000:0.0:1746143755.876374:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a65 expref: 14 pid: 14762 timeout: 934 lvb_type: 0 00000100:00100000:0.0:1746143755.877210:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6805 00000100:00100000:0.0:1746143755.877218:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963593929472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.877228:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.877234:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a65 expref: 14 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.877244:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a65 expref: 14 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.877266:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96e00/0xe984082ccd72e54f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a65 expref: 14 pid: 14762 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.877290:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143755.877294:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c8e400/0xe984082ccd72e55d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143755.877302:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c8e400/0xe984082ccd72e55d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143755.877308:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c8e400/0xe984082ccd72e55d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143755.877323:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143755.877344:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963593929472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 126us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.877349:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6805 00000100:00100000:0.0:1746143755.879061:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593929600 00000100:00100000:0.0:1746143755.879066:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593929600 00002000:00100000:0.0:1746143755.879094:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1998848->2097151) req@ffff88009e5cc380 x1830963593929600/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.879102:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc380 with x1830963593929600 ext(1998848->2097151) 00010000:00010000:0.0:1746143755.879107:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e800/0xe984082ccd72e4c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a03 expref: 25 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.879118:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c8e800/0xe984082ccd72e4c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a03 expref: 25 pid: 4582 timeout: 934 lvb_type: 0 00002000:00010000:0.0:1746143755.879123:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e5cc380 00000100:00100000:0.0:1746143755.879170:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1696 00000100:00100000:0.0:1746143755.879176:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963593929600:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143755.881787:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963593929600:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2610us (4082us total) trans 17179872999 rc 0/0 00000100:00100000:1.0:1746143755.881794:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1696 00002000:00100000:1.0:1746143755.881801:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1998848->2097151) req@ffff88009e5cc380 x1830963593929600/t17179872999(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/448 e 0 to 0 dl 1746143766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.881810:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc380 with x1830963593929600 ext(1998848->2097151) 00010000:00010000:1.0:1746143755.881816:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e800/0xe984082ccd72e4c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a03 expref: 27 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.881827:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c8e800/0xe984082ccd72e4c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1998848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a03 expref: 27 pid: 4582 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746143755.881837:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e5cc380 00000100:00100000:0.0:1746143755.885775:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.886948:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.896887:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.898885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.899228:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593930368 00000100:00100000:1.0:1746143755.899235:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593930368 00002000:00100000:1.0:1746143755.899270:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880090765500 x1830963593930368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.899289:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765500 with x1830963593930368 ext(1048576->2097151) 00002000:00010000:1.0:1746143755.899293:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090765500 00000100:00100000:1.0:1746143755.899312:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5954 00000100:00100000:1.0:1746143755.899319:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963593930368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143755.901840:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.907034:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.919055:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963593930368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19719us (20158us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143755.919069:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5954 00002000:00100000:1.0:1746143755.919083:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880090765500 x1830963593930368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.919092:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765500 with x1830963593930368 ext(1048576->2097151) 00002000:00010000:1.0:1746143755.919099:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090765500 00000100:00100000:0.0:1746143755.924785:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.931271:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.931442:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593931008 00000100:00100000:1.0:1746143755.931452:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593931008 00002000:00100000:1.0:1746143755.931499:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1990655) req@ffff880090764380 x1830963593931008/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.931508:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963593931008 ext(1048576->1990655) 00010000:00010000:1.0:1746143755.931519:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 26 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.931539:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 26 pid: 4582 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746143755.931546:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090764380 00000100:00100000:1.0:1746143755.931589:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1697 00000100:00100000:1.0:1746143755.931597:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963593931008:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143755.940993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.943116:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963593931008:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11519us (11849us total) trans 17179873000 rc 0/0 00000100:00100000:1.0:1746143755.943126:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1697 00002000:00100000:1.0:1746143755.943135:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1990655) req@ffff880090764380 x1830963593931008/t17179873000(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:151/0 lens 488/448 e 0 to 0 dl 1746143766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143755.943159:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963593931008 ext(1048576->1990655) 00010000:00010000:1.0:1746143755.943167:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 28 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:1.0:1746143755.943176:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 28 pid: 4582 timeout: 934 lvb_type: 0 00002000:00010000:1.0:1746143755.943183:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090764380 00000100:00100000:0.0:1746143755.945858:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.945890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.945914:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.945948:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.946308:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6809 00000100:00100000:0.0:1746143755.946315:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593931264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.946320:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.946328:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e52c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a57 expref: 22 pid: 8497 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143755.946336:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09c00/0xe984082ccd72e52c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a57 expref: 22 pid: 8497 timeout: 934 lvb_type: 1 00010000:00010000:0.0:1746143755.946347:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143755.946474:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593931264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 161us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143755.946480:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6809 00000100:00100000:0.0:1746143755.946490:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6811 00000100:00100000:0.0:1746143755.946495:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963593931648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143755.946501:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143755.946513:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 28 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.946527:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 28 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.946616:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c8e600/0xe984082ccd72e4d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1990655) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a18 expref: 28 pid: 4582 timeout: 934 lvb_type: 0 00010000:00010000:0.0:1746143755.946629:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.946630:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143755.946634:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.946640:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143755.946657:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143755.946664:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594264448:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143755.946682:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.949078:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.949598:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594264448:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143755.949610:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143755.949628:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963593931648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3132us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143755.949637:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6811 00000100:00100000:0.0:1746143755.951026:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.961367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.961821:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.962512:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.974959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.981748:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.981910:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.983562:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.983614:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143755.983642:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593933952 00000100:00100000:0.0:1746143755.983646:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593933952 00002000:00100000:0.0:1746143755.983665:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f01f80 x1830963593933952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/0 e 0 to 0 dl 1746143766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143755.983673:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01f80 with x1830963593933952 ext(2097152->3145727) 00002000:00010000:0.0:1746143755.983676:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01f80 00000100:00100000:0.0:1746143755.983701:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5960 00000100:00100000:0.0:1746143755.983706:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963593933952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143755.983731:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593933696 00000100:00100000:1.0:1746143755.983736:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593933696 00000100:00100000:1.0:1746143755.983761:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3858 00000100:00100000:1.0:1746143755.983766:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6309450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31017:x1830963593933696:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143755.983948:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6309450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:31017:x1830963593933696:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 180us (2037us total) trans 8589943350 rc 0/0 00000100:00100000:1.0:1746143755.983954:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3858 00000100:00100000:1.0:1746143755.984033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.984111:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.984130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143755.984750:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12825 00000100:00100000:1.0:1746143755.984756:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963593934336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143755.984764:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143755.984774:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009133cc00/0xe984082ccd72e5b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ab9 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143755.984815:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594265088:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143755.984857:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143755.987510:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12827 00000100:00100000:0.0:1746143755.987519:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963593934464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143755.987527:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143755.987534:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e36c00/0xe984082ccd72e5bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ac0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143755.987575:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594265216:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143755.987742:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143755.990815:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594265088:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143755.990851:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009133cc00/0xe984082ccd72e5b1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab9 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.990881:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009133cc00/0xe984082ccd72e5b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab9 expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143755.990893:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009133cc00, rc 0) 00000100:00100000:1.0:1746143755.990951:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963593934336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6192us (6817us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143755.990960:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12825 00000100:00100000:0.0:1746143756.002078:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143756.002627:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143756.003356:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963593933952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19648us (19739us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.003363:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5960 00002000:00100000:1.0:1746143756.003369:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f01f80 x1830963593933952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:151/0 lens 488/440 e 0 to 0 dl 1746143766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.003376:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01f80 with x1830963593933952 ext(2097152->3145727) 00002000:00010000:1.0:1746143756.003379:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01f80 00000100:00100000:1.0:1746143756.009093:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593934976 00000100:00100000:1.0:1746143756.009103:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593934976 00002000:00100000:1.0:1746143756.009298:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3477504->4194303) req@ffff880093b07100 x1830963593934976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.009307:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07100 with x1830963593934976 ext(3477504->4194303) 00002000:00010000:1.0:1746143756.009312:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b07100 00000100:00080000:0.0:1746143756.009378:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143756.009474:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5961 00000100:00100000:1.0:1746143756.009484:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963593934976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143756.023687:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963593934976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14190us (14836us total) trans 0 rc 716800/716800 00000100:00100000:1.0:1746143756.023703:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5961 00002000:00100000:1.0:1746143756.023717:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3477504->4194303) req@ffff880093b07100 x1830963593934976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 716800/716800 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.023729:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07100 with x1830963593934976 ext(3477504->4194303) 00002000:00010000:1.0:1746143756.023736:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b07100 00000100:00100000:0.0:1746143756.023806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.023840:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593935232 00000100:00100000:1.0:1746143756.023849:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593935232 00002000:00100000:1.0:1746143756.023899:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093f03800 x1830963593935232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.023907:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03800 with x1830963593935232 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.023911:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03800 00000100:00080000:0.0:1746143756.023928:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143756.023938:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5962 00000100:00100000:1.0:1746143756.023946:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963593935232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.023972:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.033971:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593935744 00000100:00100000:0.0:1746143756.033982:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593935744 00000100:00080000:1.0:1746143756.034036:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1746143756.034042:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093b04000 x1830963593935744/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.034051:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04000 with x1830963593935744 ext(4194304->4755455) 00002000:00010000:0.0:1746143756.034237:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b04000 00000100:00100000:0.0:1746143756.034266:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5964 00000100:00100000:0.0:1746143756.034286:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963593935744:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.041673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:1.0:1746143756.042445:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143756.042724:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963593935232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18777us (18920us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.042732:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5962 00002000:00100000:1.0:1746143756.042744:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093f03800 x1830963593935232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.042753:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03800 with x1830963593935232 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.042757:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03800 00000100:00100000:0.0:1746143756.046510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.046989:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593936000 00000100:00100000:1.0:1746143756.047000:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593936000 00002000:00100000:1.0:1746143756.047048:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3911680->4194303) req@ffff880093f00380 x1830963593936000/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.047059:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00380 with x1830963593936000 ext(3911680->4194303) 00010000:00010000:1.0:1746143756.047070:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093209a00/0xe984082ccd72e59c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a9d expref: 21 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.047084:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093209a00/0xe984082ccd72e59c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a9d expref: 21 pid: 8495 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.047092:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f00380 00000100:00100000:1.0:1746143756.047117:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1698 00000100:00100000:1.0:1746143756.047125:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963593936000:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143756.053269:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963593936000:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6134us (6759us total) trans 21474840316 rc 0/0 00000100:00100000:1.0:1746143756.053292:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1698 00002000:00100000:1.0:1746143756.053304:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3911680->4194303) req@ffff880093f00380 x1830963593936000/t21474840316(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/448 e 0 to 0 dl 1746143767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.053313:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00380 with x1830963593936000 ext(3911680->4194303) 00010000:00010000:1.0:1746143756.053323:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093209a00/0xe984082ccd72e59c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a9d expref: 22 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.053339:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093209a00/0xe984082ccd72e59c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3911680->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a9d expref: 22 pid: 8495 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.053345:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f00380 00000100:00100000:0.0:1746143756.053890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.057843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.062949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.063958:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593936768 00000100:00100000:1.0:1746143756.063968:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593936768 00002000:00100000:1.0:1746143756.064011:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3489792->3493887) req@ffff880093f00700 x1830963593936768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.064024:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00700 with x1830963593936768 ext(3489792->3493887) 00002000:00010000:1.0:1746143756.064029:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00700 00000100:00100000:1.0:1746143756.064060:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5965 00000100:00100000:1.0:1746143756.064067:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963593936768:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143756.064335:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963593936768:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 267us (1386us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143756.064340:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5965 00002000:00100000:1.0:1746143756.064345:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3489792->3493887) req@ffff880093f00700 x1830963593936768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.064351:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00700 with x1830963593936768 ext(3489792->3493887) 00002000:00010000:1.0:1746143756.064354:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00700 00000100:00100000:0.0:1746143756.066247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.066347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.066416:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593937152 00000100:00100000:1.0:1746143756.066424:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593937152 00002000:00100000:1.0:1746143756.066462:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093f01500 x1830963593937152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.066470:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963593937152 ext(2097152->3145727) 00002000:00010000:1.0:1746143756.066475:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01500 00000100:00100000:1.0:1746143756.066505:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5966 00000100:00100000:1.0:1746143756.066512:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963593937152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.075383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.077777:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963593937152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11264us (11428us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.077784:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5966 00002000:00100000:1.0:1746143756.077792:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093f01500 x1830963593937152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.077800:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963593937152 ext(2097152->3145727) 00010000:00010000:1.0:1746143756.077805:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 28 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.077815:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 28 pid: 4582 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.077821:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f01500 00000100:00100000:0.0:1746143756.081197:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.081750:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593937664 00000100:00100000:1.0:1746143756.081761:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593937664 00002000:00100000:1.0:1746143756.081812:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3489792->3977215) req@ffff880093f01880 x1830963593937664/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.081822:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01880 with x1830963593937664 ext(3489792->3977215) 00010000:00010000:1.0:1746143756.081831:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 28 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.081844:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 28 pid: 4582 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.081850:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f01880 00000100:00100000:1.0:1746143756.081881:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1700 00000100:00100000:1.0:1746143756.081887:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963593937664:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143756.086937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.092339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.103359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.103950:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.104022:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593938048 00000100:00100000:1.0:1746143756.104029:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593938048 00010000:00010000:1.0:1746143756.104061:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.104099:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593938176 00000100:00100000:1.0:1746143756.104101:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593938176 00010000:00010000:1.0:1746143756.104112:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c4a00/0xe984082ccd72e5a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aa4 expref: 23 pid: 8495 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.104128:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6816 00000100:00100000:1.0:1746143756.104135:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963593938048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.104170:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143756.104190:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6817 00010000:00010000:1.0:1746143756.104191:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143756.104197:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963593938176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.104201:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.104205:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143756.104219:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c4a00/0xe984082ccd72e5a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aa4 expref: 23 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.104220:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff24e00/0xe984082ccd72e5db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3489792->3977215) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ace expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.104234:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c4a00/0xe984082ccd72e5a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aa4 expref: 23 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.104236:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.104239:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.104244:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff97c00/0xe984082ccd72e5f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aea expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.104247:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c4a00/0xe984082ccd72e5a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aa4 expref: 23 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.104251:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97c00/0xe984082ccd72e5f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aea expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.104259:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.104260:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.104290:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff97c00/0xe984082ccd72e5f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aea expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.104300:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594266240:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143756.104361:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.104364:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143756.104370:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.104389:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.104397:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594266368:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143756.104419:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.107441:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594266240:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143756.107459:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.107496:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963593938048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3360us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.107504:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6816 00000100:00100000:0.0:1746143756.112048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.113890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.114981:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:1.0:1746143756.115203:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143756.129750:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.149293:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.154727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.154782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.180646:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.236104:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.239498:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.242664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.243007:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.243077:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593940224 00000100:00100000:1.0:1746143756.243085:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593940224 00010000:00010000:1.0:1746143756.243124:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c8ec00/0xe984082ccd72e502 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a3b expref: 7 pid: 4582 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.243174:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593940480 00000100:00100000:1.0:1746143756.243177:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593940480 00010000:00010000:1.0:1746143756.243188:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009133d800/0xe984082ccd72e48b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69d9 expref: 30 pid: 15784 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.243203:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6819 00000100:00100000:1.0:1746143756.243209:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593940224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.243220:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.243238:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c8ec00/0xe984082ccd72e502 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a3b expref: 7 pid: 4582 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.243248:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c8ec00/0xe984082ccd72e502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a3b expref: 7 pid: 4582 timeout: 935 lvb_type: 1 00000100:00080000:0.0:1746143756.243474:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746143756.243646:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c8ec00/0xe984082ccd72e502 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a3b expref: 7 pid: 4582 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.244255:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.244324:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593940224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1114us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.244330:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6819 00000100:00100000:0.0:1746143756.248461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.253388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.257309:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.258408:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.265861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.289538:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.292701:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.294326:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.295506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.295623:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593941888 00000100:00100000:1.0:1746143756.295627:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593941888 00010000:00010000:1.0:1746143756.295642:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff96200/0xe984082ccd72e476 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69c4 expref: 29 pid: 8495 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.295661:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6825 00000100:00100000:1.0:1746143756.295664:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593941888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.295670:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.295678:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff96200/0xe984082ccd72e476 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69c4 expref: 29 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.295684:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff96200/0xe984082ccd72e476 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69c4 expref: 29 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.295694:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff96200/0xe984082ccd72e476 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a69c4 expref: 29 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.295709:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.295711:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.295717:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c35200/0xe984082ccd72e636 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 720896->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b1b expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.295723:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c35200/0xe984082ccd72e636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 720896->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b1b expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.295746:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130c35200/0xe984082ccd72e636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 720896->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b1b expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.295755:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594267776:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143756.295812:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.297222:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594267776:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143756.297238:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.297287:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963593941888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1619us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.297296:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6825 00000100:00100000:0.0:1746143756.297449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.302254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.307757:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.307811:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.307896:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593942400 00000100:00100000:1.0:1746143756.307906:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593942400 00010000:00010000:1.0:1746143756.307946:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7c5000/0xe984082ccd72e5b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aab expref: 30 pid: 8495 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.307992:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593942528 00000100:00100000:1.0:1746143756.307995:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593942528 00010000:00010000:1.0:1746143756.308006:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c8e000/0xe984082ccd72e564 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a73 expref: 23 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.308022:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6826 00000100:00100000:1.0:1746143756.308029:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963593942400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.308042:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.308064:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7c5000/0xe984082ccd72e5b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aab expref: 30 pid: 8495 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.308073:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7c5000/0xe984082ccd72e5b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aab expref: 30 pid: 8495 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.308094:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7c5000/0xe984082ccd72e5b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6aab expref: 30 pid: 8495 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.308126:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.308188:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963593942400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 157us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.308194:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6826 00000100:00100000:0.0:1746143756.323593:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:0.0:1746143756.324280:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143756.326266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.326354:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593943168 00000100:00100000:1.0:1746143756.326360:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593943168 00000100:00100000:1.0:1746143756.326406:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3859 00000100:00100000:1.0:1746143756.326413:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:15421:x1830963593943168:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143756.326622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.326765:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:15421:x1830963593943168:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 221us (371us total) trans 8589943353 rc 0/0 00000100:00100000:1.0:1746143756.326773:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3859 00000100:00100000:0.0:1746143756.328352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.328542:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.329305:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.329331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.329415:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593943936 00000100:00100000:0.0:1746143756.329417:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593943936 00000100:00100000:0.0:1746143756.329445:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12841 00000100:00100000:0.0:1746143756.329449:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963593943936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143756.329456:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.329462:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093209a00/0xe984082ccd72e667 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6b37 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.329480:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594268672:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143756.329676:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.332706:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.332736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.332755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.332769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.332780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.332791:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143756.332858:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143755 -> 1746143756 00002000:00010000:0.0:1746143756.332861:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143755 -> 1746143756 00000100:00100000:0.0:1746143756.332881:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594268672:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143756.332911:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093209a00/0xe984082ccd72e667 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b37 expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.332925:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093209a00/0xe984082ccd72e667 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b37 expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.332940:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093209a00, rc 0) 00000100:00100000:0.0:1746143756.332978:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963593943936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3528us (3645us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143756.332986:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12841 00000100:00100000:0.0:1746143756.333038:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593944064 00000100:00100000:0.0:1746143756.333044:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593944064 00000100:00100000:0.0:1746143756.333065:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593944576 00000100:00100000:0.0:1746143756.333066:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593944576 00000100:00100000:0.0:1746143756.333077:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593944448 00000100:00100000:0.0:1746143756.333079:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593944448 00000100:00100000:0.0:1746143756.333085:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593944704 00000100:00100000:0.0:1746143756.333086:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593944704 00000100:00100000:0.0:1746143756.333096:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12843 00000100:00100000:0.0:1746143756.333101:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593944320:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143756.333109:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.333120:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6b4c expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.333137:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.333156:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.333164:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.333177:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.333186:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093209400, rc 0) 00000100:00100000:0.0:1746143756.333201:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593944320:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 100us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.333207:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12843 00000100:00100000:0.0:1746143756.333216:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12844 00000100:00100000:1.0:1746143756.333225:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12845 00000100:00100000:0.0:1746143756.333225:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593944576:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143756.333230:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143756.333234:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593944448:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143756.333236:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093208600/0xe984082ccd72e67c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6b5a expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.333242:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143756.333249:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093321800/0xe984082ccd72e683 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6b53 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.333255:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594268928:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143756.333286:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594269056:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143756.333287:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.333309:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.334735:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594268928:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143756.334754:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093208600/0xe984082ccd72e67c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b5a expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.334764:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093208600/0xe984082ccd72e67c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b5a expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.334787:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093208600, rc 0) 00000100:00100000:1.0:1746143756.334893:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593944576:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1670us (2135us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143756.334902:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12844 00000100:00100000:1.0:1746143756.335352:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594269056:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143756.335365:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093321800/0xe984082ccd72e683 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b53 expref: 6 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.335378:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093321800/0xe984082ccd72e683 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b53 expref: 6 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.335386:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093321800, rc 0) 00000100:00100000:1.0:1746143756.335413:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1962:x1830963593944448:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 2181us (2632us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143756.335418:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12845 00000100:00100000:0.0:1746143756.341774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.341830:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.341856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.342175:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5977 00000100:00100000:1.0:1746143756.342184:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963593945472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.345363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.348695:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963593945472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6505us (6830us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746143756.348706:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5977 00002000:00100000:1.0:1746143756.348716:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1359872->2097151) req@ffff8800a0a94000 x1830963593945472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.348725:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94000 with x1830963593945472 ext(1359872->2097151) 00002000:00010000:1.0:1746143756.348730:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a94000 00000100:00100000:0.0:1746143756.352834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.359210:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.359502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.359516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.359529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.359791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.359949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.360021:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593946368 00000100:00100000:1.0:1746143756.360028:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593946368 00000100:00100000:1.0:1746143756.360070:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593946624 00000100:00100000:1.0:1746143756.360072:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593946624 00000100:00100000:1.0:1746143756.360097:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593946240 00000100:00100000:1.0:1746143756.360099:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593946240 00000100:00100000:1.0:1746143756.360115:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12848 00000100:00100000:1.0:1746143756.360122:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1963:x1830963593946368:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143756.360184:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360208:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360215:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143756.360217:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143756.360220:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360249:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360260:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 20 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.360280:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594269440:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143756.360350:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.360720:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12850 00000100:00100000:1.0:1746143756.360727:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963593946624:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:0.0:1746143756.360729:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12851 00000100:00100000:0.0:1746143756.360737:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963593946240:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143756.360744:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360756:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.360759:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360762:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72e691 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b61 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.360771:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360774:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c34400/0xe984082ccd72e605 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af8 expref: 21 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.360779:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.360780:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.360781:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.360783:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.360791:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093208a00/0xe984082ccd72e5aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab2 expref: 28 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.360797:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.360798:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.360799:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c34400/0xe984082ccd72e605 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af8 expref: 21 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.360800:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360808:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c34400/0xe984082ccd72e605 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af8 expref: 21 pid: 4582 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.360817:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594269696:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143756.360817:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093208a00/0xe984082ccd72e5aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab2 expref: 28 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.360825:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093208a00/0xe984082ccd72e5aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab2 expref: 28 pid: 12618 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143756.360833:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594269952:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143756.360847:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72e691 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b61 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.360854:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72e691 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b61 expref: 9 pid: 4581 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.360861:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594270080:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143756.360864:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.360871:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 9 pid: 12618 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143756.360879:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594270208:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143756.360883:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.360894:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 28 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.360901:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594270336:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143756.360901:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.360913:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 21 pid: 8495 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.360915:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.360921:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594270592:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143756.360937:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.365317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.365345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.365349:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594269952:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143756.365360:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594270208:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143756.365367:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593947520 00000100:00100000:0.0:1746143756.365368:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594270592:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143756.365373:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593947520 00010000:00010000:0.0:1746143756.365397:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.365413:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093208a00/0xe984082ccd72e5aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab2 expref: 29 pid: 12618 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143756.365426:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594269696:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143756.365433:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594270080:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143756.365435:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593946880 00000100:00100000:1.0:1746143756.365437:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593946880 00000100:00100000:0.0:1746143756.365440:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594270336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143756.365446:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c34400/0xe984082ccd72e605 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af8 expref: 22 pid: 4582 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746143756.365454:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.365457:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6831 00000100:00100000:1.0:1746143756.365467:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963593947520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.365483:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.365506:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093208a00/0xe984082ccd72e5aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab2 expref: 29 pid: 12618 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365517:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093208a00/0xe984082ccd72e5aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab2 expref: 29 pid: 12618 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365545:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093208a00/0xe984082ccd72e5aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ab2 expref: 29 pid: 12618 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365561:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.365608:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963593947520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 144us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.365614:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6831 00000100:00100000:1.0:1746143756.365660:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594269440:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143756.365671:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.365724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.365737:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.365744:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593947136 00000100:00100000:1.0:1746143756.365746:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593947136 00010000:00010000:1.0:1746143756.365755:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72e691 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b61 expref: 10 pid: 4581 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.365767:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6833 00000100:00100000:1.0:1746143756.365771:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963593947136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.365777:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.365784:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72e691 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b61 expref: 10 pid: 4581 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365791:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72e691 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b61 expref: 10 pid: 4581 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365802:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72e691 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b61 expref: 10 pid: 4581 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365809:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.365822:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593947136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.365827:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6833 00000100:00100000:1.0:1746143756.365850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.365859:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593947392 00000100:00100000:1.0:1746143756.365861:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593947392 00010000:00010000:1.0:1746143756.365869:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 9 pid: 12618 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.365880:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6834 00000100:00100000:1.0:1746143756.365883:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593947392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.365888:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.365893:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 9 pid: 12618 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365900:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 9 pid: 12618 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365909:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093209400/0xe984082ccd72e675 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b4c expref: 9 pid: 12618 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.365920:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.365930:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963593947392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.365934:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6834 00000100:00100000:1.0:1746143756.365960:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.365972:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593946752 00000100:00100000:1.0:1746143756.365974:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593946752 00000100:00100000:0.0:1746143756.366872:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.366903:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.366918:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.366933:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.366947:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.366960:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.366977:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593948032 00000100:00100000:0.0:1746143756.366980:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593948032 00000100:00100000:0.0:1746143756.366999:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593948160 00000100:00100000:0.0:1746143756.367001:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593948160 00000100:00100000:0.0:1746143756.367010:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593948288 00000100:00100000:0.0:1746143756.367012:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593948288 00000100:00100000:0.0:1746143756.367020:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12854 00000100:00100000:0.0:1746143756.367025:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963593948032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143756.367033:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.367045:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d538200/0xe984082ccd72e6ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6b76 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.367085:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594270720:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143756.367128:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.367169:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.367231:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.367248:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593947648 00000100:00100000:0.0:1746143756.367250:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593947648 00002000:00100000:0.0:1746143756.367266:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1843200->2097151) req@ffff8800a0085880 x1830963593947648/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.367283:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085880 with x1830963593947648 ext(1843200->2097151) 00010000:00010000:0.0:1746143756.367288:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 24 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.367295:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 24 pid: 4582 timeout: 935 lvb_type: 0 00002000:00100000:1.0:1746143756.367523:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1359871) req@ffff880090767800 x1830963593946752/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.367531:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767800 with x1830963593946752 ext(1048576->1359871) 00010000:00010000:1.0:1746143756.367537:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72e63d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1359871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b22 expref: 28 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.367545:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72e63d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1359871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b22 expref: 28 pid: 4582 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.367550:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090767800 00000100:00100000:1.0:1746143756.367565:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1704 00000100:00100000:1.0:1746143756.367578:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963593946752:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143756.367854:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593947776 00000100:00100000:1.0:1746143756.367857:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593947776 00010000:00010000:1.0:1746143756.367871:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.367887:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593947904 00000100:00100000:1.0:1746143756.367890:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593947904 00010000:00010000:1.0:1746143756.367900:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 24 pid: 8495 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.367912:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6835 00000100:00100000:1.0:1746143756.367916:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963593947776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.367923:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.367937:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.367946:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.367962:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96e00/0xe984082ccd72e5fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6af1 expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.367971:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.367973:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.367977:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.367986:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368004:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.368017:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593947776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.368023:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6835 00000100:00100000:1.0:1746143756.368036:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6836 00000100:00100000:1.0:1746143756.368040:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963593947904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.368046:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.368054:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 24 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.368062:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 24 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.368071:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093209e00/0xe984082ccd72e595 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6a96 expref: 24 pid: 8495 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.368080:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.368081:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.368084:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368090:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368103:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.368113:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963593947904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.368118:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6836 00010000:00010000:1.0:1746143756.368134:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368161:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368181:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368189:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368196:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368203:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d538400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143756.368206:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368214:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368224:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.368230:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d538400/0xe984082ccd72e6d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.368262:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963593946240:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 7527us (8471us total) trans 0 rc 0/0 00002000:00010000:0.0:1746143756.368358:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0085880 00000100:00100000:0.0:1746143756.368371:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1705 00000100:00100000:0.0:1746143756.368377:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963593947648:12345-192.168.202.48@tcp:4:multiop.0 00010000:00010000:0.0:1746143756.368595:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368602:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368615:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368620:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368625:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368630:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093320400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143756.368632:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368637:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368648:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.368653:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093320400/0xe984082ccd72e6d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.368686:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963593946624:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 7961us (9169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.369684:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12851 00000100:00100000:1.0:1746143756.369704:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12859 00000100:00100000:1.0:1746143756.369711:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963593948672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143756.369718:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143756.369725:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093320c00/0xe984082ccd72e70f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6b99 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143756.369739:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a0b, atime: 0x68140a0b, ctime: 0x68140a0b, blocks: 0x1029 00010000:00010000:1.0:1746143756.369749:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.369751:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.369758:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093320c00/0xe984082ccd72e70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b99 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.369769:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093320c00/0xe984082ccd72e70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b99 expref: 23 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.369777:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093320c00, rc 0) 00000100:00100000:1.0:1746143756.369791:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963593948672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 81us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.369796:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12859 00000100:00100000:0.0:1746143756.370309:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12850 00000100:00100000:0.0:1746143756.370324:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593948800 00000100:00100000:0.0:1746143756.370329:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593948800 00000100:00100000:0.0:1746143756.370557:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12860 00000100:00100000:0.0:1746143756.370564:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31037:x1830963593948800:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143756.370572:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.370580:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d539000/0xe984082ccd72e716 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ba0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.370595:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143756.370598:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72e6c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.370604:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143756.370607:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d539000/0xe984082ccd72e716 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ba0 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.370618:0:25369:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72e6c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.370628:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d539000/0xe984082ccd72e716 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ba0 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.370635:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d539000, rc 0) 00000100:00100000:0.0:1746143756.370659:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:31037:x1830963593948800:12345-192.168.202.48@tcp:101:cat.0 Request processed in 96us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.370664:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12860 00002000:00010000:1.0:1746143756.378451:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143755 -> 1746143756 00000100:00100000:1.0:1746143756.378468:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594270720:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143756.378490:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d538200/0xe984082ccd72e6ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b76 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.378499:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d538200/0xe984082ccd72e6ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b76 expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.378513:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d538200, rc 0) 00000100:00100000:1.0:1746143756.378547:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963593948032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 11521us (11613us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143756.378554:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12854 00000100:00100000:0.0:1746143756.388031:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.388183:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.388203:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593949056 00000100:00100000:0.0:1746143756.388215:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593949056 00010000:00010000:0.0:1746143756.388246:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c35200/0xe984082ccd72e636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 720896->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b1b expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.388256:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593948928 00000100:00100000:1.0:1746143756.388261:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593948928 00000100:00100000:0.0:1746143756.388281:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6837 00000100:00100000:0.0:1746143756.388288:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963593949056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143756.388303:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143756.388310:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12861 00000100:00100000:1.0:1746143756.388316:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31040:x1830963593948928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143756.388324:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c35200/0xe984082ccd72e636 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 720896->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b1b expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.388329:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.388334:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c35200/0xe984082ccd72e636 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 720896->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b1b expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.388343:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093321a00/0xe984082ccd72e71d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ba7 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.388352:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c35200/0xe984082ccd72e636 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 720896->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b1b expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.388361:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.388365:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72e6de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.388371:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143756.388375:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093321a00/0xe984082ccd72e71d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ba7 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.388389:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.388391:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.388394:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72e6de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000020 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.388401:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72e6de lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000020 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.388654:0:12618:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72e6de lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.388661:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143756.388669:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093321a00/0xe984082ccd72e71d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ba7 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.388682:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093321a00, rc 0) 00000100:00100000:0.0:1746143756.388687:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963593949056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 400us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.388693:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6837 00000100:00100000:1.0:1746143756.388702:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31040:x1830963593948928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 387us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.388708:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12861 00000100:00100000:0.0:1746143756.390739:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963593947648:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 22358us (23504us total) trans 21474840320 rc 0/0 00000100:00100000:0.0:1746143756.390749:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1705 00002000:00100000:0.0:1746143756.390759:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1843200->2097151) req@ffff8800a0085880 x1830963593947648/t21474840320(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/448 e 0 to 0 dl 1746143767 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.390767:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085880 with x1830963593947648 ext(1843200->2097151) 00010000:00010000:0.0:1746143756.390774:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 26 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.390782:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963593946752:12345-192.168.202.48@tcp:4:cat.0 Request processed in 23204us (25055us total) trans 17179873002 rc 0/0 00010000:00010000:0.0:1746143756.390784:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 26 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.390789:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1704 00002000:00010000:0.0:1746143756.390789:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0085880 00002000:00100000:1.0:1746143756.390794:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1359871) req@ffff880090767800 x1830963593946752/t17179873002(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/448 e 0 to 0 dl 1746143767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.390801:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767800 with x1830963593946752 ext(1048576->1359871) 00010000:00010000:1.0:1746143756.390807:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72e63d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1359871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b22 expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.390815:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72e63d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1359871) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b22 expref: 30 pid: 4582 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.390820:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090767800 00000100:00100000:0.0:1746143756.393448:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.393600:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.393774:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593949440 00000100:00100000:1.0:1746143756.393779:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593949440 00002000:00100000:1.0:1746143756.393889:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800930dc000 x1830963593949440/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.393898:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc000 with x1830963593949440 ext(0->1048575) 00002000:00010000:1.0:1746143756.393901:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dc000 00000100:00100000:1.0:1746143756.393915:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5978 00000100:00100000:1.0:1746143756.393926:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963593949440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.395014:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593949568 00000100:00100000:0.0:1746143756.395017:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593949568 00010000:00010000:0.0:1746143756.395032:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 27 pid: 4582 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143756.395044:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6839 00000100:00100000:0.0:1746143756.395049:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963593949568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143756.395056:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143756.395066:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 27 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.395073:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 27 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.395085:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c34a00/0xe984082ccd72e628 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b0d expref: 27 pid: 4582 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.395095:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.395096:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.395099:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.395105:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.395212:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143756.395215:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.395223:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.395229:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963593949568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 180us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.395234:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6839 00010000:00010000:1.0:1746143756.395242:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.395248:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.395254:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.395259:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093320a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143756.395262:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.395276:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.395285:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.395290:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093320a00/0xe984082ccd72e6c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.395459:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1963:x1830963593946368:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 35337us (35956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.395465:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12848 00000100:00100000:0.0:1746143756.396553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.401698:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.401725:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593949952 00000100:00100000:0.0:1746143756.401732:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593949952 00000100:00100000:0.0:1746143756.401772:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9065 00000100:00100000:0.0:1746143756.401779:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31042:x1830963593949952:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143756.401801:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.401818:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093209c00/0xe984082ccd72e724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6bae expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.401907:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093208800/0xe984082ccd72e72b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143756.401921:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34c00/0xe984082ccd72e6b4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b6f expref: 17 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.401927:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093208800/0xe984082ccd72e72b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143756.401955:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34c00/0xe984082ccd72e6b4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b6f expref: 17 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.401966:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34c00/0xe984082ccd72e6b4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b6f expref: 17 pid: 14762 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143756.401977:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594271488:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143756.402043:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.402061:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593949440:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8138us (8459us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.402070:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5978 00002000:00100000:1.0:1746143756.402078:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800930dc000 x1830963593949440/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.402230:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc000 with x1830963593949440 ext(0->1048575) 00002000:00010000:1.0:1746143756.402235:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dc000 00000100:00100000:0.0:1746143756.403906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.404848:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593950208 00000100:00100000:1.0:1746143756.404856:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593950208 00002000:00100000:1.0:1746143756.404901:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0085500 x1830963593950208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.404909:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085500 with x1830963593950208 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.404913:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0085500 00000100:00100000:1.0:1746143756.404945:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5979 00000100:00100000:1.0:1746143756.404952:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593950208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.407492:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.408769:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.411892:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593950720 00000100:00100000:0.0:1746143756.411898:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593950720 00000100:00100000:0.0:1746143756.411933:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12862 00000100:00100000:0.0:1746143756.411937:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31040:x1830963593950720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143756.411950:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.411963:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e37a00/0xe984082ccd72e739 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6bb5 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.411982:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.411984:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.411990:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e37a00/0xe984082ccd72e739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bb5 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.412003:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e37a00/0xe984082ccd72e739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bb5 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.412011:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e37a00, rc 0) 00000100:00100000:0.0:1746143756.412043:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31040:x1830963593950720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 105us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.412048:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12862 00000100:00100000:0.0:1746143756.413752:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.416900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.416992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.417261:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593951488 00000100:00100000:1.0:1746143756.417265:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593951488 00000100:00100000:1.0:1746143756.417299:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3862 00000100:00100000:1.0:1746143756.417304:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:31035:x1830963593951488:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143756.417487:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:31035:x1830963593951488:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 182us (494us total) trans 8589943359 rc 0/0 00000100:00100000:1.0:1746143756.417494:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3862 00000100:00100000:1.0:1746143756.417789:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963593950208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12837us (13888us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.417795:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5979 00002000:00100000:1.0:1746143756.417801:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0085500 x1830963593950208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.417808:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085500 with x1830963593950208 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.417812:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0085500 00000100:00100000:0.0:1746143756.423089:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.423176:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593951616 00000100:00100000:1.0:1746143756.423187:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593951616 00000100:00100000:1.0:1746143756.423239:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12863 00000100:00100000:1.0:1746143756.423247:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31037:x1830963593951616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143756.423267:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143756.423300:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093320800/0xe984082ccd72e740 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6bbc expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143756.423326:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a0b, atime: 0x68140a0a, ctime: 0x68140a0b, blocks: 0x81d 00010000:00010000:1.0:1746143756.423348:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.423349:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.423357:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093320800/0xe984082ccd72e740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bbc expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.423377:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093320800/0xe984082ccd72e740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bbc expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.423392:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093320800, rc 0) 00000100:00100000:1.0:1746143756.423550:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:31037:x1830963593951616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 303us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.423556:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12863 00000100:00100000:0.0:1746143756.427807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.429537:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.438048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.448265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.456029:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.456905:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.464822:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.464924:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593953024 00000100:00100000:1.0:1746143756.464935:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593953024 00002000:00100000:1.0:1746143756.464984:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009cdc1c00 x1830963593953024/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.464993:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1c00 with x1830963593953024 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.464999:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1c00 00000100:00100000:1.0:1746143756.465032:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5984 00000100:00100000:1.0:1746143756.465040:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593953024:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.481383:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.481479:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.482640:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.482772:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593953408 00000100:00100000:1.0:1746143756.482777:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593953408 00000100:00100000:1.0:1746143756.482801:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12868 00000100:00100000:1.0:1746143756.482807:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963593953280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143756.482815:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143756.482824:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090671200/0xe984082ccd72e763 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6bdf expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143756.482846:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4755392, mtime: 0x68140a0c, atime: 0x68140a0b, ctime: 0x68140a0c, blocks: 0x1487 00010000:00010000:1.0:1746143756.482855:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.482856:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.482862:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090671200/0xe984082ccd72e763 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bdf expref: 32 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.482871:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090671200/0xe984082ccd72e763 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bdf expref: 32 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143756.482878:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090671200, rc 0) 00000100:00100000:1.0:1746143756.482898:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963593953280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.482904:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12868 00000100:00100000:1.0:1746143756.486508:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593953024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21455us (21684us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.486521:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5984 00002000:00100000:1.0:1746143756.486533:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009cdc1c00 x1830963593953024/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.486543:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1c00 with x1830963593953024 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.486549:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1c00 00000100:00100000:0.0:1746143756.497931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.499058:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593953664 00000100:00100000:1.0:1746143756.499070:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593953664 00002000:00100000:1.0:1746143756.499122:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009cdc3480 x1830963593953664/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.499132:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3480 with x1830963593953664 ext(2097152->3145727) 00002000:00010000:1.0:1746143756.499152:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc3480 00000100:00100000:1.0:1746143756.499189:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5985 00000100:00100000:1.0:1746143756.499197:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963593953664:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.502604:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.503199:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593954304 00000100:00100000:0.0:1746143756.503202:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593954304 00002000:00100000:0.0:1746143756.503219:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c274e00 x1830963593954304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.503226:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274e00 with x1830963593954304 ext(2097152->3145727) 00002000:00010000:0.0:1746143756.503231:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c274e00 00000100:00100000:0.0:1746143756.503241:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5987 00000100:00100000:0.0:1746143756.503245:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963593954304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.511352:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.511715:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593954560 00000100:00100000:1.0:1746143756.511725:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593954560 00002000:00100000:1.0:1746143756.511767:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009cdc0700 x1830963593954560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.511776:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0700 with x1830963593954560 ext(3145728->4194303) 00002000:00010000:1.0:1746143756.511781:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0700 00000100:00100000:1.0:1746143756.511812:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5988 00000100:00100000:1.0:1746143756.511818:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963593954560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143756.519281:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5991 00000100:00100000:1.0:1746143756.519292:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963593955328:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.519722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.520399:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593955456 00000100:00100000:0.0:1746143756.520407:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593955456 00002000:00100000:0.0:1746143756.520443:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009cdc1500 x1830963593955456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.520451:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1500 with x1830963593955456 ext(3145728->4194303) 00002000:00010000:0.0:1746143756.520457:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1500 00000100:00100000:0.0:1746143756.520474:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 5992 00000100:00100000:0.0:1746143756.520480:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593955456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143756.538014:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963593954560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26182us (26657us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.538025:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5988 00002000:00100000:1.0:1746143756.538037:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009cdc0700 x1830963593954560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.538047:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0700 with x1830963593954560 ext(3145728->4194303) 00002000:00010000:1.0:1746143756.538053:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0700 00000100:00100000:0.0:1746143756.551281:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593955840 00000100:00100000:0.0:1746143756.551290:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593955840 00000100:00100000:0.0:1746143756.551337:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9067 00000100:00100000:0.0:1746143756.551344:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:31045:x1830963593955840:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143756.551365:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.551383:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xe984082ccd72e778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6bf4 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.551475:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be6bc00/0xe984082ccd72e77f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143756.551490:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be6bc00/0xe984082ccd72e77f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143756.551501:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be6bc00/0xe984082ccd72e77f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143756.551510:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143756.551613:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xe984082ccd72e778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bf4 expref: 270 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.551644:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be6bc00/0xe984082ccd72e77f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bf4 expref: 269 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.551651:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143756.551654:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143756.551658:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be6bc00, rc 0) 00000100:00100000:0.0:1746143756.551709:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:31045:x1830963593955840:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 365us (584us total) trans 8589943360 rc 0/0 00000100:00100000:0.0:1746143756.551715:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9067 00000100:00100000:1.0:1746143756.571563:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963593955328:12345-192.168.202.48@tcp:3:cat.0 Request processed in 52260us (54685us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.571576:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 5991 00002000:00100000:1.0:1746143756.571594:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c3fad80 x1830963593955328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.571604:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830963593955328 ext(2097152->3145727) 00002000:00010000:1.0:1746143756.571612:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:0.0:1746143756.578994:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.581907:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.582017:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.589501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.589688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.590283:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6842 00000100:00100000:1.0:1746143756.590294:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963593956864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.590307:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.590328:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d539000/0xe984082ccd72e716 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ba0 expref: 33 pid: 25369 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.590349:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d539000/0xe984082ccd72e716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ba0 expref: 33 pid: 25369 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.590384:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d539000/0xe984082ccd72e716 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ba0 expref: 33 pid: 25369 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.591204:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.591230:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963593956864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 939us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.591237:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6842 00000100:00100000:0.0:1746143756.591286:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.591350:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593956992 00000100:00100000:1.0:1746143756.591354:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593956992 00010000:00010000:1.0:1746143756.591371:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093320c00/0xe984082ccd72e70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b99 expref: 24 pid: 21542 timeout: 935 lvb_type: 1 00000100:00100000:0.0:1746143756.591402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.591477:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593957120 00000100:00100000:1.0:1746143756.591480:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593957120 00010000:00010000:1.0:1746143756.591490:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093344200/0xe984082ccd72e76a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6be6 expref: 31 pid: 15784 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.591503:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6844 00000100:00100000:1.0:1746143756.591509:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593956992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143756.591514:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6845 00010000:00010000:1.0:1746143756.591516:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143756.591521:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963593957120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.591527:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093320c00/0xe984082ccd72e70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b99 expref: 24 pid: 21542 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746143756.591528:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.591534:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093320c00/0xe984082ccd72e70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b99 expref: 24 pid: 21542 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746143756.591542:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093344200/0xe984082ccd72e76a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6be6 expref: 31 pid: 15784 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.591547:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093320c00/0xe984082ccd72e70f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6b99 expref: 24 pid: 21542 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746143756.591553:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093344200/0xe984082ccd72e76a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6be6 expref: 31 pid: 15784 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746143756.592176:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093344200/0xe984082ccd72e76a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6be6 expref: 31 pid: 15784 timeout: 935 lvb_type: 1 00010000:00010000:0.0:1746143756.592190:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.592192:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.592197:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 30 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.592208:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 30 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.592230:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 30 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.592238:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594272256:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143756.592282:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143756.592570:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.592591:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963593956992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1080us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.592597:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6844 00000100:00100000:1.0:1746143756.596792:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594272256:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143756.596813:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.596861:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963593957120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5339us (5456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.596875:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6845 00000100:00100000:0.0:1746143756.601673:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.603068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.609195:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593958144 00000100:00100000:0.0:1746143756.609205:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593958144 00010000:00010000:0.0:1746143756.609244:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093345200/0xe984082ccd72e771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bed expref: 26 pid: 15784 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.609896:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593958400 00000100:00100000:1.0:1746143756.609900:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593958400 00010000:00010000:1.0:1746143756.609918:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090671200/0xe984082ccd72e763 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bdf expref: 33 pid: 8497 timeout: 935 lvb_type: 1 00000100:00100000:1.0:1746143756.609935:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593958272 00000100:00100000:1.0:1746143756.609938:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593958272 00010000:00010000:1.0:1746143756.609948:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e747 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bc3 expref: 23 pid: 8497 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.609957:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593958656 00000100:00100000:1.0:1746143756.609958:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593958656 00010000:00010000:1.0:1746143756.609965:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093320800/0xe984082ccd72e740 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bbc expref: 30 pid: 8497 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.609974:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6846 00000100:00100000:1.0:1746143756.609978:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963593958144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.609986:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.610007:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093345200/0xe984082ccd72e771 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bed expref: 27 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.610016:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093345200/0xe984082ccd72e771 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bed expref: 27 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.610031:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093345200/0xe984082ccd72e771 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bed expref: 27 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.610053:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.610076:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963593958144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.610082:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6846 00000100:00100000:1.0:1746143756.610136:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6847 00000100:00100000:1.0:1746143756.610156:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963593958400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.610164:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.610172:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090671200/0xe984082ccd72e763 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bdf expref: 33 pid: 8497 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.610180:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090671200/0xe984082ccd72e763 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bdf expref: 33 pid: 8497 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.610192:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090671200/0xe984082ccd72e763 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bdf expref: 33 pid: 8497 timeout: 935 lvb_type: 1 00010000:00010000:1.0:1746143756.610201:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.610202:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.610207:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ffb8400/0xe984082ccd72e7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c10 expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.610213:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ffb8400/0xe984082ccd72e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c10 expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.610247:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ffb8400/0xe984082ccd72e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c10 expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.610260:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594273024:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143756.610315:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.610335:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6849 00000100:00100000:1.0:1746143756.610343:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963593958656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.610349:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.610358:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093320800/0xe984082ccd72e740 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bbc expref: 30 pid: 8497 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.610366:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093320800/0xe984082ccd72e740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bbc expref: 30 pid: 8497 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.610377:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093320800/0xe984082ccd72e740 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bbc expref: 30 pid: 8497 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.610384:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.610385:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.610388:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72e7a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c17 expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.610394:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72e7a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c17 expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.610410:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72e7a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c17 expref: 21 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.610417:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594273152:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143756.610930:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.611670:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594273152:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143756.611683:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.611731:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963593958656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1389us (2399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.611739:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6849 00000100:00100000:1.0:1746143756.612092:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594273024:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143756.612101:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.612119:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963593958400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1964us (3287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.612125:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6847 00000100:00100000:0.0:1746143756.612781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.612817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.614037:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.616552:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.617263:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.704063:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.704097:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.704346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.704695:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593959936 00000100:00100000:0.0:1746143756.704698:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593959936 00000100:00100000:0.0:1746143756.704736:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593960064 00000100:00100000:0.0:1746143756.704738:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593960064 00000100:00100000:0.0:1746143756.710450:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594273536:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143756.710469:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e7d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c33 expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.710477:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e7d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c33 expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.710498:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3a1800, rc 0) 00000100:00100000:0.0:1746143756.710517:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963593959808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5196us (6463us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143756.710522:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12880 00000100:00100000:0.0:1746143756.716235:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.735930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.744591:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.744628:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.744643:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.744675:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.744754:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593960704 00000100:00100000:1.0:1746143756.744762:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593960704 00000100:00100000:1.0:1746143756.744798:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593960832 00000100:00100000:1.0:1746143756.744799:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593960832 00000100:00100000:1.0:1746143756.745008:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12884 00000100:00100000:1.0:1746143756.745012:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963593960960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143756.745036:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143756.745054:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090670e00/0xe984082ccd72e7e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6c5d expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.745104:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594273792:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143756.745171:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.748402:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.751796:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.757365:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593961472 00000100:00100000:1.0:1746143756.757375:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593961472 00010000:00010000:1.0:1746143756.757414:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9000/0xe984082ccd72e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bfb expref: 24 pid: 2839 timeout: 935 lvb_type: 0 00000100:00100000:1.0:1746143756.757445:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6850 00000100:00100000:1.0:1746143756.757453:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963593961472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143756.757467:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143756.757492:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9000/0xe984082ccd72e78d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bfb expref: 24 pid: 2839 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.757510:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9000/0xe984082ccd72e78d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bfb expref: 24 pid: 2839 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.757533:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9000/0xe984082ccd72e78d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bfb expref: 24 pid: 2839 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.757550:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.757552:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143756.757559:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.757567:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143756.757600:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143756.757614:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594274048:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143756.757686:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143756.758350:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593961600 00000100:00100000:0.0:1746143756.758355:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593961600 00000100:00100000:0.0:1746143756.758393:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12887 00000100:00100000:0.0:1746143756.758883:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31057:x1830963593961600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143756.758899:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.758911:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6c6b expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.759167:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.759169:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.759174:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.759185:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.759193:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7e800, rc 0) 00000100:00100000:0.0:1746143756.759235:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31057:x1830963593961600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 836us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.759242:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12887 00000100:00100000:0.0:1746143756.761500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.764530:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594274048:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143756.764550:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143756.764589:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963593961472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7136us (7484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143756.764600:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6850 00000100:00100000:0.0:1746143756.768519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.768563:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.768599:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.768717:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593961984 00000100:00100000:1.0:1746143756.768728:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593961984 00002000:00100000:1.0:1746143756.768779:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009ff6f480 x1830963593961984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.768791:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963593961984 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.768797:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6f480 00000100:00100000:0.0:1746143756.769257:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.769516:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593962368 00000100:00100000:1.0:1746143756.769520:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593962368 00002000:00100000:1.0:1746143756.769539:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093b04700 x1830963593962368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.769546:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04700 with x1830963593962368 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.769550:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b04700 00000100:00100000:1.0:1746143756.769561:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593962112 00000100:00100000:1.0:1746143756.769563:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593962112 00002000:00100000:1.0:1746143756.769574:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (4141056->4194303) req@ffff880093b06680 x1830963593962112/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.769580:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06680 with x1830963593962112 ext(4141056->4194303) 00010000:00010000:1.0:1746143756.769586:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 31 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.769598:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 31 pid: 15784 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.769604:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093b06680 00000100:00100000:1.0:1746143756.769613:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593962624 00000100:00100000:1.0:1746143756.769615:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593962624 00002000:00100000:1.0:1746143756.769624:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1802240->2097151) req@ffff880093b05f80 x1830963593962624/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.769635:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b05f80 with x1830963593962624 ext(1802240->2097151) 00002000:00010000:1.0:1746143756.769637:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b05f80 00000100:00100000:1.0:1746143756.769648:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1707 00000100:00100000:1.0:1746143756.769654:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963593962112:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143756.769795:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6002 00000100:00100000:1.0:1746143756.769800:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963593961984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.776371:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963593962112:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6705us (7760us total) trans 17179873004 rc 0/0 00000100:00100000:0.0:1746143756.776384:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1707 00002000:00100000:0.0:1746143756.776989:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (4141056->4194303) req@ffff880093b06680 x1830963593962112/t17179873004(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/448 e 0 to 0 dl 1746143767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.777000:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06680 with x1830963593962112 ext(4141056->4194303) 00010000:00010000:0.0:1746143756.777011:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 34 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.777032:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 34 pid: 15784 timeout: 935 lvb_type: 0 00002000:00010000:0.0:1746143756.777039:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093b06680 00000100:00100000:1.0:1746143756.784703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.784791:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593962752 00000100:00100000:0.0:1746143756.784801:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593962752 00010000:00010000:0.0:1746143756.784839:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 34 pid: 15784 timeout: 935 lvb_type: 0 00000100:00100000:0.0:1746143756.784874:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6851 00000100:00100000:0.0:1746143756.784880:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963593962752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143756.784895:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143756.784917:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 34 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.784928:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 34 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.784949:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ffb9a00/0xe984082ccd72e794 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4141056->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c02 expref: 34 pid: 15784 timeout: 935 lvb_type: 0 00010000:00010000:0.0:1746143756.784972:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.784974:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.784981:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e804 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c72 expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.784993:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c72 expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.785023:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e804 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c72 expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143756.785033:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594274304:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143756.785105:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143756.786627:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963593961984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16820us (18114us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.786637:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6002 00002000:00100000:1.0:1746143756.786646:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009ff6f480 x1830963593961984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.786656:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963593961984 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.786661:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6f480 00000100:00100000:0.0:1746143756.797220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.806639:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.811234:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.815369:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.817433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.847501:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.850707:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.859556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.859587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.860816:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593964288 00000100:00100000:1.0:1746143756.860825:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593964288 00002000:00100000:1.0:1746143756.860862:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f530380 x1830963593964288/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.860871:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f530380 with x1830963593964288 ext(3145728->4194303) 00002000:00010000:1.0:1746143756.860875:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f530380 00000100:00100000:1.0:1746143756.860893:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593964544 00000100:00100000:1.0:1746143756.860895:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593964544 00002000:00100000:1.0:1746143756.860906:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (2138112->3186687) req@ffff88008f533b80 x1830963593964544/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.860912:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533b80 with x1830963593964544 ext(2138112->3186687) 00002000:00010000:1.0:1746143756.860915:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f533b80 00000100:00100000:1.0:1746143756.860933:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6007 00000100:00100000:1.0:1746143756.860940:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963593964288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143756.864544:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.864565:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593964800 00000100:00100000:0.0:1746143756.864570:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593964800 00002000:00100000:0.0:1746143756.864596:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3186688->4194303) req@ffff88008f532d80 x1830963593964800/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143756.864604:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532d80 with x1830963593964800 ext(3186688->4194303) 00002000:00010000:0.0:1746143756.864609:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f532d80 00000100:00100000:0.0:1746143756.864626:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6009 00000100:00100000:0.0:1746143756.864632:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963593964800:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143756.864983:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593965056 00000100:00100000:1.0:1746143756.864987:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593965056 00002000:00100000:1.0:1746143756.865004:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009e5ced80 x1830963593965056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.865012:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ced80 with x1830963593965056 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.865015:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5ced80 00000100:00100000:1.0:1746143756.865033:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6010 00000100:00100000:1.0:1746143756.865038:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963593965056:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143756.874812:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963593964288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13864us (15255us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.874822:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6007 00002000:00100000:1.0:1746143756.874832:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f530380 x1830963593964288/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.874840:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f530380 with x1830963593964288 ext(3145728->4194303) 00002000:00010000:1.0:1746143756.874845:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f530380 00000100:00100000:1.0:1746143756.886950:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963593965056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21903us (22069us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143756.886960:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6010 00002000:00100000:1.0:1746143756.886970:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009e5ced80 x1830963593965056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.886979:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ced80 with x1830963593965056 ext(1048576->2097151) 00002000:00010000:1.0:1746143756.886984:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5ced80 00000100:00100000:0.0:1746143756.897718:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.899523:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.899752:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12892 00000100:00100000:0.0:1746143756.899760:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963593965312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143756.899768:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143756.899777:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093321600/0xe984082ccd72e820 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6c8e expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143756.899788:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.899789:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143756.899794:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093321600/0xe984082ccd72e820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c8e expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.899805:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093321600/0xe984082ccd72e820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c8e expref: 27 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143756.899814:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093321600, rc 0) 00000100:00100000:0.0:1746143756.899992:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963593965312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 232us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143756.899997:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12892 00000100:00100000:1.0:1746143756.900231:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.900414:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593965440 00000100:00100000:0.0:1746143756.900417:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593965440 00000100:00100000:0.0:1746143756.905918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.908447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.916458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.916504:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593965952 00000100:00100000:1.0:1746143756.916510:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593965952 00002000:00100000:1.0:1746143756.916539:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4423679) req@ffff88008f531c00 x1830963593965952/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.916547:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531c00 with x1830963593965952 ext(4194304->4423679) 00010000:00010000:1.0:1746143756.916553:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffb8400/0xe984082ccd72e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c10 expref: 35 pid: 2839 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.916564:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffb8400/0xe984082ccd72e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c10 expref: 35 pid: 2839 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.916570:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f531c00 00000100:00100000:1.0:1746143756.916593:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1710 00000100:00100000:1.0:1746143756.916599:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593965952:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143756.922326:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593965952:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5722us (5864us total) trans 21474840322 rc 0/0 00000100:00100000:1.0:1746143756.922335:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1710 00002000:00100000:1.0:1746143756.922342:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4423679) req@ffff88008f531c00 x1830963593965952/t21474840322(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/448 e 0 to 0 dl 1746143767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.922349:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f531c00 with x1830963593965952 ext(4194304->4423679) 00010000:00010000:1.0:1746143756.922357:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ffb8400/0xe984082ccd72e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c10 expref: 35 pid: 2839 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.922370:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ffb8400/0xe984082ccd72e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4423679] (req 4194304->4423679) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c10 expref: 35 pid: 2839 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.922375:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f531c00 00000100:00100000:0.0:1746143756.930691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.930791:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.940513:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.940544:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.940682:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593966464 00000100:00100000:1.0:1746143756.940689:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593966464 00002000:00100000:1.0:1746143756.940728:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4751359) req@ffff88009bfe3100 x1830963593966464/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.940736:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3100 with x1830963593966464 ext(4194304->4751359) 00002000:00010000:1.0:1746143756.940740:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3100 00000100:00100000:1.0:1746143756.940754:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593966592 00000100:00100000:1.0:1746143756.940756:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593966592 00002000:00100000:1.0:1746143756.940768:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2138111) req@ffff88009bfe0e00 x1830963593966592/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.940774:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830963593966592 ext(2097152->2138111) 00010000:00010000:1.0:1746143756.940780:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c72 expref: 27 pid: 8497 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.940792:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c72 expref: 27 pid: 8497 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.940798:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0e00 00000100:00100000:1.0:1746143756.940810:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1711 00000100:00100000:1.0:1746143756.940816:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963593966592:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143756.946439:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963593966592:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5615us (5885us total) trans 17179873006 rc 0/0 00000100:00100000:1.0:1746143756.946448:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1711 00002000:00100000:1.0:1746143756.946458:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2138111) req@ffff88009bfe0e00 x1830963593966592/t17179873006(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:152/0 lens 488/448 e 0 to 0 dl 1746143767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.946467:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830963593966592 ext(2097152->2138111) 00010000:00010000:1.0:1746143756.946475:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c72 expref: 29 pid: 8497 timeout: 935 lvb_type: 0 00010000:00010000:1.0:1746143756.946487:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1800/0xe984082ccd72e804 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c72 expref: 29 pid: 8497 timeout: 935 lvb_type: 0 00002000:00010000:1.0:1746143756.946493:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe0e00 00000100:00100000:0.0:1746143756.956782:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.956821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.956891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.963327:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.975359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.975398:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143756.976678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143756.983898:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593967488 00000100:00100000:1.0:1746143756.983908:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593967488 00002000:00100000:1.0:1746143756.983944:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009bfe1c00 x1830963593967488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/0 e 0 to 0 dl 1746143767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143756.983951:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963593967488 ext(3145728->4194303) 00002000:00010000:1.0:1746143756.983955:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:1.0:1746143756.983974:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6013 00000100:00100000:1.0:1746143756.983980:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963593967488:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143757.007103:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963593967488:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 23114us (31743us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143757.007112:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6013 00002000:00100000:1.0:1746143757.007123:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009bfe1c00 x1830963593967488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:152/0 lens 488/440 e 0 to 0 dl 1746143767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.007131:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963593967488 ext(3145728->4194303) 00002000:00010000:1.0:1746143757.007173:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:0.0:1746143757.010475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.011917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.012337:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593968128 00000100:00100000:1.0:1746143757.012340:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593968128 00000100:00100000:1.0:1746143757.012402:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12899 00000100:00100000:1.0:1746143757.012408:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31052:x1830963593968128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143757.012420:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.012429:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6cbf expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.012444:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e32000/0xe984082ccd72e83c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6caa expref: 35 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.012450:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143757.012535:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143757.012539:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 35 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.012612:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e32000/0xe984082ccd72e83c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6caa expref: 35 pid: 12618 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.012620:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e32000/0xe984082ccd72e83c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6caa expref: 35 pid: 12618 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.012628:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594275840:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143757.012688:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b422e480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.016535:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594275840:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.016551:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 34 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.016565:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06db600, rc 0) 00000100:00100000:1.0:1746143757.016586:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31052:x1830963593968128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4178us (4671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.016591:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12899 00000100:00100000:0.0:1746143757.021474:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.021527:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.021945:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593968384 00000100:00100000:1.0:1746143757.021953:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593968384 00002000:00100000:1.0:1746143757.021988:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2809856->3145727) req@ffff88012b79ed80 x1830963593968384/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.021997:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ed80 with x1830963593968384 ext(2809856->3145727) 00010000:00010000:1.0:1746143757.022004:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e32000/0xe984082ccd72e83c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6caa expref: 34 pid: 12618 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.022016:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e32000/0xe984082ccd72e83c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6caa expref: 34 pid: 12618 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746143757.022022:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79ed80 00000100:00100000:1.0:1746143757.022054:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1714 00000100:00100000:1.0:1746143757.022060:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963593968384:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143757.031575:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.031603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.031631:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.031647:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593968768 00000100:00100000:0.0:1746143757.031652:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593968768 00010000:00010000:0.0:1746143757.031673:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a39200/0xe984082ccd72e819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c87 expref: 35 pid: 12618 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.031688:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593968640 00000100:00100000:0.0:1746143757.031690:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593968640 00010000:00010000:0.0:1746143757.031697:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e32400/0xe984082ccd72e812 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c80 expref: 30 pid: 12618 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.031706:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593968896 00000100:00100000:0.0:1746143757.031708:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593968896 00010000:00010000:0.0:1746143757.031714:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a39800/0xe984082ccd72e82e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c9c expref: 31 pid: 9527 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.031725:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6857 00000100:00100000:0.0:1746143757.031730:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963593968768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.031739:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.031754:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a39200/0xe984082ccd72e819 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c87 expref: 35 pid: 12618 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.031762:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a39200/0xe984082ccd72e819 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c87 expref: 35 pid: 12618 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.031779:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a39200/0xe984082ccd72e819 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c87 expref: 35 pid: 12618 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.031792:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.032329:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963593968768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.032336:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6857 00000100:00100000:1.0:1746143757.032478:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963593968384:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 10417us (11010us total) trans 17179873007 rc 0/0 00000100:00100000:1.0:1746143757.032488:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1714 00002000:00100000:1.0:1746143757.032497:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2809856->3145727) req@ffff88012b79ed80 x1830963593968384/t17179873007(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/448 e 0 to 0 dl 1746143768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.032505:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ed80 with x1830963593968384 ext(2809856->3145727) 00010000:00010000:1.0:1746143757.032511:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e32000/0xe984082ccd72e83c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6caa expref: 36 pid: 12618 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.032521:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e32000/0xe984082ccd72e83c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6caa expref: 36 pid: 12618 timeout: 936 lvb_type: 0 00002000:00010000:1.0:1746143757.032527:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79ed80 00000100:00100000:0.0:1746143757.035182:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.039878:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593969152 00000100:00100000:0.0:1746143757.039884:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593969152 00000100:00100000:0.0:1746143757.039912:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12901 00000100:00100000:0.0:1746143757.039917:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31063:x1830963593969152:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143757.039931:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143757.039944:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72e85f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ccd expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.039970:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd72e80b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c79 expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.039977:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093321600/0xe984082ccd72e820 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c8e expref: 29 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.039982:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.039984:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.039986:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72e85f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1269760->1478655] (req 1269760->1478655) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ccd expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.040006:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093321600/0xe984082ccd72e820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c8e expref: 29 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.040016:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093321600/0xe984082ccd72e820 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c8e expref: 29 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143757.040026:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594276608:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143757.040064:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd72e80b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c79 expref: 34 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.040071:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd72e80b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c79 expref: 34 pid: 8497 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.040077:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594276736:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143757.040094:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.041342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.041360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.042765:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593969408 00000100:00100000:1.0:1746143757.042773:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593969408 00002000:00100000:1.0:1746143757.042805:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3551232->3555327) req@ffff88012b79ce00 x1830963593969408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.042813:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ce00 with x1830963593969408 ext(3551232->3555327) 00002000:00010000:1.0:1746143757.042818:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79ce00 00000100:00100000:1.0:1746143757.043447:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593969664 00000100:00100000:1.0:1746143757.043451:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593969664 00002000:00100000:1.0:1746143757.043467:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012b79f100 x1830963593969664/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.043473:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f100 with x1830963593969664 ext(3145728->4194303) 00002000:00010000:1.0:1746143757.043476:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79f100 00000100:00100000:0.0:1746143757.045059:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594276608:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143757.045111:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594276736:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143757.045135:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72e85f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1269760->1478655] (req 1269760->1478655) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ccd expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.045165:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3a0e00, rc 0) 00000100:00100000:0.0:1746143757.045185:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31063:x1830963593969152:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5268us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.045190:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12901 00000100:00100000:1.0:1746143757.047018:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593969920 00000100:00100000:1.0:1746143757.047021:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593969920 00010000:00010000:1.0:1746143757.047042:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd72e80b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c79 expref: 37 pid: 8497 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.047375:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6862 00000100:00100000:1.0:1746143757.047379:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963593969920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.047387:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.047403:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd72e80b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c79 expref: 37 pid: 8497 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.047420:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd72e80b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c79 expref: 37 pid: 8497 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.048749:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd72e80b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c79 expref: 37 pid: 8497 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.048775:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143757.048822:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963593969920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1441us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.048828:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6862 00000100:00100000:0.0:1746143757.054017:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.058235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.060885:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.062586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.066345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.069871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.092122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.097199:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.100066:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.117171:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.127382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.130363:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.144023:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.144102:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.144133:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.144162:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.144176:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.144205:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.144221:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593973760 00000100:00100000:0.0:1746143757.144223:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593973760 00002000:00100000:0.0:1746143757.144239:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093805500 x1830963593973760/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143757.144246:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805500 with x1830963593973760 ext(3145728->4194303) 00002000:00010000:0.0:1746143757.144249:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805500 00000100:00100000:0.0:1746143757.144271:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6021 00000100:00100000:0.0:1746143757.144277:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963593973248:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143757.145611:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3864 00000100:00100000:1.0:1746143757.145619:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6309850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:26913:x1830963593972992:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143757.147899:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6309850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:26913:x1830963593972992:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 2280us (3764us total) trans 8589943362 rc 0/0 00000100:00100000:1.0:1746143757.147906:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3864 00000100:00100000:1.0:1746143757.166935:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6864 00000100:00100000:1.0:1746143757.166949:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:1965:x1830963593973888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.166964:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.166973:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be6bc00/0xe984082ccd72e77f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bf4 expref: 270 pid: 20509 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.166984:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be6bc00/0xe984082ccd72e77f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bf4 expref: 270 pid: 20509 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.167000:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be6bc00/0xe984082ccd72e77f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bf4 expref: 270 pid: 20509 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.167025:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143757.167028:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47f200/0xe984082ccd72e8ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143757.167037:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47f200/0xe984082ccd72e8ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143757.167041:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47f200/0xe984082ccd72e8ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143757.167046:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143757.167104:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:1965:x1830963593973888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 159us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.167109:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6864 00000100:00100000:1.0:1746143757.167579:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593974016 00000100:00100000:1.0:1746143757.167585:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593974016 00010000:00010000:1.0:1746143757.167605:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093208800/0xe984082ccd72e72b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bae expref: 35 pid: 14763 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.167631:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6865 00000100:00100000:1.0:1746143757.167637:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1965:x1830963593974016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.167644:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.167648:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093208800/0xe984082ccd72e72b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bae expref: 35 pid: 14763 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.167659:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093208800/0xe984082ccd72e72b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bae expref: 35 pid: 14763 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.167668:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093208800/0xe984082ccd72e72b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bae expref: 35 pid: 14763 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.167676:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143757.167679:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47f200/0xe984082ccd72e8ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143757.167685:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47f200/0xe984082ccd72e8ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143757.167690:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47f200/0xe984082ccd72e8ac lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143757.167923:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143757.167940:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963593974016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 303us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.167946:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6865 00000100:00100000:0.0:1746143757.193964:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.194002:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.206131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.210249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.215761:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.215813:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593975680 00000100:00100000:1.0:1746143757.215819:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593975680 00000100:00100000:0.0:1746143757.215838:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.215852:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9070 00000100:00100000:1.0:1746143757.215858:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:31073:x1830963593975680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143757.215880:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.215894:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707a00/0xe984082ccd72e8eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6d3d expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.215965:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707c00/0xe984082ccd72e8f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.215976:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707c00/0xe984082ccd72e8f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.215984:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707c00/0xe984082ccd72e8f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.217153:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707c00/0xe984082ccd72e8f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.217159:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707c00/0xe984082ccd72e8f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143757.217170:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143757.217273:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707a00/0xe984082ccd72e8eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d3d expref: 37 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.217288:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f707c00/0xe984082ccd72e8f2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d3d expref: 36 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.217294:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143757.217296:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143757.217298:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f707c00, rc 0) 00000100:00100000:1.0:1746143757.217330:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:31073:x1830963593975680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1473us (1574us total) trans 8589943363 rc 0/0 00000100:00100000:1.0:1746143757.217339:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9070 00000100:00100000:0.0:1746143757.221724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.225051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.232856:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.238240:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.263682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.267124:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.267711:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.269582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.269647:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.269781:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593977088 00000100:00100000:1.0:1746143757.269786:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593977088 00010000:00010000:1.0:1746143757.269803:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1200/0xe984082ccd72e755 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd1 expref: 30 pid: 9527 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.269823:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6870 00000100:00100000:1.0:1746143757.269828:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963593977088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.269834:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.269846:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1200/0xe984082ccd72e755 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd1 expref: 30 pid: 9527 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.269855:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1200/0xe984082ccd72e755 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd1 expref: 30 pid: 9527 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.269867:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1200/0xe984082ccd72e755 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd1 expref: 30 pid: 9527 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.269881:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.269883:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.269889:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47e600/0xe984082ccd72e915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1712127) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d4b expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.269896:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47e600/0xe984082ccd72e915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1712127) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d4b expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.269930:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47e600/0xe984082ccd72e915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1712127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d4b expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143757.269941:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594278656:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143757.269989:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.270000:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593976832 00000100:00100000:1.0:1746143757.270002:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593976832 00000100:00100000:1.0:1746143757.270017:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12917 00000100:00100000:1.0:1746143757.270021:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963593976832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143757.270028:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.270036:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06db200/0xe984082ccd72e923 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6d52 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143757.270064:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594278784:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143757.270080:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.274642:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594278656:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143757.274652:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143757.274669:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963593977088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4841us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.274676:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6870 00000100:00100000:0.0:1746143757.275479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.286321:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.286703:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.287119:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593977728 00000100:00100000:1.0:1746143757.287124:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593977728 00002000:00100000:1.0:1746143757.287166:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1708032->1712127) req@ffff88009c274700 x1830963593977728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.287174:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274700 with x1830963593977728 ext(1708032->1712127) 00002000:00010000:1.0:1746143757.287178:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c274700 00000100:00100000:1.0:1746143757.287191:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6026 00000100:00100000:1.0:1746143757.287197:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963593977728:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143757.287322:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963593977728:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 125us (240us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143757.287328:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6026 00002000:00100000:1.0:1746143757.287332:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1708032->1712127) req@ffff88009c274700 x1830963593977728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.287339:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274700 with x1830963593977728 ext(1708032->1712127) 00002000:00010000:1.0:1746143757.287342:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c274700 00000100:00100000:0.0:1746143757.291724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.294245:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.321372:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.321473:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593978496 00000100:00100000:1.0:1746143757.321480:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593978496 00010000:00010000:1.0:1746143757.321511:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72e85f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1478655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ccd expref: 31 pid: 15784 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.321550:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6871 00000100:00100000:1.0:1746143757.321556:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963593978496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.321568:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143757.321583:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143756 -> 1746143757 00010000:00010000:1.0:1746143757.321589:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72e85f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1478655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ccd expref: 31 pid: 15784 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.321600:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72e85f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1478655) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ccd expref: 31 pid: 15784 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.321617:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72e85f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1478655) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ccd expref: 31 pid: 15784 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.321652:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.321654:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.321661:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72e92a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d60 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.321668:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72e92a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d60 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.321696:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72e92a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d60 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143757.321707:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594279040:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143757.321783:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.327096:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.356222:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.366652:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.378868:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.385978:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.412412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.412481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.414345:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.415816:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593979648 00000100:00100000:1.0:1746143757.415824:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593979648 00002000:00100000:1.0:1746143757.415864:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880130fd6680 x1830963593979648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.415872:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6680 with x1830963593979648 ext(2097152->3145727) 00002000:00010000:1.0:1746143757.415877:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd6680 00000100:00100000:0.0:1746143757.431025:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.487930:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.489994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.502898:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.504463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.517248:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.527029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.527072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.530738:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.534641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.539879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.541238:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.546678:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.546712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.546747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.546800:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593982464 00000100:00100000:0.0:1746143757.546810:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593982464 00010000:00010000:0.0:1746143757.546842:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47ec00/0xe984082ccd72e8c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d28 expref: 7 pid: 6929 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143757.546875:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593982592 00000100:00100000:0.0:1746143757.546879:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593982592 00010000:00010000:0.0:1746143757.546891:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a23a1600/0xe984082ccd72e87b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ce9 expref: 31 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143757.546907:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593982720 00000100:00100000:0.0:1746143757.546910:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593982720 00010000:00010000:0.0:1746143757.546921:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a38c00/0xe984082ccd72e874 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ce2 expref: 40 pid: 15784 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.546941:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6875 00000100:00100000:0.0:1746143757.546950:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593982464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.546962:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.546985:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c47ec00/0xe984082ccd72e8c8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d28 expref: 7 pid: 6929 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.546995:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c47ec00/0xe984082ccd72e8c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d28 expref: 7 pid: 6929 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.548935:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.554184:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.563593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.575850:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.583203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.587470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.606435:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.617215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.624449:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.638842:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.647849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.647878:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.647904:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.648508:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.655341:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.663427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.663478:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.668566:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.674123:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.674776:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.674789:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.674834:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.674886:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593986176 00000100:00100000:1.0:1746143757.674894:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593986176 00000100:00100000:1.0:1746143757.674930:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593986304 00000100:00100000:1.0:1746143757.674932:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593986304 00000100:00100000:1.0:1746143757.674942:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593986432 00000100:00100000:1.0:1746143757.674943:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593986432 00000100:00100000:1.0:1746143757.674953:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593986560 00000100:00100000:1.0:1746143757.674955:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593986560 00000100:00100000:1.0:1746143757.674966:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12926 00000100:00100000:1.0:1746143757.674972:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31083:x1830963593986176:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143757.674990:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.675006:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009573d200/0xe984082ccd72e9a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6dad expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675037:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675045:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47fe00/0xe984082ccd72e8ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d13 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.675052:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675057:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.675058:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.675061:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009573d200/0xe984082ccd72e9a8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [2027520->2097151] (req 2027520->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dad expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675087:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675097:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 32 pid: 8497 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.675108:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281088:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.675191:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47fe00/0xe984082ccd72e8ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d13 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.675198:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c47fe00/0xe984082ccd72e8ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d13 expref: 7 pid: 8495 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143757.675206:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281216:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.675227:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675234:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 34 pid: 8495 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.675240:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281344:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143757.675255:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.675284:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12927 00000100:00100000:1.0:1746143757.675290:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963593986304:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143757.675296:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.675302:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009573c400/0xe984082ccd72e9af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6db4 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675314:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.675316:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.675321:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009573c400/0xe984082ccd72e9af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6db4 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.675333:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009573c400/0xe984082ccd72e9af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6db4 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.675341:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573c400, rc 0) 00000100:00100000:1.0:1746143757.675361:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963593986304:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 72us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.675367:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12927 00000100:00100000:1.0:1746143757.675380:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12928 00000100:00100000:1.0:1746143757.675385:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963593986432:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143757.675391:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.675398:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6dbb expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675407:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.675408:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.675412:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.675420:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.675431:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573d600, rc 0) 00000100:00100000:1.0:1746143757.675445:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963593986432:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.675449:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12928 00000100:00100000:1.0:1746143757.675458:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12929 00000100:00100000:1.0:1746143757.675463:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963593986560:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143757.675468:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.675473:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6dc2 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.675481:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.678607:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.678623:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.678648:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.678659:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573d800, rc 0) 00000100:00100000:1.0:1746143757.678711:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963593986560:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3246us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.678719:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12929 00000100:00100000:0.0:1746143757.684744:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.684772:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.684812:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.684831:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593986688 00000100:00100000:0.0:1746143757.684837:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593986688 00010000:00010000:0.0:1746143757.684867:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 33 pid: 8497 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.684886:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593986816 00000100:00100000:0.0:1746143757.684888:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593986816 00010000:00010000:0.0:1746143757.684896:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47fe00/0xe984082ccd72e8ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d13 expref: 8 pid: 8495 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143757.684906:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593986944 00000100:00100000:0.0:1746143757.684908:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593986944 00010000:00010000:0.0:1746143757.684917:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 35 pid: 8495 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.684929:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6882 00000100:00100000:0.0:1746143757.684934:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1964:x1830963593986688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.684946:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.684965:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 33 pid: 8497 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.684973:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 33 pid: 8497 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.684992:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.685026:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1964:x1830963593986688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.685032:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6882 00000100:00100000:0.0:1746143757.685056:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6883 00000100:00100000:0.0:1746143757.685061:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593986816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.685067:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.685073:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c47fe00/0xe984082ccd72e8ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d13 expref: 8 pid: 8495 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.685080:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c47fe00/0xe984082ccd72e8ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d13 expref: 8 pid: 8495 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.685090:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.685104:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593986816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.685109:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6883 00000100:00100000:0.0:1746143757.685118:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6884 00000100:00100000:0.0:1746143757.685122:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963593986944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.685126:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.685131:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 35 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.685160:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 35 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.685171:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.685172:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.685178:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009573d200/0xe984082ccd72e9a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dad expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.685184:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009573d200/0xe984082ccd72e9a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dad expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.685208:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009573d200/0xe984082ccd72e9a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dad expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.685219:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594281472:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143757.685277:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143757.685562:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e800/0xe984082ccd72e7fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c6b expref: 32 pid: 8497 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.685582:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281088:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.685591:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c47fe00/0xe984082ccd72e8ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d13 expref: 7 pid: 8495 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143757.685754:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281216:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.685766:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0800/0xe984082ccd72e7da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c48 expref: 35 pid: 8495 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.685773:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.685798:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009573d200/0xe984082ccd72e9a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dad expref: 31 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.685806:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573d200, rc 0) 00000100:00100000:1.0:1746143757.686775:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31083:x1830963593986176:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11800us (12658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.686782:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12926 00000100:00100000:0.0:1746143757.687307:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.693944:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.694712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.697486:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593987456 00000100:00100000:0.0:1746143757.697492:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593987456 00000100:00100000:0.0:1746143757.697518:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593987584 00000100:00100000:0.0:1746143757.697520:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593987584 00000100:00100000:1.0:1746143757.697555:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12930 00000100:00100000:1.0:1746143757.697563:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31083:x1830963593987456:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143757.697575:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.697587:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009573de00/0xe984082ccd72e9d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6dd0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.697609:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72e92a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d60 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.697617:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009573c400/0xe984082ccd72e9af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6db4 expref: 6 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.697624:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47e200/0xe984082ccd72e962 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d7c expref: 32 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.697630:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.697632:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.697634:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009573de00/0xe984082ccd72e9d9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->1982463] (req 1048576->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dd0 expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.697658:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47e200/0xe984082ccd72e962 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d7c expref: 32 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.697668:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c47e200/0xe984082ccd72e962 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d7c expref: 32 pid: 9527 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143757.697679:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281728:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.697734:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009573c400/0xe984082ccd72e9af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6db4 expref: 6 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.697742:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009573c400/0xe984082ccd72e9af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6db4 expref: 6 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143757.697749:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281856:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.697770:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72e92a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d60 expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.697777:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72e92a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d60 expref: 34 pid: 9527 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.697783:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594281984:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143757.697796:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.697811:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12931 00000100:00100000:1.0:1746143757.697817:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963593987584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143757.697823:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.697829:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009573d400/0xe984082ccd72e9e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6dd7 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143757.698095:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594282112:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143757.698117:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.709359:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143757.713360:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime: 1746143756 -> 1746143757 00002000:00010000:1.0:1746143757.713366:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143756 -> 1746143757 00002000:00010000:1.0:1746143757.713367:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime: 1746143756 -> 1746143757 00000100:00100000:1.0:1746143757.713384:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594282112:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143757.713408:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009573d400/0xe984082ccd72e9e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dd7 expref: 35 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.713420:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009573d400/0xe984082ccd72e9e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dd7 expref: 35 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.713451:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573d400, rc 0) 00000100:00100000:0.0:1746143757.713620:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.713845:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963593987584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 16027us (16428us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143757.713856:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12931 00000100:00100000:1.0:1746143757.716413:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593988480 00000100:00100000:1.0:1746143757.716422:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593988480 00000100:00100000:1.0:1746143757.716463:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9077 00000100:00100000:1.0:1746143757.716470:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+22:31089:x1830963593988480:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143757.716489:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.716503:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009573c000/0xe984082ccd72ea0a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6df3 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.716567:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.716580:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1400/0xe984082ccd72e9cb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc9 expref: 23 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.716587:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47ec00/0xe984082ccd72e9fc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dec expref: 272 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.716593:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.716617:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47ec00/0xe984082ccd72e9fc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dec expref: 272 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.716626:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47ec00/0xe984082ccd72e9fc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dec expref: 272 pid: 21713 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.716637:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594282240:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.717908:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1400/0xe984082ccd72e9cb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc9 expref: 23 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.717917:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1400/0xe984082ccd72e9cb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc9 expref: 23 pid: 21713 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.717924:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594282368:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143757.717947:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.722653:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.723448:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0084a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594282240:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143757.723460:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594282368:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143757.723481:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143757.725254:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.725781:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143757.727955:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.727961:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143757.727998:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143757.728002:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143757.728014:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.728041:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009573c000/0xe984082ccd72ea0a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6df3 expref: 23 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.730759:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6df3 expref: 22 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.730772:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143757.730774:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143757.730778:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573d000, rc 0) 00000100:00100000:1.0:1746143757.730932:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+22:31089:x1830963593988480:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 14461us (17312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.730941:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9077 00000100:00100000:0.0:1746143757.733137:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.737618:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.740136:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.742468:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593989632 00000100:00100000:1.0:1746143757.742472:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593989632 00000100:00100000:1.0:1746143757.742502:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12936 00000100:00100000:1.0:1746143757.742508:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593989632:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143757.742516:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.742524:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009573cc00/0xe984082ccd72ea26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e08 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143757.742555:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594282880:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143757.742597:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.742795:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593989888 00000100:00100000:0.0:1746143757.742799:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593989888 00000100:00100000:0.0:1746143757.742822:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3868 00000100:00100000:0.0:1746143757.742827:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:31083:x1830963593989888:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143757.742945:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:31083:x1830963593989888:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 118us (529us total) trans 8589943372 rc 0/0 00000100:00100000:0.0:1746143757.742951:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3868 00002000:00010000:1.0:1746143757.743881:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143756 -> 1746143757 00002000:00010000:1.0:1746143757.743885:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143756 -> 1746143757 00000100:00100000:1.0:1746143757.743897:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594282880:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143757.743918:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009573cc00/0xe984082ccd72ea26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e08 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.743933:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009573cc00/0xe984082ccd72ea26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e08 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.743944:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573cc00, rc 0) 00000100:00100000:1.0:1746143757.743966:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593989632:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1458us (2244us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143757.743971:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12936 00000100:00100000:0.0:1746143757.744393:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594282752:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143757.744408:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72ea1f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e01 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.744417:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c47ea00/0xe984082ccd72ea1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e01 expref: 7 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.744427:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47ea00, rc 0) 00000100:00100000:0.0:1746143757.744447:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593989504:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4023us (4315us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143757.744452:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12935 00000100:00100000:0.0:1746143757.745574:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.748027:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.748106:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593990272 00000100:00100000:1.0:1746143757.748112:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593990272 00000100:00100000:1.0:1746143757.748648:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9078 00000100:00100000:1.0:1746143757.748656:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+22:31089:x1830963593990272:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143757.748672:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.748686:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009573c600/0xe984082ccd72ea2d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e0f expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.748812:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748825:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748833:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748843:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748848:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748854:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748859:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009573da00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143757.748863:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748869:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748877:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143757.748879:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143757.748882:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748886:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009573da00/0xe984082ccd72ea34 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143757.748910:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009573c600/0xe984082ccd72ea2d lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e0f expref: 23 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.748916:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009573c600/0xe984082ccd72ea2d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e0f expref: 23 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.748923:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009573c600, rc 0) 00000100:00100000:1.0:1746143757.749317:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+22:31089:x1830963593990272:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 661us (1291us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143757.749323:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9078 00000100:00100000:0.0:1746143757.753249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.753292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.768007:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.777311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143757.777870:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009573de00/0xe984082ccd72e9d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dd0 expref: 32 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.777886:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009573de00/0xe984082ccd72e9d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dd0 expref: 32 pid: 8495 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143757.777892:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305c8e00 00000100:00100000:3.0:1746143757.778472:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1722 00000100:00100000:3.0:1746143757.778478:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963593991040:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143757.788516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.789067:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593991168 00000100:00100000:3.0:1746143757.789075:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593991168 00000100:00100000:3.0:1746143757.789128:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12938 00000100:00100000:3.0:1746143757.789135:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31095:x1830963593991168:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143757.789166:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143757.789180:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e1d expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.789204:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 36 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.789212:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47f000/0xe984082ccd72e8d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d2f expref: 5 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.789219:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72e882 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cf0 expref: 33 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.789224:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.789226:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.789228:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2789376->3145727] (req 2789376->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 36 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.789251:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72e882 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cf0 expref: 33 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.789272:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72e882 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cf0 expref: 33 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.789282:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594283264:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.789361:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47f000/0xe984082ccd72e8d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d2f expref: 5 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.789369:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c47f000/0xe984082ccd72e8d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d2f expref: 5 pid: 6929 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.789376:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594283392:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.789512:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 36 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.789521:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 36 pid: 15784 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.789528:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594283520:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.789547:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143757.792889:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594283264:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.792898:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594283392:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.792904:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594283520:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.792927:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2789376->3145727] (req 2789376->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 36 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.792942:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47e600, rc 0) 00000100:00100000:3.0:1746143757.792988:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31095:x1830963593991168:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3853us (4478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.792995:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12938 00000100:00100000:0.0:1746143757.797637:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.797845:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.799770:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593991296 00000100:00100000:1.0:1746143757.799779:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593991296 00010000:00010000:1.0:1746143757.799809:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47f000/0xe984082ccd72e8d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d2f expref: 6 pid: 6929 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143757.799834:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593991424 00000100:00100000:1.0:1746143757.799837:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593991424 00010000:00010000:1.0:1746143757.799848:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 36 pid: 15784 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.799872:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6892 00000100:00100000:1.0:1746143757.799879:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963593991296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.799889:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.799906:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c47f000/0xe984082ccd72e8d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d2f expref: 6 pid: 6929 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143757.799917:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c47f000/0xe984082ccd72e8d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d2f expref: 6 pid: 6929 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143757.799936:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c47f000/0xe984082ccd72e8d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d2f expref: 6 pid: 6929 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143757.799953:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143757.799988:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963593991296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.799994:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6892 00000100:00100000:1.0:1746143757.800008:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6893 00000100:00100000:1.0:1746143757.800013:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963593991424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.800019:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.800026:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 36 pid: 15784 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.800033:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 36 pid: 15784 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.800044:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06db600/0xe984082ccd72e851 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cbf expref: 36 pid: 15784 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.800051:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143757.800065:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963593991424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.800069:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6893 00000100:00100000:0.0:1746143757.801032:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.801048:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593991552 00000100:00100000:0.0:1746143757.801051:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593991552 00010000:00010000:0.0:1746143757.801065:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72e882 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cf0 expref: 34 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143757.801090:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6894 00000100:00100000:0.0:1746143757.801094:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963593991552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.801099:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.801106:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72e882 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cf0 expref: 34 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.801118:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72e882 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cf0 expref: 34 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.801317:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72e882 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6cf0 expref: 34 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.801331:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.801333:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.801339:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.801346:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.801811:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 34 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.801823:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594283648:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143757.801892:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.807021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.807547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.814933:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.815186:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593992064 00000100:00100000:3.0:1746143757.815192:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593992064 00000100:00100000:3.0:1746143757.815228:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12939 00000100:00100000:3.0:1746143757.815234:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:31095:x1830963593992064:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143757.815248:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143757.815270:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e24 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.815291:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72e985 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d9f expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.815299:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47f400/0xe984082ccd72e9ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6de5 expref: 41 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.815305:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 7 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.815311:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.815313:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.815316:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->3395583] (req 3145728->3395583) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 41 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.815339:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 7 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.815349:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 7 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.815358:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594283904:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.815406:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47f400/0xe984082ccd72e9ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6de5 expref: 41 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.815414:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c47f400/0xe984082ccd72e9ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6de5 expref: 41 pid: 21542 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.815421:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594284032:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.815440:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72e985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d9f expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.815447:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72e985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d9f expref: 30 pid: 9527 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.815459:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594284160:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.815471:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143757.817937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.818776:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.818894:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594283904:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.818905:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594284032:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.818912:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594284160:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.818941:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->3395583] (req 3145728->3395583) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 41 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.818955:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47f600, rc 0) 00000100:00100000:3.0:1746143757.818993:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:31095:x1830963593992064:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3759us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.819000:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12939 00000100:00100000:0.0:1746143757.821396:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.821414:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593992576 00000100:00100000:1.0:1746143757.821420:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593992576 00000100:00100000:0.0:1746143757.821429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143757.821446:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47f400/0xe984082ccd72e9ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6de5 expref: 41 pid: 21542 timeout: 936 lvb_type: 1 00000100:00100000:1.0:1746143757.821464:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593992448 00000100:00100000:1.0:1746143757.821465:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593992448 00000100:00100000:3.0:1746143757.821472:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6896 00010000:00010000:1.0:1746143757.821472:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 8 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.821481:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963593992576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143757.821485:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6897 00000100:00100000:1.0:1746143757.821490:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593992448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143757.821492:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.821496:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.821509:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 8 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143757.821510:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c47f400/0xe984082ccd72e9ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6de5 expref: 41 pid: 21542 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143757.821519:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 8 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143757.821533:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c47f400/0xe984082ccd72e9ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6de5 expref: 41 pid: 21542 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143757.821553:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009573d800/0xe984082ccd72e9bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dc2 expref: 8 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:3.0:1746143757.821557:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c47f400/0xe984082ccd72e9ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6de5 expref: 41 pid: 21542 timeout: 936 lvb_type: 1 00010000:00010000:1.0:1746143757.821582:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143757.821583:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143757.821609:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963593992576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 130us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.821615:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6896 00000100:00100000:1.0:1746143757.821615:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963593992448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 118us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.821620:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6897 00000100:00100000:3.0:1746143757.821641:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593992832 00000100:00100000:3.0:1746143757.821643:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593992832 00002000:00100000:3.0:1746143757.821662:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305cb100 x1830963593992832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.821670:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb100 with x1830963593992832 ext(1048576->2097151) 00002000:00010000:3.0:1746143757.821673:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305cb100 00000100:00100000:3.0:1746143757.821683:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6043 00000100:00100000:3.0:1746143757.821688:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963593992832:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143757.822955:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.823012:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593992960 00000100:00100000:3.0:1746143757.823015:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593992960 00010000:00010000:3.0:1746143757.823033:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72e985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d9f expref: 31 pid: 9527 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.823063:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6898 00000100:00100000:3.0:1746143757.823069:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963593992960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143757.823076:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143757.823086:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72e985 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d9f expref: 31 pid: 9527 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.823096:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72e985 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d9f expref: 31 pid: 9527 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.823110:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72e985 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d9f expref: 31 pid: 9527 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.823120:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.823121:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.823127:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4423679] (req 3145728->3395583) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 41 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.823134:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4423679] (req 3145728->3395583) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 41 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.823187:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4423679] (req 3145728->3395583) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 41 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143757.823197:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594284288:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143757.823254:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143757.827490:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594284288:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143757.827508:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143757.827543:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963593992960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4474us (4591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.827552:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6898 00000100:00100000:0.0:1746143757.832823:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.833478:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963593992320:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14136us (15545us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143757.833485:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6042 00002000:00100000:3.0:1746143757.833490:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8801305c8000 x1830963593992320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/440 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.833497:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8000 with x1830963593992320 ext(1048576->2097151) 00002000:00010000:3.0:1746143757.833501:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8000 00000100:00100000:3.0:1746143757.833718:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963593992832:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12029us (12287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143757.833724:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6043 00002000:00100000:3.0:1746143757.833729:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305cb100 x1830963593992832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/440 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.833735:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb100 with x1830963593992832 ext(1048576->2097151) 00002000:00010000:3.0:1746143757.833738:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305cb100 00000100:00100000:0.0:1746143757.840437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.846397:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.846500:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593993600 00000100:00100000:3.0:1746143757.846508:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593993600 00000100:00100000:3.0:1746143757.846557:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12940 00000100:00100000:3.0:1746143757.846564:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:31093:x1830963593993600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143757.846582:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143757.846597:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e2b expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.846619:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.846621:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.846627:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 41 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.846640:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 41 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.846654:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47f200, rc 0) 00000100:00100000:3.0:1746143757.848075:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:31093:x1830963593993600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1507us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.848083:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12940 00000100:00100000:0.0:1746143757.861714:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.861756:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.862067:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593993984 00000100:00100000:3.0:1746143757.862075:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593993984 00002000:00100000:3.0:1746143757.862114:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305c8380 x1830963593993984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.862122:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8380 with x1830963593993984 ext(2097152->3145727) 00002000:00010000:3.0:1746143757.862126:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8380 00000100:00100000:3.0:1746143757.862160:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593994112 00000100:00100000:3.0:1746143757.862162:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593994112 00002000:00100000:3.0:1746143757.862173:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3395584->4194303) req@ffff8801305c9180 x1830963593994112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.862179:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9180 with x1830963593994112 ext(3395584->4194303) 00000100:00100000:0.0:1746143757.862180:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6045 00002000:00010000:3.0:1746143757.862182:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9180 00000100:00100000:0.0:1746143757.862189:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963593993984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143757.862192:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6046 00000100:00100000:3.0:1746143757.862197:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963593994112:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143757.864861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.864906:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.865402:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6048 00000100:00100000:0.0:1746143757.865411:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963593994368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143757.874026:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1965:x1830963593994112:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11819us (12260us total) trans 0 rc 798720/798720 00000100:00100000:3.0:1746143757.874036:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6046 00002000:00100000:3.0:1746143757.874046:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3395584->4194303) req@ffff8801305c9180 x1830963593994112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/440 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.874060:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9180 with x1830963593994112 ext(3395584->4194303) 00002000:00010000:3.0:1746143757.874065:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9180 00000100:00100000:0.0:1746143757.888441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.888838:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963593993984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26650us (27133us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143757.888846:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6045 00002000:00100000:1.0:1746143757.888854:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305c8380 x1830963593993984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/440 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.888862:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8380 with x1830963593993984 ext(2097152->3145727) 00002000:00010000:1.0:1746143757.888866:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8380 00000100:00100000:3.0:1746143757.892344:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594284416:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.892370:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72ea5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143757.892831:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963593994368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27420us (27922us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143757.892841:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6048 00002000:00100000:1.0:1746143757.892854:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3502079) req@ffff8801305c9500 x1830963593994368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 504/440 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143757.892862:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9500 with x1830963593994368 ext(2097152->3502079) 00002000:00010000:1.0:1746143757.892867:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c9500 00000100:00100000:0.0:1746143757.899521:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.899762:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593995008 00000100:00100000:3.0:1746143757.899769:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593995008 00010000:00010000:3.0:1746143757.899801:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6df3 expref: 23 pid: 20509 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.899838:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6899 00000100:00100000:3.0:1746143757.899844:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+23:1962:x1830963593995008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143757.899857:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143757.899862:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6df3 expref: 23 pid: 20509 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.899873:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6df3 expref: 23 pid: 20509 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.899891:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009573d000/0xe984082ccd72ea11 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6df3 expref: 23 pid: 20509 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.899918:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143757.899922:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72ea5e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143757.899934:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72ea5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143757.899940:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72ea5e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143757.899957:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143757.899968:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72ea5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143757.899974:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72ea5e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143757.899991:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:3.0:1746143757.900004:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+22:1962:x1830963593995008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 160us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.900009:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6899 00010000:00010000:3.0:1746143757.901101:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a0a00/0xe984082ccd72ea57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e32 expref: 41 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.901116:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72ea5e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e32 expref: 40 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.901122:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143757.901125:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143757.901127:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3a1200, rc 0) 00000100:00100000:3.0:1746143757.901722:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+40:31101:x1830963593994880:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 13195us (13286us total) trans 8589943375 rc 0/0 00000100:00100000:3.0:1746143757.901729:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9079 00000100:00100000:0.0:1746143757.907080:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.907104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.907123:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.907162:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.907189:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.907504:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12944 00000100:00100000:1.0:1746143757.907511:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963593995520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143757.907516:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143757.907521:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e505c00/0xe984082ccd72ea81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e4e expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.907532:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e505c00/0xe984082ccd72ea81 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e4e expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.907539:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e505c00/0xe984082ccd72ea81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e4e expref: 31 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143757.907549:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e505c00, rc 0) 00000100:00100000:1.0:1746143757.907562:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963593995520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 53us (399us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143757.907566:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12944 00000100:00100000:0.0:1746143757.908770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.915754:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.924175:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.924821:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.924843:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.924887:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593996032 00000100:00100000:3.0:1746143757.924893:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593996032 00000100:00100000:3.0:1746143757.924920:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12947 00000100:00100000:3.0:1746143757.924924:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:31101:x1830963593996032:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143757.924936:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143757.924948:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e63 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.924967:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47e000/0xe984082ccd72e977 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d91 expref: 31 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.924974:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47fa00/0xe984082ccd72e9e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dde expref: 43 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.924979:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 6 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.924984:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.924985:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.924987:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.925008:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 6 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.925016:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 6 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.925024:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594284800:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.925090:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47fa00/0xe984082ccd72e9e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dde expref: 43 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.925096:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c47fa00/0xe984082ccd72e9e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dde expref: 43 pid: 21542 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.925103:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594284928:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.925119:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47e000/0xe984082ccd72e977 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d91 expref: 31 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.925124:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c47e000/0xe984082ccd72e977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d91 expref: 31 pid: 9527 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.925130:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594285056:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.925166:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143757.925183:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593996416 00000100:00100000:3.0:1746143757.925185:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593996416 00002000:00100000:3.0:1746143757.925201:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0086300 x1830963593996416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.925212:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086300 with x1830963593996416 ext(1048576->2097151) 00002000:00010000:3.0:1746143757.925215:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086300 00000100:00100000:3.0:1746143757.925222:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593996288 00000100:00100000:3.0:1746143757.925223:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593996288 00002000:00100000:3.0:1746143757.925231:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0084380 x1830963593996288/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.925237:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084380 with x1830963593996288 ext(1048576->2097151) 00002000:00010000:3.0:1746143757.925239:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084380 00000100:00100000:0.0:1746143757.925247:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6049 00000100:00100000:3.0:1746143757.925252:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6050 00000100:00100000:3.0:1746143757.925266:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1962:x1830963593996288:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143757.925269:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1963:x1830963593996416:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143757.935175:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594284800:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.936463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.936500:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594284928:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.936611:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594285056:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.936635:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.936649:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c47e800, rc 0) 00000100:00100000:0.0:1746143757.936746:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593996672 00000100:00100000:0.0:1746143757.936751:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593996672 00010000:00010000:0.0:1746143757.936773:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 7 pid: 15784 timeout: 936 lvb_type: 1 00000100:00100000:0.0:1746143757.936802:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6900 00000100:00100000:0.0:1746143757.936808:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593996672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.936817:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.936833:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 7 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.936843:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 7 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.936860:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009573d600/0xe984082ccd72e9b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dbb expref: 7 pid: 15784 timeout: 936 lvb_type: 1 00010000:00010000:0.0:1746143757.937817:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143757.938415:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31101:x1830963593996032:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 13486us (14236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.938421:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12947 00000100:00100000:0.0:1746143757.938572:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593996672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1763us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.938578:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6900 00000100:00100000:0.0:1746143757.939650:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.939689:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.939754:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593996800 00000100:00100000:3.0:1746143757.939759:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593996800 00010000:00010000:3.0:1746143757.939778:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47fa00/0xe984082ccd72e9e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dde expref: 44 pid: 21542 timeout: 936 lvb_type: 1 00000100:00100000:3.0:1746143757.939908:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593996928 00000100:00100000:3.0:1746143757.939911:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593996928 00010000:00010000:3.0:1746143757.939921:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47e000/0xe984082ccd72e977 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d91 expref: 31 pid: 9527 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.941782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.942150:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593997056 00000100:00100000:1.0:1746143757.942155:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593997056 00010000:00010000:1.0:1746143757.942173:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->4423679] (req 3145728->3395583) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 43 pid: 8495 timeout: 936 lvb_type: 0 00000100:00100000:1.0:1746143757.942189:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6903 00000100:00100000:1.0:1746143757.942193:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1963:x1830963593997056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143757.942201:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143757.942211:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->4423679] (req 3145728->3395583) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 43 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.942219:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->4423679] (req 3145728->3395583) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 43 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.942231:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c47f600/0xe984082ccd72ea49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->4423679] (req 3145728->3395583) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e24 expref: 43 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:1.0:1746143757.942243:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.942245:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143757.942250:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 42 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.942265:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 42 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143757.942285:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 42 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143757.942293:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0087100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594285312:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143757.942331:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143757.944451:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0087100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594285312:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143757.944467:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143757.944809:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1963:x1830963593997056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2612us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143757.944821:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6903 00000100:00100000:3.0:1746143757.945171:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594285184:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143757.945182:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143757.945213:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963593996928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5134us (5522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.945223:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6902 00000100:00100000:0.0:1746143757.947102:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.950026:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.951691:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593997568 00000100:00100000:0.0:1746143757.951698:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593997568 00002000:00100000:0.0:1746143757.951731:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1953792->1957887) req@ffff8800a0087100 x1830963593997568/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143757.951740:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087100 with x1830963593997568 ext(1953792->1957887) 00002000:00010000:0.0:1746143757.951745:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0087100 00000100:00100000:0.0:1746143757.951777:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6052 00000100:00100000:0.0:1746143757.951784:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963593997568:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143757.951925:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963593997568:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 141us (1899us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143757.951932:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6052 00002000:00100000:0.0:1746143757.951937:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1953792->1957887) req@ffff8800a0087100 x1830963593997568/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143757.951942:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0087100 with x1830963593997568 ext(1953792->1957887) 00002000:00010000:0.0:1746143757.951945:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0087100 00000100:00100000:0.0:1746143757.953252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.953298:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593997824 00000100:00100000:3.0:1746143757.953302:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593997824 00002000:00100000:3.0:1746143757.953320:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093503100 x1830963593997824/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 504/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.953326:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963593997824 ext(1048576->2097151) 00002000:00010000:3.0:1746143757.953329:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093503100 00000100:00100000:3.0:1746143757.953347:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6053 00000100:00100000:3.0:1746143757.953352:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963593997824:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143757.962096:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.962443:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963593997824:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 9089us (9189us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746143757.962452:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6053 00002000:00100000:3.0:1746143757.962466:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093503100 x1830963593997824/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 504/440 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.962474:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963593997824 ext(1048576->2097151) 00002000:00010000:3.0:1746143757.962478:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093503100 00000100:00100000:0.0:1746143757.969476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.969506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.969541:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.969896:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12950 00000100:00100000:0.0:1746143757.969902:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31103:x1830963593998208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143757.969909:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143757.969916:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e78 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.969931:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.969933:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.969939:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 32 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.969949:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 32 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143757.969958:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06db200, rc 0) 00000100:00100000:3.0:1746143757.970160:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12951 00000100:00100000:3.0:1746143757.970167:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31101:x1830963593998336:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143757.970174:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143757.970180:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e7f expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.970194:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 43 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.970202:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 33 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.970209:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 43 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.970214:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143757.970215:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143757.970218:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->2252799] (req 2097152->2252799) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.970232:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 43 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.970242:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 43 pid: 8495 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.970249:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594285696:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143757.970483:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:31103:x1830963593998208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 581us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.970489:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12950 00010000:00010000:3.0:1746143757.970492:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 33 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.970500:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 32 pid: 4581 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.970508:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594285824:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.970528:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 43 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143757.970528:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143757.970535:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 43 pid: 25369 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.970542:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594285952:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.970552:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143757.972803:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594285696:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143757.972845:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594285568:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143757.972863:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3a0a00/0xe984082ccd72eaa4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e71 expref: 43 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.972872:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3a0a00/0xe984082ccd72eaa4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e71 expref: 43 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.972895:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3a0a00, rc 0) 00000100:00100000:0.0:1746143757.972965:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963593998080:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3288us (3493us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143757.972971:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12949 00000100:00100000:3.0:1746143757.973036:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594285824:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143757.973049:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593998592 00000100:00100000:3.0:1746143757.973052:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593998592 00010000:00010000:3.0:1746143757.973068:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 42 pid: 8495 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.973094:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6904 00000100:00100000:3.0:1746143757.973100:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963593998592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143757.973107:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143757.973117:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 42 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.973126:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 42 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.973159:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c47f200/0xe984082ccd72ea50 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e2b expref: 42 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.973181:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143757.973200:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963593998592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.973206:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6904 00000100:00100000:0.0:1746143757.974210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.974237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.974246:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593998848 00000100:00100000:3.0:1746143757.974250:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593998848 00002000:00100000:3.0:1746143757.974280:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093500000 x1830963593998848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.974288:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500000 with x1830963593998848 ext(2097152->3145727) 00010000:00010000:3.0:1746143757.974293:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 32 pid: 4581 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.974301:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 32 pid: 4581 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143757.974307:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093500000 00000100:00100000:3.0:1746143757.974320:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1724 00000100:00100000:3.0:1746143757.974326:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963593998848:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143757.980649:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.980683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.980712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.980731:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593999104 00000100:00100000:0.0:1746143757.980737:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593999104 00000100:00100000:0.0:1746143757.980784:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593999232 00000100:00100000:0.0:1746143757.980787:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593999232 00000100:00100000:0.0:1746143757.980797:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593999360 00000100:00100000:0.0:1746143757.980799:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593999360 00000100:00100000:0.0:1746143757.980811:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12952 00000100:00100000:0.0:1746143757.980817:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963593999104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143757.980832:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143757.980846:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72ead5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6e8d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143757.981435:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.981478:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.981490:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593999616 00000100:00100000:3.0:1746143757.981493:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593999616 00000100:00100000:3.0:1746143757.981504:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593999744 00000100:00100000:3.0:1746143757.981506:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593999744 00000100:00100000:3.0:1746143757.981514:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12955 00000100:00100000:3.0:1746143757.981519:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593999616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143757.981524:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143757.981530:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba2b400/0xe984082ccd72eaea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ea2 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.981538:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143757.981544:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba2b400/0xe984082ccd72eaea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ea2 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.981551:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2b400/0xe984082ccd72eaea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ea2 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.981560:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba2b400, rc 0) 00000100:00100000:3.0:1746143757.981573:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963593999616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 54us (139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143757.981577:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12955 00000100:00100000:3.0:1746143757.981584:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12956 00000100:00100000:3.0:1746143757.981588:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593999744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143757.981592:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143757.981596:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba2aa00/0xe984082ccd72eaf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ea9 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143757.981613:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594286336:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143757.981628:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00010000:00010000:0.0:1746143757.981866:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.981868:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143757.981873:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72ead5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e8d expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.981882:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72ead5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e8d expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143757.981889:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3a0e00, rc 0) 00000100:00100000:0.0:1746143757.981907:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963593999104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1090us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.981912:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12952 00000100:00100000:3.0:1746143757.982970:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963593998848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8643us (8758us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143757.982980:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1724 00002000:00100000:3.0:1746143757.982987:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093500000 x1830963593998848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/440 e 0 to 0 dl 1746143768 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.983159:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500000 with x1830963593998848 ext(2097152->3145727) 00010000:00010000:3.0:1746143757.983166:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 32 pid: 4581 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.983175:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06db200/0xe984082ccd72eaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e78 expref: 32 pid: 4581 timeout: 936 lvb_type: 0 00002000:00010000:3.0:1746143757.983181:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093500000 00000100:00100000:3.0:1746143757.983243:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594286336:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143757.983268:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ba2aa00/0xe984082ccd72eaf1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ea9 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.983276:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba2aa00/0xe984082ccd72eaf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ea9 expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143757.983283:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba2aa00, rc 0) 00000100:00100000:0.0:1746143757.983383:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963593999488 00000100:00100000:0.0:1746143757.983386:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963593999488 00010000:00010000:0.0:1746143757.983400:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 41 pid: 25369 timeout: 936 lvb_type: 0 00000100:00100000:0.0:1746143757.983421:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6906 00000100:00100000:0.0:1746143757.983426:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963593999488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.983434:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.983443:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 41 pid: 25369 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.983451:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 41 pid: 25369 timeout: 936 lvb_type: 0 00010000:00010000:0.0:1746143757.983464:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1800/0xe984082ccd72ea8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e5c expref: 41 pid: 25369 timeout: 936 lvb_type: 0 00000100:00100000:3.0:1746143757.983510:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963593999744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1920us (2029us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143757.983515:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12956 00010000:00010000:0.0:1746143757.983521:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.983535:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963593999488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.983540:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6906 00000100:00100000:0.0:1746143757.987131:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.987799:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.989329:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594286592:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143757.989345:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143757.989356:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801376cae00, rc 0) 00000100:00100000:3.0:1746143757.989380:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:31103:x1830963594000128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1510us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143757.989386:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12957 00000100:00100000:0.0:1746143757.990124:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.990380:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.991525:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143757.991678:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594000384 00000100:00100000:3.0:1746143757.991682:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594000384 00002000:00100000:3.0:1746143757.991703:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2789376->3145727) req@ffff8800a63a0a80 x1830963594000384/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.991712:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0a80 with x1830963594000384 ext(2789376->3145727) 00010000:00010000:3.0:1746143757.991718:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 35 pid: 8495 timeout: 936 lvb_type: 0 00010000:00010000:3.0:1746143757.991726:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 35 pid: 8495 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143757.991731:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a63a0a80 00000100:00100000:3.0:1746143757.991754:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1725 00000100:00100000:3.0:1746143757.991759:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594000384:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143757.994680:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.995302:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594286720:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143757.995316:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.995335:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1963:x1830963594000256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3505us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.995342:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6908 00000100:00100000:3.0:1746143757.996545:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594000384:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4782us (6162us total) trans 17179873011 rc 0/0 00000100:00100000:3.0:1746143757.996553:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1725 00002000:00100000:3.0:1746143757.996560:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2789376->3145727) req@ffff8800a63a0a80 x1830963594000384/t17179873011(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:153/0 lens 488/448 e 0 to 0 dl 1746143768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.996574:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0a80 with x1830963594000384 ext(2789376->3145727) 00010000:00010000:3.0:1746143757.996582:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 37 pid: 8495 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143757.996594:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 37 pid: 8495 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143757.996600:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a63a0a80 00000100:00100000:1.0:1746143757.997296:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143757.997613:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143757.997702:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594001024 00000100:00100000:0.0:1746143757.997706:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594001024 00010000:00010000:0.0:1746143757.997727:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801376ca000/0xe984082ccd72eaff lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb0 expref: 26 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143757.997741:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6909 00000100:00100000:0.0:1746143757.997746:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+26:1965:x1830963594001024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143757.997755:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143757.997759:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801376ca000/0xe984082ccd72eaff lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb0 expref: 26 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143757.997767:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801376ca000/0xe984082ccd72eaff lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb0 expref: 26 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143757.997781:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801376ca000/0xe984082ccd72eaff lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb0 expref: 26 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143757.997803:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143757.997807:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801376cbc00/0xe984082ccd72eb1b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143757.997816:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801376cbc00/0xe984082ccd72eb1b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143757.997821:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801376cbc00/0xe984082ccd72eb1b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143757.997834:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143757.997852:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+25:1965:x1830963594001024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143757.997857:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6909 00000100:00100000:3.0:1746143757.997990:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594000896 00000100:00100000:3.0:1746143757.997993:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594000896 00002000:00100000:3.0:1746143757.998012:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2248704->2252799) req@ffff8800a0084000 x1830963594000896/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/0 e 0 to 0 dl 1746143768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.998019:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084000 with x1830963594000896 ext(2248704->2252799) 00002000:00010000:3.0:1746143757.998022:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084000 00000100:00100000:3.0:1746143757.998032:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6054 00000100:00100000:3.0:1746143757.998036:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594000896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143757.998123:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594000896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 87us (828us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143757.998128:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6054 00002000:00100000:3.0:1746143757.998132:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2248704->2252799) req@ffff8800a0084000 x1830963594000896/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746143768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143757.998152:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084000 with x1830963594000896 ext(2248704->2252799) 00002000:00010000:3.0:1746143757.998155:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084000 00000100:00100000:0.0:1746143758.001337:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.001364:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.001375:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.001392:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594001152 00000100:00100000:3.0:1746143758.001399:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594001152 00000100:00100000:0.0:1746143758.001401:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.001431:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594001280 00000100:00100000:3.0:1746143758.001433:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594001280 00000100:00100000:0.0:1746143758.001436:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594001408 00000100:00100000:0.0:1746143758.001438:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594001408 00000100:00100000:3.0:1746143758.001444:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12958 00000100:00100000:3.0:1746143758.001450:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594001152:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:0.0:1746143758.001454:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12959 00000100:00100000:0.0:1746143758.001458:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594001280:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143758.001463:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.001463:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.001474:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72eb29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ec5 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.001474:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eb22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ecc expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.001495:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eb22 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ecc expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.001503:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eb22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ecc expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143758.001508:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594286976:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143758.001510:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3a1200, rc 0) 00000100:00100000:1.0:1746143758.001560:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594001536 00000100:00100000:1.0:1746143758.001564:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594001536 00010000:00010000:1.0:1746143758.001579:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 37 pid: 8495 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.001596:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6910 00000100:00100000:1.0:1746143758.001601:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594001536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.001608:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.001624:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 37 pid: 8495 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.001634:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 37 pid: 8495 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.001649:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c47e600/0xe984082ccd72ea42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2789376->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e1d expref: 37 pid: 8495 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.001661:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.001663:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.001668:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.001675:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.001877:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00000100:00080000:3.0:1746143758.001892:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143758.001894:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143758.001977:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594001280:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 517us (611us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143758.001983:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12959 00000100:00100000:0.0:1746143758.002018:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.002033:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594001792 00000100:00100000:0.0:1746143758.002035:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594001792 00000100:00100000:0.0:1746143758.002055:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3871 00000100:00100000:0.0:1746143758.002059:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:31101:x1830963594001792:12345-192.168.202.48@tcp:35:multiop.0 00000100:00080000:3.0:1746143758.002110:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746143758.002184:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.002192:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594287104:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143758.002290:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.002445:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+40:31101:x1830963594001792:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 384us (425us total) trans 8589943377 rc 0/0 00000100:00100000:0.0:1746143758.002451:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3871 00000100:00100000:1.0:1746143758.003905:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594287104:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143758.003920:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.003955:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594001536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2354us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.003962:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6910 00000100:00100000:3.0:1746143758.004047:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594286976:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143758.004064:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72eb29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ec5 expref: 7 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.004074:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2a400/0xe984082ccd72eb29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ec5 expref: 7 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.004085:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba2a400, rc 0) 00000100:00100000:3.0:1746143758.004102:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963594001152:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2652us (2772us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143758.004107:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12958 00000100:00100000:0.0:1746143758.007847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:3.0:1746143758.008386:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143758.010034:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.010056:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.010093:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.010100:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594002304 00000100:00100000:3.0:1746143758.010105:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594002304 00000100:00100000:0.0:1746143758.010107:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594002560 00000100:00100000:0.0:1746143758.010109:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594002560 00000100:00080000:3.0:1746143758.010121:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:3.0:1746143758.010136:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a63a0700 x1830963594002304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.010136:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093502680 x1830963594002560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.010157:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0700 with x1830963594002304 ext(2097152->3145727) 00002000:00100000:0.0:1746143758.010157:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502680 with x1830963594002560 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.010161:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a0700 00002000:00010000:0.0:1746143758.010161:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093502680 00000100:00100000:0.0:1746143758.010429:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594002816 00000100:00100000:0.0:1746143758.010432:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594002816 00002000:00100000:0.0:1746143758.010448:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093501f80 x1830963594002816/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.010454:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501f80 with x1830963594002816 ext(3145728->4194303) 00002000:00010000:0.0:1746143758.010457:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093501f80 00000100:00100000:0.0:1746143758.010468:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6055 00000100:00100000:0.0:1746143758.010472:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1962:x1830963594002304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.010763:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6056 00000100:00100000:1.0:1746143758.010767:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6057 00000100:00100000:3.0:1746143758.010768:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1962:x1830963594002560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143758.010772:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963594002816:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.014316:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.014991:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12962 00000100:00100000:3.0:1746143758.014998:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594003072:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143758.015016:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ba2ba00/0xe984082ccd72eb53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.015025:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47fc00/0xe984082ccd72ea18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dfa expref: 35 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.015032:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72ead5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e8d expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.015037:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1a00/0xe984082ccd72ea73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e40 expref: 38 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.015042:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.015044:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.015046:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba2ba00/0xe984082ccd72eb53 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.015064:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1a00/0xe984082ccd72ea73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e40 expref: 38 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.015070:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1a00/0xe984082ccd72ea73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e40 expref: 38 pid: 21542 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.015078:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594287488:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.015098:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72ead5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e8d expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.015105:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72ead5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e8d expref: 9 pid: 4581 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.015111:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594287744:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.015155:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47fc00/0xe984082ccd72ea18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dfa expref: 35 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.015162:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c47fc00/0xe984082ccd72ea18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6dfa expref: 35 pid: 8495 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.015170:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594287872:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.015183:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.016519:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.016551:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.016572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.016634:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594003328 00000100:00100000:1.0:1746143758.016639:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594003328 00000100:00100000:1.0:1746143758.016668:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594003584 00000100:00100000:1.0:1746143758.016670:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594003584 00000100:00100000:1.0:1746143758.016678:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594003456 00000100:00100000:1.0:1746143758.016680:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594003456 00000100:00100000:1.0:1746143758.016693:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12964 00000100:00100000:1.0:1746143758.016698:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594003328:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143758.016722:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016734:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016745:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143758.016746:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143758.016748:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016765:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016773:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 32 pid: 25369 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.016781:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594288384:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.016813:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.016826:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12965 00000100:00100000:1.0:1746143758.016831:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594003584:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143758.016845:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016853:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 38 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016859:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801376cbe00/0xe984082ccd72eb30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ed3 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.016863:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.016865:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.016867:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016880:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801376cbe00/0xe984082ccd72eb30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ed3 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.016886:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801376cbe00/0xe984082ccd72eb30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ed3 expref: 10 pid: 8495 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.016894:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594288512:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.016918:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 38 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.016925:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 38 pid: 2839 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.016933:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594288640:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.016947:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.026783:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594288128:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.027077:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594288256:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.027245:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594287616:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.027282:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.027524:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.027589:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594288000:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.027602:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.027648:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.027663:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.027680:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594003712 00000100:00100000:0.0:1746143758.027685:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594003712 00010000:00010000:0.0:1746143758.027712:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801376cb200/0xe984082ccd72eadc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e94 expref: 11 pid: 2839 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.027727:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594004096 00000100:00100000:0.0:1746143758.027728:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594004096 00010000:00010000:0.0:1746143758.027735:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72ea3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e16 expref: 36 pid: 8495 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.027744:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594003840 00000100:00100000:0.0:1746143758.027746:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594003840 00010000:00010000:0.0:1746143758.027753:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c47e400/0xe984082ccd72e8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d0c expref: 9 pid: 8495 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.027765:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6911 00000100:00100000:0.0:1746143758.027770:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594003712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.027780:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.027797:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801376cb200/0xe984082ccd72eadc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e94 expref: 11 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.027804:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801376cb200/0xe984082ccd72eadc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e94 expref: 11 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.027827:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801376cb200/0xe984082ccd72eadc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e94 expref: 11 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.027842:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.027872:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594003712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.027878:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6911 00000100:00100000:0.0:1746143758.027902:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6912 00000100:00100000:0.0:1746143758.027906:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594004096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.027911:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.027917:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72ea3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e16 expref: 36 pid: 8495 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.027924:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72ea3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e16 expref: 36 pid: 8495 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.027933:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0c00/0xe984082ccd72ea3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e16 expref: 36 pid: 8495 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.027941:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.027953:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594004096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.027958:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6912 00000100:00100000:0.0:1746143758.027968:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6913 00000100:00100000:0.0:1746143758.027972:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594003840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.027981:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.027991:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c47e400/0xe984082ccd72e8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d0c expref: 9 pid: 8495 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.027999:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c47e400/0xe984082ccd72e8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d0c expref: 9 pid: 8495 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.028009:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c47e400/0xe984082ccd72e8b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6d0c expref: 9 pid: 8495 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.028016:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.028028:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594003840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.028033:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6913 00000100:00100000:0.0:1746143758.028059:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.028070:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594004352 00000100:00100000:0.0:1746143758.028072:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594004352 00010000:00010000:0.0:1746143758.028081:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1600/0xe984082ccd72ea7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e47 expref: 39 pid: 21542 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.028090:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6914 00000100:00100000:0.0:1746143758.028094:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:1965:x1830963594004352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.028099:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.028105:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1600/0xe984082ccd72ea7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e47 expref: 39 pid: 21542 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.028112:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1600/0xe984082ccd72ea7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e47 expref: 39 pid: 21542 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.028122:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1600/0xe984082ccd72ea7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e47 expref: 39 pid: 21542 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.028130:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.028132:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.028135:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.028157:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.028171:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.028185:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:1965:x1830963594004352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.028190:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6914 00010000:00010000:3.0:1746143758.028497:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028505:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028525:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028531:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028538:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028548:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093208800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143758.028552:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028558:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028566:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.028571:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093208800/0xe984082ccd72eb5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.028605:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594003200:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 13485us (13836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.028611:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12963 00000100:00100000:0.0:1746143758.029592:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.029625:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.029907:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594288384:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.029923:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.031303:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.031321:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594004736 00000100:00100000:1.0:1746143758.031327:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594004736 00002000:00100000:1.0:1746143758.031360:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1953792->2097151) req@ffff8800a0a96a00 x1830963594004736/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.031374:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a96a00 with x1830963594004736 ext(1953792->2097151) 00010000:00010000:1.0:1746143758.031382:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 33 pid: 25369 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.031382:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143758.031393:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 33 pid: 25369 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746143758.031399:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0a96a00 00000100:00100000:1.0:1746143758.031418:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1726 00000100:00100000:1.0:1746143758.031424:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1962:x1830963594004736:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143758.031782:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.031805:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594003968 00000100:00100000:3.0:1746143758.031809:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594003968 00010000:00010000:3.0:1746143758.031829:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a0e00/0xe984082ccd72ead5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e8d expref: 9 pid: 4581 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.032309:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.032321:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.032332:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.032370:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.032384:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594004608 00000100:00100000:0.0:1746143758.032387:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594004608 00010000:00010000:0.0:1746143758.032398:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1a00/0xe984082ccd72ea73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e40 expref: 38 pid: 21542 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.032408:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594004864 00000100:00100000:0.0:1746143758.032410:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594004864 00010000:00010000:0.0:1746143758.032417:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801376cbe00/0xe984082ccd72eb30 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ed3 expref: 8 pid: 8495 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.032424:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594004992 00000100:00100000:0.0:1746143758.032426:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594004992 00010000:00010000:0.0:1746143758.032439:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093344400/0xe984082ccd72e75c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd8 expref: 40 pid: 15784 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.032447:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594005248 00000100:00100000:0.0:1746143758.032448:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594005248 00010000:00010000:0.0:1746143758.032455:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1c00/0xe984082ccd72e7b0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4423680->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c1e expref: 34 pid: 15784 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.032463:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6918 00000100:00100000:0.0:1746143758.032467:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:1962:x1830963594004608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.032472:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.032478:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1a00/0xe984082ccd72ea73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e40 expref: 38 pid: 21542 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.032485:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1a00/0xe984082ccd72ea73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e40 expref: 38 pid: 21542 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.032495:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1a00/0xe984082ccd72ea73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e40 expref: 38 pid: 21542 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.032635:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6919 00000100:00100000:3.0:1746143758.032641:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594004864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.032648:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.032658:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801376cbe00/0xe984082ccd72eb30 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ed3 expref: 8 pid: 8495 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.032666:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801376cbe00/0xe984082ccd72eb30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ed3 expref: 8 pid: 8495 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.032675:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.032689:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594004864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.032693:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6919 00000100:00100000:3.0:1746143758.032715:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6920 00000100:00100000:3.0:1746143758.032719:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594004992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.032724:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.032732:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093344400/0xe984082ccd72e75c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd8 expref: 40 pid: 15784 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.032739:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093344400/0xe984082ccd72e75c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd8 expref: 40 pid: 15784 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.032748:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093344400/0xe984082ccd72e75c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6bd8 expref: 40 pid: 15784 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.032756:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.032757:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.032760:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032767:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032788:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.032802:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594004992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.032807:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6920 00000100:00100000:3.0:1746143758.032819:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6921 00000100:00100000:3.0:1746143758.032823:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594005248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.032828:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.032835:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1c00/0xe984082ccd72e7b0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4423680->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c1e expref: 34 pid: 15784 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.032841:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3a1c00/0xe984082ccd72e7b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4423680->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6c1e expref: 34 pid: 15784 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.032850:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.032862:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594005248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 39us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.032866:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6921 00010000:00010000:3.0:1746143758.032882:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032888:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032902:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032911:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032917:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032922:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801376cac00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143758.032925:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032932:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032939:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.032943:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801376cac00/0xe984082ccd72eb4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.033412:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801376cbe00/0xe984082ccd72eb30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ed3 expref: 7 pid: 8495 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.033427:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594288512:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.033436:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594288640:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.033449:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.033937:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594002944:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 19068us (19626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.033944:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12961 00010000:00010000:0.0:1746143758.034270:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.034273:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.034277:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba2ba00/0xe984082ccd72eb53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.034284:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba2ba00/0xe984082ccd72eb53 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.034302:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.034323:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:1962:x1830963594004608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1855us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.034328:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6918 00000100:00080000:0.0:1746143758.034356:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143758.036505:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1962:x1830963594002560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25730us (26441us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.036514:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6056 00002000:00100000:3.0:1746143758.036523:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093502680 x1830963594002560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.036531:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502680 with x1830963594002560 ext(3145728->4194303) 00010000:00010000:3.0:1746143758.036537:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 35 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.036547:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 35 pid: 2839 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.036552:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093502680 00000100:00100000:1.0:1746143758.036836:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1962:x1830963594002816:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26062us (26741us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143758.036843:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6057 00002000:00100000:1.0:1746143758.036849:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093501f80 x1830963594002816/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.036861:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501f80 with x1830963594002816 ext(3145728->4194303) 00010000:00010000:1.0:1746143758.036868:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.036876:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746143758.036881:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093501f80 00000100:00100000:1.0:1746143758.038636:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1962:x1830963594004736:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7207us (7330us total) trans 21474840328 rc 0/0 00000100:00100000:1.0:1746143758.038645:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1726 00002000:00100000:1.0:1746143758.038652:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1953792->2097151) req@ffff8800a0a96a00 x1830963594004736/t21474840328(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.038660:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a96a00 with x1830963594004736 ext(1953792->2097151) 00010000:00010000:1.0:1746143758.038666:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 33 pid: 25369 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.038676:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c47e800/0xe984082ccd72ea96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e63 expref: 33 pid: 25369 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746143758.038682:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0a96a00 00000100:00100000:1.0:1746143758.039035:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1962:x1830963594002304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28562us (29004us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143758.039040:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6055 00002000:00100000:1.0:1746143758.039045:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a63a0700 x1830963594002304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.039052:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a0700 with x1830963594002304 ext(2097152->3145727) 00010000:00010000:1.0:1746143758.039057:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 33 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.039064:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 33 pid: 2839 timeout: 937 lvb_type: 0 00002000:00010000:1.0:1746143758.039068:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a63a0700 00000100:00100000:3.0:1746143758.040582:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1964:x1830963594005120:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7372us (8268us total) trans 21474840329 rc 0/0 00000100:00100000:3.0:1746143758.040591:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1727 00002000:00100000:3.0:1746143758.040598:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2252799) req@ffff8800a0a97100 x1830963594005120/t21474840329(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.040606:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97100 with x1830963594005120 ext(2097152->2252799) 00010000:00010000:3.0:1746143758.040613:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.040625:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.040630:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0a97100 00000100:00100000:0.0:1746143758.043986:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143758.045349:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045357:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045376:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045381:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045387:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045393:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e504a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143758.045396:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045402:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045410:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045415:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e504a00/0xe984082ccd72eb61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.045632:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963594003328:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 28932us (29114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.045640:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12964 00000100:00100000:0.0:1746143758.045837:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594005504 00000100:00100000:0.0:1746143758.045841:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594005504 00000100:00100000:0.0:1746143758.045861:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12967 00000100:00100000:0.0:1746143758.045866:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31103:x1830963594005504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.045878:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.045887:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ee1 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045903:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143758.045905:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c34c00/0xe984082ccd72eb6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045911:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143758.045915:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 33 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045926:0:4581:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880130c34c00/0xe984082ccd72eb6f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045936:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 33 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.045944:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131253200, rc 0) 00000100:00100000:0.0:1746143758.045970:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:31103:x1830963594005504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.045975:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12967 00000100:00100000:0.0:1746143758.046469:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.046585:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594005632 00000100:00100000:1.0:1746143758.046589:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594005632 00010000:00010000:1.0:1746143758.046603:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.046631:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6923 00000100:00100000:1.0:1746143758.046637:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1964:x1830963594005632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.046643:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.046654:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.046662:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.046673:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72eab2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->4423679] (req 2097152->2252799) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6e7f expref: 33 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.046689:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.046690:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.046693:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c34c00/0xe984082ccd72eb6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.046831:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c34c00/0xe984082ccd72eb6f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.046856:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.046877:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594005632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 239us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.046883:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6923 00000100:00100000:0.0:1746143758.046888:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.047945:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594005760 00000100:00100000:3.0:1746143758.047950:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594005760 00010000:00010000:3.0:1746143758.047968:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 33 pid: 2839 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.048354:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6924 00000100:00100000:3.0:1746143758.048362:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1963:x1830963594005760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.048370:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.048384:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 33 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.048394:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 33 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.048410:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801376cae00/0xe984082ccd72eb06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eb7 expref: 33 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.048421:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.048422:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.048425:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.048432:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.048456:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143758.048565:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048573:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048591:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048598:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048603:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048614:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e505000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143758.048617:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048623:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048632:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.048637:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e505000/0xe984082ccd72eb68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.048683:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1963:x1830963594005760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 321us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.048689:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6924 00000100:00100000:1.0:1746143758.048840:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963594003584:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 32008us (32287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.048847:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12965 00000100:00100000:0.0:1746143758.051493:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.051534:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.051639:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594006016 00000100:00100000:3.0:1746143758.051645:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594006016 00002000:00100000:3.0:1746143758.051679:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a0a95880 x1830963594006016/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.051687:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95880 with x1830963594006016 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.051691:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95880 00000100:00100000:3.0:1746143758.051712:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6058 00000100:00100000:3.0:1746143758.051716:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1965:x1830963594006016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.059109:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.059185:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.059223:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.059236:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.059249:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.059274:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.059302:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.060208:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594006656 00000100:00100000:1.0:1746143758.060211:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594006656 00000100:00100000:1.0:1746143758.060234:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3872 00000100:00100000:1.0:1746143758.060240:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+273:27138:x1830963594006656:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746143758.060645:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143758.062329:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+274:27138:x1830963594006656:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 2088us (3142us total) trans 8589943379 rc 0/0 00000100:00100000:1.0:1746143758.062337:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3872 00000100:00100000:3.0:1746143758.063499:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1965:x1830963594006016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11781us (12009us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.063507:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6058 00002000:00100000:3.0:1746143758.063516:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a0a95880 x1830963594006016/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.063524:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95880 with x1830963594006016 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.063528:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95880 00000100:00100000:1.0:1746143758.066312:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594007424 00000100:00100000:1.0:1746143758.066319:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594007424 00010000:00010000:1.0:1746143758.066352:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6c00/0xe984082ccd72df83 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66c9 expref: 271 pid: 14762 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.066388:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6931 00000100:00100000:1.0:1746143758.066395:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+271:1964:x1830963594007424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.066407:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.066412:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6c00/0xe984082ccd72df83 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66c9 expref: 271 pid: 14762 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.066423:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6c00/0xe984082ccd72df83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66c9 expref: 271 pid: 14762 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.066442:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130ee6c00/0xe984082ccd72df83 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a66c9 expref: 271 pid: 14762 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.066454:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.066458:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.066467:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.066473:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.066503:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143758.066525:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.066531:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143758.066545:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+270:1964:x1830963594007424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 150us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.066551:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6931 00000040:00080000:3.0:1746143758.067291:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2604, 88 off219680 00000004:00080000:3.0:1746143758.067299:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077159113ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067339:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2630, 88 off222152 00000004:00080000:3.0:1746143758.067344:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077204030ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143758.067354:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2631, 88 off222240 00000004:00080000:3.0:1746143758.067357:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077217023ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143758.067364:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2605, 88 off219768 00000004:00080000:3.0:1746143758.067367:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077226895ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067372:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2606, 88 off219856 00000004:00080000:3.0:1746143758.067375:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077235093ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067381:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2632, 88 off222328 00000004:00080000:3.0:1746143758.067383:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077243311ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143758.067389:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2633, 88 off222416 00000004:00080000:3.0:1746143758.067392:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077252148ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143758.067398:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2634, 88 off222504 00000004:00080000:3.0:1746143758.067400:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077260655ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143758.067406:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2607, 88 off219944 00000004:00080000:3.0:1746143758.067408:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077268348ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067414:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2635, 88 off222592 00000004:00080000:3.0:1746143758.067416:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077276288ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143758.067423:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2608, 88 off220032 00000004:00080000:3.0:1746143758.067425:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077285548ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067431:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2636, 88 off222680 00000004:00080000:3.0:1746143758.067433:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077293293ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143758.067438:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2609, 88 off220120 00000004:00080000:3.0:1746143758.067441:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077301098ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067446:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2610, 88 off220208 00000004:00080000:3.0:1746143758.067448:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077308598ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067453:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2611, 88 off220296 00000004:00080000:3.0:1746143758.067456:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077316165ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067461:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2612, 88 off220384 00000004:00080000:3.0:1746143758.067464:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837077323953ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143758.067469:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2637, 88 off222768 00000004:00080000:3.0:1746143758.067471:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837077331773ns, next at 833304778357ns, rc = 0 00000100:00100000:0.0:1746143758.070066:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.076133:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594007680 00000100:00100000:0.0:1746143758.076159:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594007680 00000100:00100000:0.0:1746143758.076195:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9085 00000100:00100000:0.0:1746143758.076201:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:31103:x1830963594007680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.076220:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.076237:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6eef expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.076295:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143758.076302:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 38 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.076317:0:21713:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143758.076327:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 38 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.076337:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.076339:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143758.076342:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 38 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.076347:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131253e00, rc 0) 00000100:00100000:0.0:1746143758.076381:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:31103:x1830963594007680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 180us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.076386:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9085 00000100:00100000:3.0:1746143758.080672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000001:00080000:0.0:1746143758.101402:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943377 is committed 00000001:00080000:0.0:1746143758.101421:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943360 is committed 00000001:00080000:0.0:1746143758.101425:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943347 is committed 00000004:00010000:3.0:1746143758.101432:0:20509:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a0a96680 reply state ffff8800951f1400 transno 8589943380 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00000001:00080000:0.0:1746143758.101432:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943379 is committed 00000001:00080000:0.0:1746143758.101438:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943359 is committed 00000100:00100000:3.0:1746143758.101441:0:20509:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746143758.101468:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943378 is committed 00000100:00100000:3.0:1746143758.101532:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31104:x1830963594006272:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 49458us (49994us total) trans 8589943380 rc 0/0 00000100:00100000:3.0:1746143758.101539:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9084 00000001:00080000:0.0:1746143758.101542:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943380 is committed 00000004:00080000:0.0:1746143758.101545:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1973 committed 00000004:00080000:0.0:1746143758.101550:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1949 committed 00000004:00080000:0.0:1746143758.101555:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1948 committed 00000004:00080000:0.0:1746143758.101556:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1947 committed 00000004:00080000:0.0:1746143758.101558:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1946 committed 00000004:00080000:0.0:1746143758.101559:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1972 committed 00000004:00080000:0.0:1746143758.101560:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1945 committed 00000004:00080000:0.0:1746143758.101561:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1971 committed 00000004:00080000:0.0:1746143758.101562:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1944 committed 00000004:00080000:0.0:1746143758.101563:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1970 committed 00000004:00080000:0.0:1746143758.101565:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1969 committed 00000004:00080000:0.0:1746143758.101566:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1968 committed 00000004:00080000:0.0:1746143758.101568:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1943 committed 00000004:00080000:0.0:1746143758.101569:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1942 committed 00000004:00080000:0.0:1746143758.101570:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1967 committed 00010000:00010000:3.0:1746143758.101571:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00000004:00080000:0.0:1746143758.101571:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1966 committed 00000004:00080000:0.0:1746143758.101572:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1941 committed 00010000:00010000:3.0:1746143758.101582:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801376cb000/0xe984082ccd72eb3e lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eda expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.101588:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00000004:00080000:0.0:1746143758.101611:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1965 committed 00010000:00010000:3.0:1746143758.101614:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801376cb000/0xe984082ccd72eb3e lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eda expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.101624:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801376cb000/0xe984082ccd72eb3e lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eda expref: 7 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.101634:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594290048:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.101673:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.101682:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594290176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.101713:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.101729:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594290688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.101741:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.101753:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143758.101758:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594290560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.101771:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.101779:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.101788:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.101802:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.101816:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746143758.101817:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.101824:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.101829:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.101834:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c35400 already unused, calling callback (ffffffffa1387690) 00000100:00100000:0.0:1746143758.101837:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290816:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143758.101838:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.101844:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143758.101849:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746143758.101855:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.101857:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746143758.101858:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00010000:1.0:1746143758.101861:0:3279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.101862:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290432:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143758.101869:0:3279:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.101872:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746143758.101876:0:3279:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.101880:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.101890:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746143758.101892:0:3279:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.101900:0:3279:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3279:1830963594291200:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143758.101907:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290176 00000100:00100000:0.0:1746143758.101912:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290176 00000100:00100000:1.0:1746143758.101920:0:3279:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.101939:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290688 00000100:00100000:0.0:1746143758.101941:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290688 00000100:00100000:0.0:1746143758.101949:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290560 00000100:00100000:0.0:1746143758.101951:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290560 00000100:00100000:0.0:1746143758.101958:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291072 00000100:00100000:0.0:1746143758.101959:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291072 00000100:00100000:0.0:1746143758.101966:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290304 00000100:00100000:0.0:1746143758.101967:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290304 00000100:00100000:1.0:1746143758.101971:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594291584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.101973:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290816 00000100:00100000:0.0:1746143758.101974:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290816 00000100:00100000:0.0:1746143758.101979:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290432 00000100:00100000:0.0:1746143758.101980:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290432 00000100:00100000:0.0:1746143758.101985:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290944 00000100:00100000:0.0:1746143758.101986:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290944 00000100:00100000:1.0:1746143758.101989:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.101991:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291584 00000100:00100000:0.0:1746143758.101993:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291584 00000100:00100000:1.0:1746143758.101997:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594292096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.102002:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12969 00000100:00100000:0.0:1746143758.102007:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594290176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.102009:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.102015:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143758.102019:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594291456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.102028:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.102033:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594291968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.102043:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.102078:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292096 00000100:00100000:1.0:1746143758.102080:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292096 00000100:00100000:1.0:1746143758.102090:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291456 00000100:00100000:1.0:1746143758.102091:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291456 00000100:00100000:1.0:1746143758.102097:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291968 00000100:00100000:1.0:1746143758.102098:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291968 00000100:00100000:1.0:1746143758.102104:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12970 00000100:00100000:1.0:1746143758.102108:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594290688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.102188:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594290176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (474us total) trans 21474840330 rc 0/0 00000100:00100000:0.0:1746143758.102193:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12969 00000100:00100000:1.0:1746143758.102205:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594290688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (462us total) trans 21474840331 rc 0/0 00000100:00100000:0.0:1746143758.102209:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12971 00000100:00100000:1.0:1746143758.102212:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12970 00000100:00100000:0.0:1746143758.102213:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594290560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.102219:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12972 00000100:00100000:1.0:1746143758.102223:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594291072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.102279:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12973 00000100:00100000:0.0:1746143758.102283:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963594290304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.102294:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594291072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (504us total) trans 21474840332 rc 0/0 00000100:00100000:1.0:1746143758.102299:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12972 00000100:00100000:1.0:1746143758.102309:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12974 00000100:00100000:1.0:1746143758.102312:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963594290816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.102365:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3292:x1830963594290304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (547us total) trans 21474840334 rc 0/0 00000100:00100000:1.0:1746143758.102370:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3292:x1830963594290816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (520us total) trans 21474840335 rc 0/0 00000100:00100000:0.0:1746143758.102370:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12973 00000100:00100000:1.0:1746143758.102374:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12974 00000100:00100000:0.0:1746143758.102380:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12975 00000100:00100000:1.0:1746143758.102383:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12976 00000100:00100000:0.0:1746143758.102384:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963594290432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.102386:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963594290944:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143758.102415:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a97480/2, rc 0, transno 21474840334 00000100:00100000:1.0:1746143758.102422:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143758.102430:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a95f80/2, rc 0, transno 21474840335 00000100:00100000:1.0:1746143758.102432:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.102452:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291328:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143758.102456:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:0.0:1746143758.102458:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.102460:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143755 -> 1746143755 00002000:00010000:0.0:1746143758.102462:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.102464:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5255 00000100:00100000:1.0:1746143758.102467:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.102475:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.102480:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963594290432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (606us total) trans 21474840336 rc 0/0 00000100:00100000:0.0:1746143758.102484:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12975 00000100:00100000:1.0:1746143758.102486:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.102491:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594292352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.102493:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291328 00000100:00100000:0.0:1746143758.102496:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291328 00000100:00100000:1.0:1746143758.102502:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.102503:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291840 00000100:00100000:0.0:1746143758.102505:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291840 00000100:00100000:0.0:1746143758.102509:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12977 00000004:00080000:1.0:1746143758.102512:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094306d80/2, rc 0, transno 21474840332 00000100:00100000:0.0:1746143758.102513:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3293:x1830963594291584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.102515:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143758.102521:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a96300/2, rc 0, transno 21474840330 00000100:00100000:1.0:1746143758.102522:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594290176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143758.102527:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a95c00/2, rc 0, transno 21474840331 00000100:00100000:1.0:1746143758.102529:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594290688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.102534:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143758.102537:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.102550:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.102556:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594292224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.102568:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143758.102581:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a94a80/2, rc 0, transno 21474840336 00000100:00100000:1.0:1746143758.102584:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290432:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143758.102594:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143758.102596:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.102598:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.102600:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.102601:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143758.102619:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3293:x1830963594291584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (629us total) trans 17179873012 rc 0/0 00000100:00100000:0.0:1746143758.102624:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12977 00000100:00100000:0.0:1746143758.102634:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292352 00000100:00100000:0.0:1746143758.102636:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292352 00000100:00100000:1.0:1746143758.102642:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3292:x1830963594290944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 255us (750us total) trans 21474840337 rc 0/0 00000100:00100000:0.0:1746143758.102642:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291712 00000100:00100000:0.0:1746143758.102644:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291712 00000100:00100000:1.0:1746143758.102646:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12976 00000100:00100000:0.0:1746143758.102649:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292224 00000100:00100000:0.0:1746143758.102650:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292224 00000100:00100000:1.0:1746143758.102654:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12978 00000100:00100000:1.0:1746143758.102657:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594292096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.102739:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12979 00000100:00100000:0.0:1746143758.102743:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594291456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.102818:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594291456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (788us total) trans 17179873014 rc 0/0 00000100:00100000:0.0:1746143758.102822:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12979 00000100:00100000:0.0:1746143758.102830:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12980 00000100:00100000:0.0:1746143758.102833:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594291968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.102889:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594291968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (844us total) trans 17179873015 rc 0/0 00000100:00100000:0.0:1746143758.102893:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12980 00000100:00100000:0.0:1746143758.102900:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12981 00000100:00100000:0.0:1746143758.102903:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594291328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143758.103024:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12982 00000100:00100000:3.0:1746143758.103029:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594291840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143758.103110:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963594291840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (622us total) trans 17179873017 rc 0/0 00000100:00100000:3.0:1746143758.103118:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12982 00000100:00100000:3.0:1746143758.103129:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12983 00000100:00100000:3.0:1746143758.103133:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594292352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.103213:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3295:x1830963594292352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (710us total) trans 21474840338 rc 0/0 00000100:00100000:3.0:1746143758.103218:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12983 00000100:00100000:3.0:1746143758.103228:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12984 00000100:00100000:3.0:1746143758.103232:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594291712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143758.103300:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143758.103302:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143758.103303:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143758.103305:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143758.103307:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143758.103323:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963594291712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (772us total) trans 17179873018 rc 0/0 00000100:00100000:3.0:1746143758.103328:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12984 00000100:00100000:3.0:1746143758.103338:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12985 00000100:00100000:3.0:1746143758.103341:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594292224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143758.103404:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3295:x1830963594292224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (835us total) trans 17179873019 rc 0/0 00000100:00100000:3.0:1746143758.103409:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12985 00000100:00100000:1.0:1746143758.103624:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594292096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 965us (1613us total) trans 17179873013 rc 0/0 00000100:00100000:1.0:1746143758.103629:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12978 00000100:00100000:1.0:1746143758.103648:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179872990 gen 2 00000004:00080000:1.0:1746143758.103652:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b04380, transno 17179872947 00000004:00080000:1.0:1746143758.103658:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c276300, transno 17179872948 00000004:00080000:1.0:1746143758.103660:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b07800, transno 17179872949 00000004:00080000:1.0:1746143758.103662:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b06300, transno 17179872950 00000004:00080000:1.0:1746143758.103664:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b07480, transno 17179872951 00000004:00080000:1.0:1746143758.103665:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b06d80, transno 17179872952 00000004:00080000:1.0:1746143758.103667:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b05c00, transno 17179872953 00000004:00080000:1.0:1746143758.103669:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b06a00, transno 17179872954 00000004:00080000:1.0:1746143758.103671:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d82300, transno 17179872958 00000004:00080000:1.0:1746143758.103673:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767100, transno 17179872959 00000004:00080000:1.0:1746143758.103675:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093804e00, transno 17179872960 00000004:00080000:1.0:1746143758.103677:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d82d80, transno 17179872961 00000004:00080000:1.0:1746143758.103679:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093805c00, transno 17179872962 00000004:00080000:1.0:1746143758.103681:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767b80, transno 17179872963 00000004:00080000:1.0:1746143758.103682:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767480, transno 17179872964 00000004:00080000:1.0:1746143758.103684:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093806a00, transno 17179872965 00000004:00080000:1.0:1746143758.103687:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0086a00, transno 17179872966 00000004:00080000:1.0:1746143758.103689:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0084e00, transno 17179872967 00000004:00080000:1.0:1746143758.103691:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0a97800, transno 17179872968 00000004:00080000:1.0:1746143758.103694:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0086680, transno 17179872969 00000004:00080000:1.0:1746143758.103696:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085180, transno 17179872970 00000004:00080000:1.0:1746143758.103698:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085c00, transno 17179872971 00000004:00080000:1.0:1746143758.103700:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085f80, transno 17179872972 00000004:00080000:1.0:1746143758.103702:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0086d80, transno 17179872973 00000004:00080000:1.0:1746143758.103704:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0af100, transno 17179872975 00000004:00080000:1.0:1746143758.103706:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ad880, transno 17179872976 00000004:00080000:1.0:1746143758.103707:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ad500, transno 17179872977 00000004:00080000:1.0:1746143758.103709:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0adc00, transno 17179872978 00000004:00080000:1.0:1746143758.103711:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ae300, transno 17179872979 00000004:00080000:1.0:1746143758.103713:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ace00, transno 17179872980 00000004:00080000:1.0:1746143758.103715:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0aea00, transno 17179872981 00000004:00080000:1.0:1746143758.103717:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0af800, transno 17179872982 00000004:00080000:1.0:1746143758.103720:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6c000, transno 17179872983 00000004:00080000:1.0:1746143758.103722:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f02300, transno 17179872984 00000004:00080000:1.0:1746143758.103724:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6f100, transno 17179872985 00000004:00080000:1.0:1746143758.103726:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f03100, transno 17179872986 00000004:00080000:1.0:1746143758.103728:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6dc00, transno 17179872987 00000004:00080000:1.0:1746143758.103730:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c13100, transno 17179872988 00000004:00080000:1.0:1746143758.103732:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6f800, transno 17179872989 00000004:00080000:1.0:1746143758.103734:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c11c00, transno 17179872990 00000100:00100000:1.0:1746143758.103739:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012fc12300 x1830963594291456/t17179873014(17179873014) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143774 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143758.103751:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc12300/2, rc 0, transno 17179873014 00000100:00100000:1.0:1746143758.103754:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594291456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.103763:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc11500/2, rc 0, transno 17179873015 00000100:00100000:1.0:1746143758.103765:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594291968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.103772:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc12680/2, rc 0, transno 17179873012 00000100:00100000:1.0:1746143758.103774:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594291584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.103779:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc13100/2, rc 0, transno 17179873013 00000100:00100000:1.0:1746143758.103781:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594292096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.103980:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594291328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1075us (1511us total) trans 17179873016 rc 0/0 00000100:00100000:0.0:1746143758.103985:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12981 00000004:00080000:1.0:1746143758.104403:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 40 done 00000004:00080000:1.0:1746143758.104421:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094305f80/2, rc 0, transno 21474840337 00000100:00100000:1.0:1746143758.104424:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594290944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143758.104435:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc13480/2, rc 0, transno 17179873018 00000100:00100000:1.0:1746143758.104437:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.104442:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc10e00/2, rc 0, transno 17179873019 00000100:00100000:1.0:1746143758.104444:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594292224:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.104449:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc11880/2, rc 0, transno 17179873016 00000100:00100000:1.0:1746143758.104451:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.104455:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc11c00/2, rc 0, transno 17179873017 00000100:00100000:1.0:1746143758.104457:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594291840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.104461:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3cb100/2, rc 0, transno 21474840338 00000100:00100000:1.0:1746143758.104463:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594292352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.104504:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594290560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2290us (2732us total) trans 21474840333 rc 0/0 00000100:00100000:1.0:1746143758.104509:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12971 00000004:00080000:0.0:1746143758.104644:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0a94e00/2, rc 0, transno 21474840333 00000100:00100000:3.0:1746143758.104646:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.104647:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594290560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.104685:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594290048:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143758.104697:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143758.105512:0:3279:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3279:1830963594291200:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143758.105523:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.105528:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35400/0xe984082ccd72eb7d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 20509 initiator: MDT0 00000100:00100000:3.0:1746143758.105772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143758.106010:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106016:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143758.106029:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143758.106115:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106121:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106126:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106130:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3a1200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.106133:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106154:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106161:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.106163:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143758.106165:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106169:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3a1200/0xe984082ccd72eba7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106184:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1c00/0xe984082ccd72eb99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106188:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1c00/0xe984082ccd72eb99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106192:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1c00/0xe984082ccd72eb99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106196:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a23a1c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.106198:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1c00/0xe984082ccd72eb99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106202:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1c00/0xe984082ccd72eb99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106207:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143758.106209:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143758.106211:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1c00/0xe984082ccd72eb99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106220:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1c00/0xe984082ccd72eb99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106227:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1000/0xe984082ccd72eba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106231:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1000/0xe984082ccd72eba0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106234:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1000/0xe984082ccd72eba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106238:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a23a1000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.106240:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1000/0xe984082ccd72eba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106244:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1000/0xe984082ccd72eba0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106249:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd900) 00010000:00010000:0.0:1746143758.106250:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143758.106262:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1000/0xe984082ccd72eba0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106266:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1000/0xe984082ccd72eba0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.106299:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1a00/0xe984082ccd72eb92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ef6 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.106306:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a23a1a00/0xe984082ccd72eb92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ef6 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.106317:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a23a1a00, rc 0) 00000100:00100000:0.0:1746143758.106341:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31108:x1830963594007936:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 24461us (25676us total) trans 8589943381 rc 301/301 00000100:00100000:0.0:1746143758.106346:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9086 00000100:00100000:0.0:1746143758.106703:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.106799:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594008320 00000100:00100000:1.0:1746143758.106803:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594008320 00000100:00100000:1.0:1746143758.106831:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3873 00000100:00100000:1.0:1746143758.106836:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31103:x1830963594008320:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143758.106894:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31103:x1830963594008320:12345-192.168.202.48@tcp:49:cat.0 Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.106900:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3873 00000100:00100000:0.0:1746143758.109637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.109698:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594008576 00000100:00100000:1.0:1746143758.109705:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594008576 00000100:00100000:1.0:1746143758.109745:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9088 00000100:00100000:1.0:1746143758.109751:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31111:x1830963594008576:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143758.110036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143758.110082:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.110098:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd72ebbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f04 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.110212:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.110222:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.110234:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.110246:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.110251:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.110267:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111215:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd72ebd1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111226:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd72ebd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111233:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd72ebd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143758.111243:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143758.111320:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111328:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111333:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111338:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d4400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.111342:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111348:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111358:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143758.111361:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.111365:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111370:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ebc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111380:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111384:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111388:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111392:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d5800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.111394:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111398:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111404:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5056600) 00010000:00010000:1.0:1746143758.111406:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.111408:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111412:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd72ebca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.111454:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd72ebbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f04 expref: 244 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.111466:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd72ebd1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f04 expref: 243 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.111494:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.111497:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143758.111499:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4000, rc 0) 00000100:00100000:1.0:1746143758.111553:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31111:x1830963594008576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1802us (1922us total) trans 8589943383 rc 0/0 00000100:00100000:1.0:1746143758.111559:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9088 00000100:00100000:0.0:1746143758.112541:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594009088 00000100:00100000:0.0:1746143758.112545:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594009088 00000100:00100000:0.0:1746143758.113706:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3875 00000100:00100000:0.0:1746143758.113716:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31104:x1830963594009088:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1746143758.113894:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31104:x1830963594009088:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 178us (1391us total) trans 8589943384 rc 0/0 00000100:00100000:0.0:1746143758.113900:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3875 00000100:00100000:1.0:1746143758.114802:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594009216 00000100:00100000:1.0:1746143758.114806:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594009216 00000100:00100000:1.0:1746143758.114844:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594009344 00000100:00100000:1.0:1746143758.114847:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594009344 00000100:00100000:1.0:1746143758.114863:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12986 00000100:00100000:1.0:1746143758.114873:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594009216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.114882:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143758.114897:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12987 00010000:00010000:1.0:1746143758.114897:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f0b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.114905:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963594009344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.114914:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.114924:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f12 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143758.114947:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a0d, atime: 0x68140a0c, ctime: 0x68140a0d, blocks: 0x81f 00010000:00010000:3.0:1746143758.114960:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.114962:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.114969:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.114982:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 35 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.114991:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3a1200, rc 0) 00000100:00100000:3.0:1746143758.115015:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963594009344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.115020:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12987 00002000:00010000:1.0:1746143758.115244:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a0c, atime: 0x68140a0b, ctime: 0x68140a0c, blocks: 0x7a9 00010000:00010000:1.0:1746143758.115265:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.115267:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.115272:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.115287:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 40 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.115294:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4a00, rc 0) 00000100:00100000:1.0:1746143758.115328:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594009216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 455us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.115334:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12986 00000100:00100000:1.0:1746143758.120533:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594009600 00000100:00100000:1.0:1746143758.120542:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594009600 00000100:00100000:1.0:1746143758.120572:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594009728 00000100:00100000:1.0:1746143758.120575:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594009728 00000100:00100000:1.0:1746143758.120590:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12988 00000100:00100000:1.0:1746143758.120598:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1962:x1830963594009600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.120612:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.120627:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f19 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143758.120649:0:2839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a0d, atime: 0x68140a0c, ctime: 0x68140a0d, blocks: 0x81d 00010000:00010000:1.0:1746143758.120664:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.120665:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.120673:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 36 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.120687:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 36 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.120703:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4200, rc 0) 00000100:00100000:1.0:1746143758.120742:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963594009600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 144us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.120748:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12988 00000100:00100000:0.0:1746143758.120753:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12989 00000100:00100000:0.0:1746143758.120760:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594009728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.120768:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.120776:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f20 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143758.120788:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a0d, atime: 0x68140a0d, ctime: 0x68140a0d, blocks: 0x81f 00010000:00010000:0.0:1746143758.120795:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.120796:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.120800:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 41 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.120812:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 41 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.120818:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0235400, rc 0) 00000100:00100000:0.0:1746143758.120862:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594009728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 102us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.120866:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12989 00000100:00100000:3.0:1746143758.122772:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594009856 00000100:00100000:3.0:1746143758.122779:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594009856 00002000:00100000:3.0:1746143758.122816:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009b850380 x1830963594009856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.122825:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850380 with x1830963594009856 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.122829:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850380 00000100:00100000:3.0:1746143758.122851:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6059 00000100:00100000:3.0:1746143758.122856:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1965:x1830963594009856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.124040:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.124977:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594009984 00000100:00100000:0.0:1746143758.124984:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594009984 00000100:00100000:0.0:1746143758.125016:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12990 00000100:00100000:0.0:1746143758.125022:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594009984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.125035:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.125051:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f27 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.125068:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.125070:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.125078:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 42 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.125092:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 42 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.125102:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801376cb200, rc 0) 00000100:00100000:0.0:1746143758.125127:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1962:x1830963594009984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 105us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.125136:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12990 00000100:00100000:3.0:1746143758.128233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.130230:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594010112 00000100:00100000:0.0:1746143758.130240:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594010112 00000100:00100000:0.0:1746143758.130292:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12991 00000100:00100000:0.0:1746143758.130299:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963594010112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.130312:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.130325:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f2e expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.130343:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.130345:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.130351:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.130364:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 37 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.130374:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801376ca600, rc 0) 00000100:00100000:0.0:1746143758.130420:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963594010112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 122us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.130426:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12991 00000100:00100000:1.0:1746143758.139881:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1965:x1830963594009856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17016us (19458us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143758.139891:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6059 00002000:00100000:1.0:1746143758.139901:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009b850380 x1830963594009856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.139909:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850380 with x1830963594009856 ext(3145728->4194303) 00002000:00010000:1.0:1746143758.139915:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850380 00000100:00100000:3.0:1746143758.146509:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594010240 00000100:00100000:3.0:1746143758.146516:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594010240 00000100:00100000:3.0:1746143758.146546:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594010368 00000100:00100000:3.0:1746143758.146547:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594010368 00000100:00100000:3.0:1746143758.146560:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12992 00000100:00100000:3.0:1746143758.146567:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1964:x1830963594010240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.146580:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.146592:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f35 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.146610:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.146611:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.146618:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.146630:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.146640:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094de9e00, rc 0) 00000100:00100000:3.0:1746143758.146676:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594010240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 110us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.146681:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12992 00000100:00100000:1.0:1746143758.146686:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12994 00000100:00100000:3.0:1746143758.146692:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 12995 00000100:00100000:1.0:1746143758.146692:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1965:x1830963594010368:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143758.146696:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1965:x1830963594010624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.146699:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.146700:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.146705:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f4a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.146705:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f3c expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.146714:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.146714:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.146715:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.146716:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.146719:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.146719:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 36 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.146727:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.146727:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 36 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.146734:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094de8400, rc 0) 00010000:00010000:1.0:1746143758.146739:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4e00, rc 0) 00000100:00100000:3.0:1746143758.146749:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594010624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.146750:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1965:x1830963594010368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.146753:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12995 00000100:00100000:1.0:1746143758.146756:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 12994 00000100:00100000:0.0:1746143758.151033:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.151049:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.151059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.151069:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.151127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.153722:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6062 00000100:00100000:0.0:1746143758.153735:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6063 00000100:00100000:0.0:1746143758.153740:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594011776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.154197:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6064 00000100:00100000:0.0:1746143758.154202:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1965:x1830963594011904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.155753:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594011520:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.156397:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.156977:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594012160 00000100:00100000:1.0:1746143758.156984:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594012160 00000100:00100000:1.0:1746143758.157018:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9089 00000100:00100000:1.0:1746143758.157023:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31114:x1830963594012160:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143758.157034:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.157049:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5c00/0xe984082ccd72ec25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f51 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.157131:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157155:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157165:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157177:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157182:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157186:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157286:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013c400/0xe984082ccd72ec3a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157293:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013013c400/0xe984082ccd72ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.157299:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013013c400/0xe984082ccd72ec3a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143758.157307:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143758.158750:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158760:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158766:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158770:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d4400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.158774:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158779:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158790:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143758.158792:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.158795:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158799:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4400/0xe984082ccd72ec2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158816:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158821:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158825:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158829:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013013d400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.158831:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158835:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158840:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74700) 00010000:00010000:1.0:1746143758.158842:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.158844:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158848:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013d400/0xe984082ccd72ec33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.158884:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5c00/0xe984082ccd72ec25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f51 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.158895:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013013c400/0xe984082ccd72ec3a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f51 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.158900:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.158903:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143758.158905:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013013c400, rc 0) 00000100:00100000:1.0:1746143758.158932:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31114:x1830963594012160:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1907us (2535us total) trans 8589943385 rc 0/0 00000100:00100000:1.0:1746143758.158938:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9089 00000100:00100000:3.0:1746143758.167781:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1964:x1830963594010880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15715us (16746us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.167891:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6060 00002000:00100000:3.0:1746143758.167901:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012f184380 x1830963594010880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.167911:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184380 with x1830963594010880 ext(0->1048575) 00002000:00010000:3.0:1746143758.167917:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f184380 00000100:00100000:0.0:1746143758.178784:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594011776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25034us (27704us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.178796:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6063 00002000:00100000:0.0:1746143758.178812:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012f186d80 x1830963594011776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.178821:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186d80 with x1830963594011776 ext(1048576->2097151) 00002000:00010000:0.0:1746143758.178827:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f186d80 00000100:00100000:3.0:1746143758.182390:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594011136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28896us (31332us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.182399:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6061 00002000:00100000:3.0:1746143758.182408:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012f184700 x1830963594011136/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.182417:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184700 with x1830963594011136 ext(1048576->2097151) 00002000:00010000:3.0:1746143758.182421:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f184700 00000100:00100000:3.0:1746143758.194727:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594011520:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40995us (43663us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143758.194736:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6062 00002000:00100000:3.0:1746143758.194741:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88012f185180 x1830963594011520/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.194748:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963594011520 ext(4194304->4755455) 00002000:00010000:3.0:1746143758.194752:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185180 00000100:00100000:3.0:1746143758.204777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.204803:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594012416 00000100:00100000:3.0:1746143758.204810:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594012416 00000100:00100000:3.0:1746143758.204918:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3876 00000100:00100000:3.0:1746143758.204925:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a630a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31103:x1830963594012416:12345-192.168.202.48@tcp:35:cat.0 00000001:00080000:3.0:1746143758.207346:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840333 is committed 00000001:00080000:3.0:1746143758.207355:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840336 is committed 00000001:00080000:3.0:1746143758.207364:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840320 is committed 00000001:00080000:3.0:1746143758.207371:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840304 is committed 00000001:00080000:3.0:1746143758.207378:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840337 is committed 00000001:00080000:3.0:1746143758.207391:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840328 is committed 00000001:00080000:3.0:1746143758.207396:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840322 is committed 00000001:00080000:3.0:1746143758.207613:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840327 is committed 00000001:00080000:3.0:1746143758.207649:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840338 is committed 00000001:00080000:3.0:1746143758.207653:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840329 is committed 00000100:00100000:0.0:1746143758.210465:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.210496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.210534:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.210656:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594013312 00000100:00100000:3.0:1746143758.210661:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594013312 00002000:00100000:3.0:1746143758.210678:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012f185f80 x1830963594013312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.210685:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185f80 with x1830963594013312 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.210688:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185f80 00000100:00100000:3.0:1746143758.210703:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6066 00000100:00100000:3.0:1746143758.210709:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594013184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.214587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.214650:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594012928 00000100:00100000:1.0:1746143758.214658:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594012928 00002000:00100000:1.0:1746143758.214694:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012f187480 x1830963594012928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.214703:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963594012928 ext(3145728->4194303) 00002000:00010000:1.0:1746143758.214708:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187480 00000100:00100000:1.0:1746143758.214738:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6068 00000100:00100000:1.0:1746143758.214744:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594012928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.220087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.220163:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594013696 00000100:00100000:1.0:1746143758.220170:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594013696 00000100:00100000:1.0:1746143758.220214:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9090 00000100:00100000:1.0:1746143758.220222:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31114:x1830963594013696:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143758.220240:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.220243:0:14763:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746143758.220272:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013013c400/0xe984082ccd72ec3a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f51 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.220290:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131253e00/0xe984082ccd72eb8b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6eef expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.220308:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.220312:0:14763:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143758.220321:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd72ec48 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f58 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.220367:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.220378:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e400/0xe984082ccd72ebae lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6efd expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.220386:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd72ebd1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f04 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.220391:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.220415:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd72ebd1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f04 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.220424:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd72ebd1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f04 expref: 242 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.220434:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594292480:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.220691:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e400/0xe984082ccd72ebae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6efd expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.220699:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e400/0xe984082ccd72ebae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6efd expref: 8 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.220707:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594292608:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.220728:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800933b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.220970:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594013184:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10257us (10468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.220981:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6066 00002000:00100000:3.0:1746143758.220992:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012f185880 x1830963594013184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.221001:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185880 with x1830963594013184 ext(2097152->3145727) 00002000:00010000:3.0:1746143758.221006:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185880 00000100:00100000:0.0:1746143758.226879:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.226927:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.226932:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594292480:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.226941:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594292608:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.226959:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143758.227032:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6933 00000100:00100000:0.0:1746143758.227038:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594013952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.227049:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.227054:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e400/0xe984082ccd72ebae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6efd expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.227063:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e400/0xe984082ccd72ebae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6efd expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.227079:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e400/0xe984082ccd72ebae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6efd expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.227094:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.227098:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.227105:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.227110:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.227125:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143758.227158:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594013952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.227163:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6933 00000100:00100000:3.0:1746143758.227381:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594012672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16711us (16921us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.227387:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6065 00002000:00100000:3.0:1746143758.227393:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012f184e00 x1830963594012672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.227400:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184e00 with x1830963594012672 ext(2097152->3145727) 00002000:00010000:3.0:1746143758.227403:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f184e00 00010000:00010000:1.0:1746143758.227533:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.227540:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000040:00080000:1.0:1746143758.228042:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2613, 88 off220472 00000004:00080000:1.0:1746143758.228047:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837237907372ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.228090:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2638, 88 off222856 00000004:00080000:1.0:1746143758.228094:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837237954385ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143758.228110:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2639, 88 off222944 00000004:00080000:1.0:1746143758.228113:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837237973235ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143758.228120:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2614, 88 off220560 00000004:00080000:1.0:1746143758.228122:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837237982352ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.228128:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2615, 88 off220648 00000004:00080000:1.0:1746143758.228130:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837237990468ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.228159:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2640, 88 off223032 00000004:00080000:1.0:1746143758.228162:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837238022018ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143758.228860:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2641, 88 off223120 00000004:00080000:1.0:1746143758.228866:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837238726176ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143758.229224:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2642, 88 off223208 00000004:00080000:1.0:1746143758.229228:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837239088078ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143758.229236:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2616, 88 off220736 00000004:00080000:1.0:1746143758.229239:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837239099026ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.229267:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2643, 88 off223296 00000004:00080000:1.0:1746143758.229271:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837239131030ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143758.229277:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2617, 88 off220824 00000004:00080000:1.0:1746143758.229279:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837239139166ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.229284:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2644, 88 off223384 00000004:00080000:1.0:1746143758.229287:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837239147258ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143758.229293:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2618, 88 off220912 00000004:00080000:1.0:1746143758.229295:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837239155563ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.229301:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2619, 88 off221000 00000004:00080000:1.0:1746143758.229303:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837239163016ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.229309:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2620, 88 off221088 00000004:00080000:1.0:1746143758.229311:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837239171448ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.229348:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2622, 88 off221272 00000004:00080000:1.0:1746143758.229351:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837239211326ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143758.229364:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2645, 88 off223472 00000004:00080000:1.0:1746143758.229367:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837239227356ns, next at 833304778357ns, rc = 0 00000100:00100000:0.0:1746143758.232015:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594012928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17261us (17425us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.232027:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6068 00002000:00100000:0.0:1746143758.232039:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012f187480 x1830963594012928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.232048:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963594012928 ext(3145728->4194303) 00002000:00010000:0.0:1746143758.232054:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187480 00000100:00100000:0.0:1746143758.240829:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.241172:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594014080 00000100:00100000:1.0:1746143758.241179:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594014080 00000100:00100000:1.0:1746143758.241214:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9091 00000100:00100000:1.0:1746143758.241220:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31111:x1830963594014080:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.241238:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.241263:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f5f expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.241310:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.241318:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.241332:0:21713:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.241395:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.241407:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.241409:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143758.241412:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 243 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.241418:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26800, rc 0) 00000100:00100000:1.0:1746143758.241463:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31111:x1830963594014080:12345-192.168.202.48@tcp:101:cat.0 Request processed in 241us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.241468:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9091 00000001:00080000:0.0:1746143758.247357:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943384 is committed 00000001:00080000:0.0:1746143758.247367:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943381 is committed 00000001:00080000:0.0:1746143758.247372:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943387 is committed 00000004:00080000:0.0:1746143758.247375:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1981 committed 00000004:00080000:0.0:1746143758.247381:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1958 committed 00000004:00080000:0.0:1746143758.247386:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1957 committed 00000004:00080000:0.0:1746143758.247388:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1956 committed 00000004:00080000:0.0:1746143758.247389:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1955 committed 00000004:00080000:0.0:1746143758.247391:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1980 committed 00000004:00080000:0.0:1746143758.247392:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1954 committed 00000004:00080000:0.0:1746143758.247394:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1979 committed 00000004:00080000:0.0:1746143758.247395:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1953 committed 00000004:00080000:0.0:1746143758.247396:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1978 committed 00000004:00080000:0.0:1746143758.247398:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1977 committed 00000004:00080000:0.0:1746143758.247399:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1976 committed 00000004:00080000:0.0:1746143758.247400:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1952 committed 00000004:00080000:0.0:1746143758.247491:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1951 committed 00000004:00080000:0.0:1746143758.247493:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1975 committed 00000004:00080000:0.0:1746143758.247494:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1974 committed 00000004:00080000:0.0:1746143758.247496:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1950 committed 00000001:00080000:0.0:1746143758.247503:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943383 is committed 00000100:00100000:0.0:1746143758.247526:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594293120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.247578:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594292736:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143758.247817:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.247828:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.247830:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143758.247834:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.247848:0:14763:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.247854:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.247873:0:14763:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 240 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.247881:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594294784:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143758.247922:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.247936:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292864 00000100:00100000:0.0:1746143758.247941:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292864 00000100:00100000:0.0:1746143758.247966:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594293376 00000100:00100000:0.0:1746143758.247967:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594293376 00000100:00100000:0.0:1746143758.247976:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594293888 00000100:00100000:0.0:1746143758.247978:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594293888 00000100:00100000:0.0:1746143758.247986:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594294400 00000100:00100000:0.0:1746143758.247987:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594294400 00000100:00100000:0.0:1746143758.247994:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12996 00000100:00100000:1.0:1746143758.247998:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12997 00000100:00100000:0.0:1746143758.247999:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3293:x1830963594292864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.248003:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3293:x1830963594293376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.249165:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.249177:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594293248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.249191:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.249208:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292736 00000100:00100000:3.0:1746143758.249210:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292736 00000100:00100000:3.0:1746143758.249221:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13005 00000100:00100000:3.0:1746143758.249224:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594294656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143758.249308:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594294656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (549us total) trans 17179873025 rc 0/0 00000100:00100000:3.0:1746143758.249313:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13005 00000100:00100000:3.0:1746143758.249322:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13007 00000100:00100000:3.0:1746143758.249326:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594293504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.249402:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594293504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (601us total) trans 21474840343 rc 0/0 00000100:00100000:3.0:1746143758.249406:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13007 00000100:00100000:3.0:1746143758.249415:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13009 00000100:00100000:3.0:1746143758.249418:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594294528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143758.249483:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594294528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (643us total) trans 17179873027 rc 0/0 00000100:00100000:3.0:1746143758.249488:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13009 00000100:00100000:3.0:1746143758.249495:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13011 00000100:00100000:3.0:1746143758.249499:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963594293248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.249568:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963594293248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (376us total) trans 21474840345 rc 0/0 00000100:00100000:3.0:1746143758.249572:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13011 00000100:00100000:2.0:1746143758.249609:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a63a3b80 x1830963594292992/t21474840342(21474840342) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143774 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746143758.249617:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a3b80/2, rc 0, transno 21474840342 00000004:00080000:3.0:1746143758.249618:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a3800/2, rc 0, transno 21474840344 00000100:00100000:3.0:1746143758.249621:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594292736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.249621:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594292992:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143758.249628:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a3100/2, rc 0, transno 21474840345 00000004:00080000:2.0:1746143758.249629:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f480/2, rc 0, transno 21474840343 00000100:00100000:3.0:1746143758.249631:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594293248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.249631:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594293504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143758.249638:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0f480/2, rc 0, transno 17179873026 00000100:00100000:2.0:1746143758.249640:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594294016:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143758.249645:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0ca80/2, rc 0, transno 17179873027 00000100:00100000:2.0:1746143758.249647:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594294528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143758.249651:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0fb80/2, rc 0, transno 17179873024 00000100:00100000:2.0:1746143758.249653:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594294144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143758.249657:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0c380/2, rc 0, transno 17179873025 00000100:00100000:2.0:1746143758.249659:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594294656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143758.249665:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a2300/2, rc 0, transno 21474840340 00000100:00100000:2.0:1746143758.249666:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594293120:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143758.249670:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79e680/2, rc 0, transno 21474840341 00000100:00100000:2.0:1746143758.249673:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594293632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.249757:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594293376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1754us (1926us total) trans 21474840339 rc 0/0 00000100:00100000:1.0:1746143758.249763:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12997 00000004:00080000:3.0:1746143758.249840:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0d180/2, rc 0, transno 17179873022 00000100:00100000:3.0:1746143758.249843:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594293760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143758.249848:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0ed80/2, rc 0, transno 17179873023 00000100:00100000:3.0:1746143758.249850:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594294272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143758.249855:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0d880/2, rc 0, transno 17179873020 00000100:00100000:3.0:1746143758.249857:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594293888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143758.249862:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0ea00/2, rc 0, transno 17179873021 00000100:00100000:3.0:1746143758.249864:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594294400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143758.249868:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305c9c00/2, rc 0, transno 21474840339 00000100:00100000:3.0:1746143758.249870:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594293376:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143758.249935:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143758.249937:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.249939:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.249940:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143757 -> 1746143757 00002000:00010000:0.0:1746143758.249942:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143758.249960:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594292864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1961us (2167us total) trans 21474840346 rc 0/0 00000100:00100000:0.0:1746143758.249965:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12996 00000004:00080000:3.0:1746143758.250010:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a1f80/2, rc 0, transno 21474840346 00000100:00100000:3.0:1746143758.250013:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594292864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143758.250117:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 18 done 00000100:00100000:0.0:1746143758.250184:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143758.250194:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594294912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.250213:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143758.250239:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594294912 00000100:00100000:2.0:1746143758.250242:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594294912 00000100:00100000:2.0:1746143758.250525:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13012 00000100:00100000:2.0:1746143758.250531:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594294912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.250611:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594294912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (397us total) trans 21474840347 rc 0/0 00000100:00100000:2.0:1746143758.250615:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13012 00000004:00080000:0.0:1746143758.250664:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459180/2, rc 0, transno 21474840347 00000100:00100000:0.0:1746143758.250667:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594294912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.252741:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594294784:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143758.252790:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9a00/0xe984082ccd72ec48 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 8 pid: 14763 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143758.252848:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 7 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.252881:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8200, rc 0) 00000100:00100000:0.0:1746143758.252940:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31114:x1830963594013696:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 32718us (32860us total) trans 8589943387 rc 0/0 00000100:00100000:0.0:1746143758.252948:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9090 00000100:00100000:0.0:1746143758.256778:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.256932:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594014208 00000100:00100000:2.0:1746143758.256939:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594014208 00000100:00100000:2.0:1746143758.256985:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3877 00000100:00100000:2.0:1746143758.256992:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31111:x1830963594014208:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143758.257105:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31111:x1830963594014208:12345-192.168.202.48@tcp:49:cat.0 Request processed in 113us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.257111:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3877 00000100:00100000:0.0:1746143758.267231:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.267295:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594014336 00000100:00100000:2.0:1746143758.267303:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594014336 00000100:00100000:2.0:1746143758.267352:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13013 00000100:00100000:2.0:1746143758.267358:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31114:x1830963594014336:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143758.267372:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.267388:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f66 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.267411:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 15 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.267419:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.267424:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.267425:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.267428:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1421312->1785855] (req 1421312->1785855) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.267454:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.267464:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 9 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.267473:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594295040:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.267753:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 15 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.267761:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 15 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.267769:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594295168:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.267791:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.269811:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746143758.269827:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594295296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143758.269874:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.269947:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295296 00000100:00100000:3.0:1746143758.269952:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295296 00000100:00100000:3.0:1746143758.269997:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1746143758.270003:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963594295296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746143758.270023:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 530120704 pending 0 free 3852468224 avail 3823108096 00000100:00100000:3.0:1746143758.270060:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963594295296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.270066:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1746143758.270180:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594295296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143758.270230:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594295040:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.270237:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594295168:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.270270:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1421312->1785855] (req 1421312->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.270284:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143758.270291:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327e00, rc 0) 00000100:00100000:3.0:1746143758.270326:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594014464 00000100:00100000:3.0:1746143758.270329:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594014464 00010000:00010000:3.0:1746143758.270343:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 10 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.270361:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6935 00000100:00100000:3.0:1746143758.270365:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594014464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.270374:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.270393:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 10 pid: 25369 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.270402:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 10 pid: 25369 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.270419:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de8400/0xe984082ccd72ec17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f4a expref: 10 pid: 25369 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.270431:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.270456:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594014464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.270462:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6935 00000100:00100000:2.0:1746143758.270851:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31114:x1830963594014336:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3492us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.270857:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13013 00000100:00100000:0.0:1746143758.271617:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.272678:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594014592 00000100:00100000:2.0:1746143758.272686:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594014592 00010000:00010000:2.0:1746143758.272712:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 16 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.272750:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6936 00000100:00100000:2.0:1746143758.272756:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594014592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.272765:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.272783:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 16 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.272794:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 16 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.272810:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0235400/0xe984082ccd72ebf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f20 expref: 16 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.272836:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.272838:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.272844:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.272855:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.272882:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.272892:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594295424:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143758.272970:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.278647:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594295424:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143758.279138:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.279196:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594014592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6438us (7578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.279206:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6936 00000100:00100000:0.0:1746143758.285048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.285237:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b20e2be-dc58-49ff-81b7-9c0574412294:3294:1830963594295552:0@lo:400:kworker.0 00000100:00100000:3.0:1746143758.285277:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1830963594295808:0@lo:400:kworker.0 00000100:00100000:0.0:1746143758.285286:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.285298:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.285322:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143758.285325:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143758.285327:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963594295680:0@lo:400:kworker.0 00000100:00100000:3.0:1746143758.285329:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1830963594295936:0@lo:400:kworker.0 00000100:00100000:3.0:1746143758.285343:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.285351:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295808 00000100:00100000:0.0:1746143758.285357:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295808 00000100:00100000:0.0:1746143758.285393:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295936 00000100:00100000:0.0:1746143758.285395:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295936 00000100:00100000:1.0:1746143758.285406:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1746143758.285410:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1746143758.285413:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1830963594295808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143758.285414:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1830963594295936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143758.285448:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1830963594295808:12345-0@lo:400:kworker.0 Request processed in 36us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.285448:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1830963594295936:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.285453:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1746143758.285455:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1746143758.285468:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.285493:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295680 00000100:00100000:1.0:1746143758.285496:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295680 00000100:00100000:1.0:1746143758.285510:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1746143758.285514:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963594295680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143758.285535:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963594295680:12345-0@lo:400:kworker.0 Request processed in 20us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.285539:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1746143758.285551:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963594295680:0@lo:400:kworker.0 00000100:00100000:2.0:1746143758.285586:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594014848 00000100:00100000:2.0:1746143758.285589:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594014848 00002000:00100000:2.0:1746143758.285615:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1421312->1425407) req@ffff880094c12d80 x1830963594014848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.285623:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963594014848 ext(1421312->1425407) 00002000:00010000:2.0:1746143758.285628:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:2.0:1746143758.285640:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6069 00000100:00100000:2.0:1746143758.285644:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594014848:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143758.285767:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594014848:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 122us (726us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143758.285775:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6069 00002000:00100000:2.0:1746143758.285779:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1421312->1425407) req@ffff880094c12d80 x1830963594014848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.285786:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963594014848 ext(1421312->1425407) 00002000:00010000:2.0:1746143758.285788:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:2.0:1746143758.285807:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295552 00000100:00100000:2.0:1746143758.285810:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295552 00000100:00100000:2.0:1746143758.285825:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1746143758.285829:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963594295552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143758.285853:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3294:x1830963594295552:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.285858:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1746143758.285922:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143758.285943:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3292:1830963594295936:0@lo:400:kworker.0 00000100:00100000:3.0:1746143758.285951:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3292:1830963594295808:0@lo:400:kworker.0 00000100:00100000:0.0:1746143758.287227:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b20e2be-dc58-49ff-81b7-9c0574412294:3294:1830963594295552:0@lo:400:kworker.0 00000100:00100000:0.0:1746143758.288412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.288455:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.288457:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594015104 00000100:00100000:3.0:1746143758.288462:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594015104 00002000:00100000:3.0:1746143758.288489:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094c11180 x1830963594015104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.288498:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11180 with x1830963594015104 ext(2097152->3145727) 00002000:00010000:3.0:1746143758.288502:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11180 00000100:00100000:3.0:1746143758.288515:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594015360 00000100:00100000:3.0:1746143758.288517:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594015360 00002000:00100000:3.0:1746143758.288525:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094c10000 x1830963594015360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.288532:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10000 with x1830963594015360 ext(3145728->4194303) 00000100:00100000:2.0:1746143758.288532:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6070 00002000:00010000:3.0:1746143758.288534:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10000 00000100:00100000:2.0:1746143758.288540:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594015104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.288542:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6071 00000100:00100000:3.0:1746143758.288546:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594015360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.290296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.290350:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594015616 00000100:00100000:3.0:1746143758.290354:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594015616 00002000:00100000:3.0:1746143758.290378:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c10380 x1830963594015616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.290386:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10380 with x1830963594015616 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.290390:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10380 00000100:00100000:3.0:1746143758.290402:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6072 00000100:00100000:3.0:1746143758.290407:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1962:x1830963594015616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.294901:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.295160:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594015872 00000100:00100000:2.0:1746143758.295167:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594015872 00000100:00100000:2.0:1746143758.295852:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13014 00000100:00100000:2.0:1746143758.295859:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:31108:x1830963594015872:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143758.295876:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.295890:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f6d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.295892:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143758.295913:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 42 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.295926:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba26600/0xe984082ccd72ec10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f43 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143758.297981:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594016000 00000100:00100000:0.0:1746143758.297990:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594016000 00002000:00100000:0.0:1746143758.298024:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1781760->1785855) req@ffff880093502300 x1830963594016000/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.298034:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963594016000 ext(1781760->1785855) 00002000:00010000:0.0:1746143758.298038:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502300 00000100:00100000:0.0:1746143758.298076:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6073 00000100:00100000:0.0:1746143758.298083:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594016000:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:2.0:1746143758.299047:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.299049:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.299055:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1142784->2097151] (req 1142784->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 42 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.299085:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba26600/0xe984082ccd72ec10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f43 expref: 34 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.299096:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba26600/0xe984082ccd72ec10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f43 expref: 34 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.299107:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594296064:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.299201:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 42 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.299208:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 42 pid: 2839 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.299216:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594296192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.299234:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.302180:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143758.302230:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143758.302324:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594296320 00000100:00100000:2.0:1746143758.302331:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594296320 00000100:00100000:2.0:1746143758.302374:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1746143758.302384:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963594296320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143758.302404:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 541917184 pending 35782656 free 3853516800 avail 3851419648 00000100:00100000:2.0:1746143758.302452:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963594296320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.302458:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1746143758.302506:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143758.304195:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594016000:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 6104us (8295us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143758.304206:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6073 00002000:00100000:0.0:1746143758.304215:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1781760->1785855) req@ffff880093502300 x1830963594016000/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.304224:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963594016000 ext(1781760->1785855) 00002000:00010000:0.0:1746143758.304229:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502300 00000100:00100000:0.0:1746143758.311859:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.311891:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594296064:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.311891:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.311902:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594296192:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.311924:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594016128 00000100:00100000:3.0:1746143758.311930:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594016128 00010000:00010000:2.0:1746143758.311930:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1142784->2097151] (req 1142784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 42 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.311947:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131253e00, rc 0) 00010000:00010000:3.0:1746143758.311958:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba26600/0xe984082ccd72ec10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f43 expref: 35 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.311989:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594016256 00000100:00100000:3.0:1746143758.311991:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594016256 00010000:00010000:3.0:1746143758.312000:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 43 pid: 2839 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.312001:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:31108:x1830963594015872:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 16141us (17106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.312008:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13014 00000100:00100000:3.0:1746143758.312022:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6937 00000100:00100000:3.0:1746143758.312028:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1965:x1830963594016128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143758.312033:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6938 00010000:00010000:3.0:1746143758.312039:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143758.312039:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594016256:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.312047:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.312059:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba26600/0xe984082ccd72ec10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f43 expref: 35 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.312059:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 42 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.312068:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba26600/0xe984082ccd72ec10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f43 expref: 35 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.312483:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 42 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.312506:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba26600/0xe984082ccd72ec10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f43 expref: 35 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.312527:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4200/0xe984082ccd72ebed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f19 expref: 42 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.312531:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.312533:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.312539:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 41 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.312546:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 41 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.312558:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143758.312575:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 41 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.312582:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594016256:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 543us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.312585:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594296448:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143758.312588:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6938 00000100:00100000:3.0:1746143758.312631:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.317414:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594015104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28865us (28995us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143758.317426:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6070 00002000:00100000:2.0:1746143758.317437:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094c11180 x1830963594015104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.317445:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11180 with x1830963594015104 ext(2097152->3145727) 00002000:00010000:2.0:1746143758.317451:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11180 00000100:00100000:0.0:1746143758.317874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.317922:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594016512 00000100:00100000:2.0:1746143758.317928:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594016512 00002000:00100000:2.0:1746143758.317954:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1142784->1146879) req@ffff88012e17e680 x1830963594016512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.317961:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17e680 with x1830963594016512 ext(1142784->1146879) 00002000:00010000:2.0:1746143758.317964:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17e680 00000100:00100000:2.0:1746143758.317987:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6074 00000100:00100000:2.0:1746143758.317993:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594016512:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143758.318126:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594016512:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 133us (253us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143758.318132:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6074 00002000:00100000:2.0:1746143758.318136:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1142784->1146879) req@ffff88012e17e680 x1830963594016512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.318163:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17e680 with x1830963594016512 ext(1142784->1146879) 00002000:00010000:2.0:1746143758.318166:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17e680 00000100:00100000:0.0:1746143758.318218:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594015360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29670us (29761us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.318225:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6071 00002000:00100000:0.0:1746143758.318230:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094c10000 x1830963594015360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.318238:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10000 with x1830963594015360 ext(3145728->4194303) 00002000:00010000:0.0:1746143758.318241:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c10000 00000100:00100000:3.0:1746143758.318297:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594296448:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143758.318313:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.318336:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594016128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6308us (6486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.318344:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6937 00000100:00100000:0.0:1746143758.321748:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.321883:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594016768 00000100:00100000:1.0:1746143758.321889:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594016768 00000100:00100000:3.0:1746143758.322523:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1962:x1830963594015616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 32114us (32228us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.322532:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6072 00002000:00100000:3.0:1746143758.322541:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c10380 x1830963594015616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.322549:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10380 with x1830963594015616 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.322553:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10380 00000100:00100000:1.0:1746143758.323872:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3878 00000100:00100000:1.0:1746143758.323884:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31114:x1830963594016768:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143758.324117:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31114:x1830963594016768:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 236us (2375us total) trans 8589943388 rc 0/0 00000100:00100000:1.0:1746143758.324122:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3878 00000100:00100000:0.0:1746143758.334839:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.334915:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594016896 00000100:00100000:2.0:1746143758.334923:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594016896 00000100:00100000:2.0:1746143758.334967:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13015 00000100:00100000:2.0:1746143758.334974:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1965:x1830963594016896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143758.334991:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.335005:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131253600/0xe984082ccd72ec6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f74 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.335058:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594296576:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143758.335159:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143758.337123:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime: 1746143757 -> 1746143758 00002000:00010000:2.0:1746143758.337128:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime: 1746143757 -> 1746143758 00000100:00100000:2.0:1746143758.337163:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594296576:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143758.337185:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131253600/0xe984082ccd72ec6b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f74 expref: 16 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.337197:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131253600/0xe984082ccd72ec6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f74 expref: 16 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.337223:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131253600, rc 0) 00000100:00100000:2.0:1746143758.337267:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1965:x1830963594016896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2292us (2433us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143758.337277:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13015 00000100:00100000:0.0:1746143758.339349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.341091:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594017024 00000100:00100000:2.0:1746143758.341101:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594017024 00000100:00100000:2.0:1746143758.341152:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13016 00000100:00100000:2.0:1746143758.341159:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:31108:x1830963594017024:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143758.341174:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.341187:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f7b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.341211:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.341218:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143758.341219:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143758.341222:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.341244:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 7 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.341261:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 7 pid: 6929 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.341271:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594296704:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.341341:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.344854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.344935:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594017280 00000100:00100000:3.0:1746143758.344942:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594017280 00002000:00100000:3.0:1746143758.344977:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093502d80 x1830963594017280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.344987:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502d80 with x1830963594017280 ext(4194304->4755455) 00002000:00010000:3.0:1746143758.344991:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502d80 00000100:00100000:3.0:1746143758.345005:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6075 00000100:00100000:3.0:1746143758.345010:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594017280:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.347585:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594296704:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.347612:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->1097727] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.347628:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131253c00, rc 0) 00000100:00100000:3.0:1746143758.348330:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31108:x1830963594017024:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7169us (8985us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.348339:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13016 00000100:00100000:0.0:1746143758.351555:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.351959:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594017408 00000100:00100000:2.0:1746143758.351967:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594017408 00002000:00100000:2.0:1746143758.352004:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1421312->1785855) req@ffff88012e17c000 x1830963594017408/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.352013:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c000 with x1830963594017408 ext(1421312->1785855) 00010000:00010000:2.0:1746143758.352021:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 8 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.352033:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 8 pid: 6929 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746143758.352040:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e17c000 00000100:00100000:2.0:1746143758.352067:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1728 00000100:00100000:2.0:1746143758.352074:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594017408:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143758.352871:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594017280:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7858us (8021us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143758.352879:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6075 00002000:00100000:3.0:1746143758.352885:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093502d80 x1830963594017280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.352891:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502d80 with x1830963594017280 ext(4194304->4755455) 00002000:00010000:3.0:1746143758.352895:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502d80 00000100:00100000:3.0:1746143758.358635:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594017408:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 6552us (7077us total) trans 21474840348 rc 0/0 00000100:00100000:3.0:1746143758.358646:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1728 00002000:00100000:3.0:1746143758.358657:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1421312->1785855) req@ffff88012e17c000 x1830963594017408/t21474840348(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.358666:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c000 with x1830963594017408 ext(1421312->1785855) 00010000:00010000:3.0:1746143758.358674:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 10 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.358688:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 10 pid: 6929 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.358694:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e17c000 00000100:00100000:0.0:1746143758.362525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.362577:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.362646:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594017664 00000100:00100000:3.0:1746143758.362653:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594017664 00010000:00010000:3.0:1746143758.362681:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 10 pid: 6929 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.362964:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6939 00000100:00100000:3.0:1746143758.362971:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594017664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.362981:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.362997:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 10 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.363008:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 10 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.363025:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093327e00/0xe984082ccd72ec5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1421312->1785855) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f66 expref: 10 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.363242:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.363244:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.363258:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.363270:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.363295:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.363305:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594296832:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143758.363532:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.363930:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594017536 00000100:00100000:2.0:1746143758.363935:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594017536 00000100:00100000:2.0:1746143758.363969:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13017 00000100:00100000:2.0:1746143758.363975:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594017536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143758.363987:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.363996:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba2b200/0xe984082ccd72ec79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f82 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.364020:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594296960:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143758.364058:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.368025:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.368048:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594017920 00000100:00100000:0.0:1746143758.368050:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594296832:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143758.368053:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594017920 00002000:00010000:2.0:1746143758.368053:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143757 -> 1746143758 00010000:00010000:0.0:1746143758.368066:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.368072:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594296960:192.168.202.48@tcp:106: 00002000:00100000:3.0:1746143758.368085:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1093632->1097727) req@ffff88009c275f80 x1830963594017920/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.368092:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275f80 with x1830963594017920 ext(1093632->1097727) 00010000:00010000:2.0:1746143758.368093:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba2b200/0xe984082ccd72ec79 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f82 expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143758.368096:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c275f80 00010000:00010000:2.0:1746143758.368105:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba2b200/0xe984082ccd72ec79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f82 expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143758.368112:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594017664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5141us (5594us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143758.368118:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba2b200, rc 0) 00000100:00100000:0.0:1746143758.368120:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6939 00000100:00100000:2.0:1746143758.368167:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594017536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4192us (5588us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143758.368174:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13017 00000100:00100000:3.0:1746143758.369274:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6076 00000100:00100000:3.0:1746143758.369282:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594017920:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.369407:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594017920:12345-192.168.202.48@tcp:3:cat.0 Request processed in 126us (1390us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143758.369412:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6076 00002000:00100000:3.0:1746143758.369417:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1093632->1097727) req@ffff88009c275f80 x1830963594017920/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.369423:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275f80 with x1830963594017920 ext(1093632->1097727) 00002000:00010000:3.0:1746143758.369426:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c275f80 00000100:00100000:0.0:1746143758.371868:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.371987:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594018176 00000100:00100000:2.0:1746143758.371994:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594018176 00000100:00100000:2.0:1746143758.372037:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3879 00000100:00100000:2.0:1746143758.372043:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31108:x1830963594018176:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143758.372475:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31108:x1830963594018176:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 431us (610us total) trans 8589943389 rc 0/0 00000100:00100000:2.0:1746143758.372481:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3879 00000100:00100000:1.0:1746143758.377518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.377555:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594018432 00000100:00100000:2.0:1746143758.377562:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594018432 00000100:00100000:2.0:1746143758.377607:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3880 00000100:00100000:2.0:1746143758.377614:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31111:x1830963594018432:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143758.377936:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31111:x1830963594018432:12345-192.168.202.48@tcp:35:cat.0 Request processed in 321us (424us total) trans 8589943390 rc 0/0 00000100:00100000:2.0:1746143758.377943:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3880 00000100:00100000:0.0:1746143758.429728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.429834:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594018688 00000100:00100000:2.0:1746143758.429842:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594018688 00000100:00100000:2.0:1746143758.430123:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9092 00000100:00100000:2.0:1746143758.430131:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31122:x1830963594018688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143758.430165:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.430179:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b000/0xe984082ccd72ec80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f89 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.430278:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430289:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430298:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430309:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430314:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430319:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430399:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430405:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430409:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:2.0:1746143758.430417:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143758.430477:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430483:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430488:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430493:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ba2ba00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143758.430496:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430502:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430510:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143758.430512:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143758.430515:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430519:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2ba00/0xe984082ccd72ec87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430912:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430917:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430922:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430926:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ba2b800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143758.430928:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430936:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430942:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd700) 00010000:00010000:2.0:1746143758.430944:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143758.430946:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430951:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b800/0xe984082ccd72ec8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.430980:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2b000/0xe984082ccd72ec80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.430989:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.430995:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.430996:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143758.430999:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba2bc00, rc 0) 00000100:00100000:2.0:1746143758.431397:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31122:x1830963594018688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1265us (1675us total) trans 8589943391 rc 0/0 00000100:00100000:2.0:1746143758.431403:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9092 00000100:00100000:0.0:1746143758.433512:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.433556:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.433770:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594018816 00000100:00100000:2.0:1746143758.433777:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594018816 00000100:00100000:2.0:1746143758.433953:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594018944 00000100:00100000:2.0:1746143758.433956:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594018944 00000100:00100000:1.0:1746143758.433992:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13018 00000100:00100000:1.0:1746143758.433999:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594018816:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.434014:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.434027:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090670a00/0xe984082ccd72eca3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f90 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.434066:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594297088:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143758.434122:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.434226:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13019 00000100:00100000:2.0:1746143758.434231:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594018944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143758.434240:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.434248:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009500be00/0xe984082ccd72ecaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f97 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.434285:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594297216:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143758.434310:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00002000:00010000:1.0:1746143758.436877:0:2839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143757 -> 1746143758 00002000:00010000:1.0:1746143758.436883:0:2839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143756 -> 1746143758 00002000:00010000:1.0:1746143758.436884:0:2839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143757 -> 1746143758 00000100:00100000:1.0:1746143758.436902:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594297088:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143758.437131:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594297216:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143758.437247:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009500be00/0xe984082ccd72ecaa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f97 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.437270:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009500be00/0xe984082ccd72ecaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f97 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.437281:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009500be00, rc 0) 00000100:00100000:2.0:1746143758.437314:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594018944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3082us (3756us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143758.437322:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13019 00010000:00010000:1.0:1746143758.437607:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090670a00/0xe984082ccd72eca3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f90 expref: 35 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.437616:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090670a00/0xe984082ccd72eca3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f90 expref: 35 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.437627:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090670a00, rc 0) 00000100:00100000:1.0:1746143758.437645:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594018816:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3647us (4139us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143758.437651:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13018 00000100:00100000:0.0:1746143758.444003:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.444046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.444101:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594019328 00000100:00100000:3.0:1746143758.444108:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594019328 00002000:00100000:3.0:1746143758.444166:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ca6e300 x1830963594019328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.444176:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e300 with x1830963594019328 ext(0->1048575) 00002000:00010000:3.0:1746143758.444180:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6e300 00000100:00100000:3.0:1746143758.444201:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594019456 00000100:00100000:3.0:1746143758.444203:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594019456 00002000:00100000:3.0:1746143758.444214:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009ca6c000 x1830963594019456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.444221:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c000 with x1830963594019456 ext(1048576->2097151) 00002000:00010000:3.0:1746143758.444224:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c000 00000100:00100000:3.0:1746143758.444234:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6077 00000100:00100000:3.0:1746143758.444239:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594019328:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.445758:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6078 00000100:00100000:3.0:1746143758.445767:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594019456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143758.462095:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594019456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16316us (18035us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143758.462105:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6078 00002000:00100000:2.0:1746143758.462114:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009ca6c000 x1830963594019456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.462122:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c000 with x1830963594019456 ext(1048576->2097151) 00002000:00010000:2.0:1746143758.462127:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c000 00000100:00100000:1.0:1746143758.462613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.462803:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594019712 00000100:00100000:2.0:1746143758.462810:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594019712 00000100:00100000:3.0:1746143758.463040:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594019328:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18800us (19044us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.463047:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6077 00002000:00100000:3.0:1746143758.463053:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ca6e300 x1830963594019328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.463060:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e300 with x1830963594019328 ext(0->1048575) 00002000:00010000:3.0:1746143758.463064:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6e300 00000100:00100000:1.0:1746143758.463429:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9093 00000100:00100000:1.0:1746143758.463438:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31124:x1830963594019712:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143758.463454:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.463471:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6f9e expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.463549:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.463561:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.463567:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.463591:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.463601:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 11 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.463611:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594297344:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.463652:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.467168:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594297344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.467191:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143758.467266:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.467336:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594019840 00000100:00100000:2.0:1746143758.467341:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594019840 00010000:00010000:2.0:1746143758.467370:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 12 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.467447:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6940 00000100:00100000:2.0:1746143758.467454:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594019840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.467464:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.467469:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 12 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.467478:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 12 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.467494:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba2bc00/0xe984082ccd72ec95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f89 expref: 12 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.467517:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.467521:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143758.467528:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143758.467533:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143758.467546:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143758.467573:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.467579:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143758.467580:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594019840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 127us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.467589:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6940 00000004:00200000:1.0:1746143758.467595:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143758.467714:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.467731:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.467737:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.467739:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143758.467741:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090671200, rc 0) 00000100:00100000:1.0:1746143758.467763:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31124:x1830963594019712:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4327us (5151us total) trans 8589943392 rc 0/0 00000100:00100000:1.0:1746143758.467769:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9093 00000100:00100000:0.0:1746143758.471790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.471879:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594019968 00000100:00100000:1.0:1746143758.471886:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594019968 00000100:00100000:1.0:1746143758.471978:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13020 00000100:00100000:1.0:1746143758.471986:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:31122:x1830963594019968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.472002:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.472016:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fa5 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.472042:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 36 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.472049:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143758.472050:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143758.472053:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.472076:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 36 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.472086:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 36 pid: 6929 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.472097:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594297472:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.472469:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.476528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.476748:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594297472:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.476790:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.476869:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594020096 00000100:00100000:3.0:1746143758.476877:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594020096 00002000:00100000:3.0:1746143758.476917:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1142784->2097151) req@ffff88009ca6f480 x1830963594020096/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.476925:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6f480 with x1830963594020096 ext(1142784->2097151) 00010000:00010000:3.0:1746143758.476932:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 37 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.476946:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 37 pid: 6929 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.476952:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca6f480 00000100:00100000:3.0:1746143758.476978:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1729 00000100:00100000:3.0:1746143758.476987:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963594020096:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:2.0:1746143758.477837:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090671600, rc 0) 00000100:00100000:2.0:1746143758.477872:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:31122:x1830963594019968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5884us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.477879:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13020 00000100:00100000:3.0:1746143758.488157:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594020096:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11148us (11615us total) trans 17179873028 rc 0/0 00000100:00100000:3.0:1746143758.488169:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1729 00002000:00100000:3.0:1746143758.488178:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1142784->2097151) req@ffff88009ca6f480 x1830963594020096/t17179873028(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.488188:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6f480 with x1830963594020096 ext(1142784->2097151) 00010000:00010000:3.0:1746143758.488197:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 39 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.488209:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 39 pid: 6929 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.488220:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca6f480 00000100:00100000:0.0:1746143758.493601:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.494419:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594020224 00000100:00100000:2.0:1746143758.494427:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594020224 00010000:00010000:2.0:1746143758.494460:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 39 pid: 6929 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.494663:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6941 00000100:00100000:2.0:1746143758.494671:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594020224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.494682:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.494700:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 39 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.494712:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 39 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.494730:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131253e00/0xe984082ccd72ec64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f6d expref: 39 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.494760:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.494761:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.494768:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.494774:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.494800:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.494811:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594297600:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143758.494886:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.496455:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594297600:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143758.496469:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.496499:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594020224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1829us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.496506:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6941 00000100:00100000:0.0:1746143758.502795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.502880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.503591:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594020480 00000100:00100000:3.0:1746143758.503599:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594020480 00002000:00100000:3.0:1746143758.503637:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6ed80 x1830963594020480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.503647:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ed80 with x1830963594020480 ext(1048576->2097151) 00002000:00010000:3.0:1746143758.503652:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6ed80 00000100:00100000:3.0:1746143758.503681:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6079 00000100:00100000:3.0:1746143758.503688:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1964:x1830963594020480:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143758.504962:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594020736 00000100:00100000:1.0:1746143758.504968:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594020736 00000100:00100000:1.0:1746143758.505901:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9094 00000100:00100000:1.0:1746143758.505910:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31126:x1830963594020736:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143758.505928:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.505943:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671a00/0xe984082ccd72eccd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fac expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.506283:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506294:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506303:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506314:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506320:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506325:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506432:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506439:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506445:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143758.506452:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143758.506525:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506531:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506536:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506541:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090670800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.506544:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506550:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506559:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143758.506561:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.506564:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506568:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72ecd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506890:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506896:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506901:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506905:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090671800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.506907:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506912:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506918:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74900) 00010000:00010000:1.0:1746143758.506921:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.506923:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506927:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72ecdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.506964:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671a00/0xe984082ccd72eccd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 246 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.506974:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 245 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.506981:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.506984:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143758.506986:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090670a00, rc 0) 00000100:00100000:1.0:1746143758.507181:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31126:x1830963594020736:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1272us (4299us total) trans 8589943393 rc 0/0 00000100:00100000:1.0:1746143758.507188:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9094 00000100:00100000:3.0:1746143758.521961:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1964:x1830963594020480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18266us (19166us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.521971:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6079 00002000:00100000:3.0:1746143758.521982:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6ed80 x1830963594020480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.521990:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ed80 with x1830963594020480 ext(1048576->2097151) 00002000:00010000:3.0:1746143758.521995:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6ed80 00000100:00100000:0.0:1746143758.526232:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.526332:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594020992 00000100:00100000:1.0:1746143758.526340:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594020992 00000100:00100000:1.0:1746143758.526394:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9095 00000100:00100000:1.0:1746143758.526401:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31129:x1830963594020992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.526420:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.526435:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72ecf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fb3 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.526540:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526551:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526559:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526569:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526573:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526578:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526663:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671a00/0xe984082ccd72ed05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526671:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671a00/0xe984082ccd72ed05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526676:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671a00/0xe984082ccd72ed05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143758.526683:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143758.526745:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526750:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526755:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526759:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090670200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.526762:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526767:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526774:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143758.526776:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.526779:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526783:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670200/0xe984082ccd72ecf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526795:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526803:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526808:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526811:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090671000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.526812:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526816:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526820:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74900) 00010000:00010000:1.0:1746143758.526821:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.526823:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526826:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671000/0xe984082ccd72ecfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.526852:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72ecf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fb3 expref: 248 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.526861:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671a00/0xe984082ccd72ed05 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fb3 expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.526865:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.526867:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143758.526868:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090671a00, rc 0) 00000100:00100000:1.0:1746143758.526915:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31129:x1830963594020992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 514us (693us total) trans 8589943394 rc 0/0 00000100:00100000:1.0:1746143758.526921:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9095 00000100:00100000:0.0:1746143758.528410:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.528480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.528550:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594021120 00000100:00100000:3.0:1746143758.528557:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594021120 00000100:00100000:3.0:1746143758.528582:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594021248 00000100:00100000:3.0:1746143758.528584:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594021248 00000100:00100000:3.0:1746143758.528601:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13021 00000100:00100000:3.0:1746143758.528606:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31122:x1830963594021120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.528618:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.528628:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fba expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.528646:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.528653:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143758.528654:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143758.528657:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.528680:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 15 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.528691:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 15 pid: 6929 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.528701:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594297728:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.528765:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.528779:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13022 00000100:00100000:3.0:1746143758.528783:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594021248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.528790:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.528798:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fc1 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.528808:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.528810:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.528815:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 39 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.528823:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 39 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.528830:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81a200, rc 0) 00000100:00100000:3.0:1746143758.528846:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594021248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 62us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.528850:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13022 00000100:00100000:0.0:1746143758.529681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.531345:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594021376 00000100:00100000:3.0:1746143758.531351:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594021376 00000100:00100000:3.0:1746143758.531406:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 719 00000100:00100000:3.0:1746143758.531412:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1962:x1830963594021376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.531424:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.531444:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671a00/0xe984082ccd72ed05 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fb3 expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.531469:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.531472:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.531516:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:1962:x1830963594021376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.531521:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 719 00000100:00100000:3.0:1746143758.532162:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594297728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.532182:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.532200:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81a800, rc 0) 00000100:00100000:3.0:1746143758.532222:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31122:x1830963594021120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3616us (3815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.532229:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13021 00000100:00100000:0.0:1746143758.538957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.539268:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594021504 00000100:00100000:3.0:1746143758.539276:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594021504 00002000:00100000:3.0:1746143758.539316:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1097727) req@ffff88009ca6d500 x1830963594021504/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.539326:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d500 with x1830963594021504 ext(1048576->1097727) 00010000:00010000:3.0:1746143758.539333:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 16 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.539346:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 16 pid: 6929 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.539352:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca6d500 00000100:00100000:3.0:1746143758.539385:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1730 00000100:00100000:3.0:1746143758.539392:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594021504:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143758.540220:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.540258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.540304:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594021760 00000100:00100000:1.0:1746143758.540309:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594021760 00002000:00100000:1.0:1746143758.540326:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009445b480 x1830963594021760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.540333:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b480 with x1830963594021760 ext(0->1048575) 00002000:00010000:1.0:1746143758.540337:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b480 00000100:00100000:1.0:1746143758.540348:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594022016 00000100:00100000:1.0:1746143758.540350:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594022016 00002000:00100000:1.0:1746143758.540362:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009445aa00 x1830963594022016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.540369:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445aa00 with x1830963594022016 ext(1048576->2097151) 00002000:00010000:1.0:1746143758.540372:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009445aa00 00000100:00100000:1.0:1746143758.540390:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6080 00000100:00100000:1.0:1746143758.540396:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594021760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.541996:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6081 00000100:00100000:3.0:1746143758.542008:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594022016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.543388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.543418:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594022272 00000100:00100000:0.0:1746143758.543425:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594022272 00002000:00100000:0.0:1746143758.543457:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6c700 x1830963594022272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.543466:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c700 with x1830963594022272 ext(1048576->2097151) 00002000:00010000:0.0:1746143758.543470:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c700 00000100:00100000:0.0:1746143758.543493:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6082 00000100:00100000:0.0:1746143758.543500:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963594022272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143758.546470:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594021504:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7073us (7514us total) trans 21474840349 rc 0/0 00000100:00100000:2.0:1746143758.546478:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1730 00002000:00100000:2.0:1746143758.546485:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1097727) req@ffff88009ca6d500 x1830963594021504/t21474840349(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.546498:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d500 with x1830963594021504 ext(1048576->1097727) 00010000:00010000:2.0:1746143758.546505:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 19 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.546518:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 19 pid: 6929 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746143758.546524:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca6d500 00000100:00100000:0.0:1746143758.556040:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.558882:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963594022016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16869us (18625us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.558893:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6081 00002000:00100000:3.0:1746143758.558905:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009445aa00 x1830963594022016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.558914:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445aa00 with x1830963594022016 ext(1048576->2097151) 00002000:00010000:3.0:1746143758.558919:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009445aa00 00000100:00100000:2.0:1746143758.560337:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594022400 00000100:00100000:2.0:1746143758.560345:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594022400 00010000:00010000:2.0:1746143758.560376:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 20 pid: 6929 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.560406:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6942 00000100:00100000:2.0:1746143758.560412:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594022400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.560422:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.560437:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 20 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.560446:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 20 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.560463:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131253c00/0xe984082ccd72ec72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1097727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f7b expref: 20 pid: 6929 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.561219:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.561222:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.561229:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.561236:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.561273:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.561284:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594297856:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143758.561352:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.573006:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594297856:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143758.573025:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.573063:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594022400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 12650us (17029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.573073:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6942 00000100:00100000:1.0:1746143758.573718:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594022272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30217us (30334us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143758.573726:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6082 00002000:00100000:1.0:1746143758.573735:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6c700 x1830963594022272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.573743:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c700 with x1830963594022272 ext(1048576->2097151) 00002000:00010000:1.0:1746143758.573747:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c700 00000100:00100000:0.0:1746143758.581625:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594021760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41221us (41399us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.581636:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6080 00002000:00100000:0.0:1746143758.581649:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009445b480 x1830963594021760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.581656:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b480 with x1830963594021760 ext(0->1048575) 00002000:00010000:0.0:1746143758.581661:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b480 00000100:00100000:0.0:1746143758.585304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.585327:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594022656 00000100:00100000:0.0:1746143758.585334:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594022656 00002000:00100000:0.0:1746143758.585366:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1ee300 x1830963594022656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.585376:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee300 with x1830963594022656 ext(1048576->2097151) 00002000:00010000:0.0:1746143758.585380:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ee300 00000100:00100000:0.0:1746143758.585447:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6083 00000100:00100000:0.0:1746143758.585453:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594022656:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.596982:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594022656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11520us (11674us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.596994:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6083 00002000:00100000:0.0:1746143758.597005:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1ee300 x1830963594022656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.597020:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ee300 with x1830963594022656 ext(1048576->2097151) 00002000:00010000:0.0:1746143758.597025:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ee300 00000100:00100000:1.0:1746143758.611801:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.613452:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594022784 00000100:00100000:3.0:1746143758.613460:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594022784 00000100:00100000:3.0:1746143758.613496:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13023 00000100:00100000:3.0:1746143758.613507:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31126:x1830963594022784:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143758.613519:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.613532:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fc8 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.613553:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.613561:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.613566:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.613570:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.613573:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [8192->581631] (req 8192->581631) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.613597:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.613606:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 9 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.613616:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594297984:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.613692:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.613698:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 18 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.613705:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298112:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.613721:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e59780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.613783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.613850:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594022912 00000100:00100000:0.0:1746143758.613852:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594022912 00000100:00100000:0.0:1746143758.613868:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13024 00000100:00100000:0.0:1746143758.613872:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31129:x1830963594022912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.613878:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.613884:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fcf expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.613893:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.613894:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.613899:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.613908:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.613916:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094de9800, rc 0) 00000100:00100000:0.0:1746143758.613933:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31129:x1830963594022912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 61us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.613939:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13024 00000100:00100000:0.0:1746143758.615075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.615089:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594023168 00000100:00100000:0.0:1746143758.615092:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594023168 00002000:00100000:0.0:1746143758.615112:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f1ed180 x1830963594023168/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.615121:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed180 with x1830963594023168 ext(2097152->3145727) 00002000:00010000:0.0:1746143758.615125:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ed180 00000100:00100000:0.0:1746143758.615134:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6084 00000100:00100000:0.0:1746143758.615151:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594023168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.618734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.619432:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594023424 00000100:00100000:0.0:1746143758.619439:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594023424 00000100:00100000:1.0:1746143758.619454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.619468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:0.0:1746143758.619469:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f1ed500 x1830963594023424/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.619478:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed500 with x1830963594023424 ext(3145728->4194303) 00002000:00010000:0.0:1746143758.619483:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ed500 00000100:00100000:0.0:1746143758.619495:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594023680 00000100:00100000:0.0:1746143758.619497:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594023680 00002000:00100000:0.0:1746143758.619505:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093500700 x1830963594023680/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.619513:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500700 with x1830963594023680 ext(2097152->3145727) 00002000:00010000:0.0:1746143758.619515:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500700 00000100:00100000:0.0:1746143758.619522:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594023936 00000100:00100000:0.0:1746143758.619524:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594023936 00002000:00100000:0.0:1746143758.619532:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093503800 x1830963594023936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.619538:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503800 with x1830963594023936 ext(3145728->4194303) 00002000:00010000:0.0:1746143758.619540:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503800 00000100:00100000:0.0:1746143758.619551:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6085 00000100:00100000:0.0:1746143758.619557:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594023424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143758.620130:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6086 00000100:00100000:2.0:1746143758.620154:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1964:x1830963594023680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143758.620230:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6087 00000100:00100000:2.0:1746143758.620236:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1964:x1830963594023936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.622327:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594297984:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.622339:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298112:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.622363:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [8192->581631] (req 8192->581631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.622378:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81be00, rc 0) 00000100:00100000:3.0:1746143758.622417:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31126:x1830963594022784:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8914us (10620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.622425:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13023 00000100:00100000:0.0:1746143758.623780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.623811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.623840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.623872:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594024064 00000100:00100000:2.0:1746143758.623878:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594024064 00010000:00010000:2.0:1746143758.623907:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 14 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.623943:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594024192 00000100:00100000:2.0:1746143758.623946:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594024192 00010000:00010000:2.0:1746143758.623957:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 19 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.623973:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6943 00000100:00100000:2.0:1746143758.623978:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594024064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.623989:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.624006:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 14 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.624007:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6944 00010000:00010000:2.0:1746143758.624017:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 14 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.624017:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594024192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.624024:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.624035:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de9e00/0xe984082ccd72ec09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f35 expref: 14 pid: 25369 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.624036:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 19 pid: 25369 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.624045:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 19 pid: 25369 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.624053:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143758.624071:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4a00/0xe984082ccd72ebdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f0b expref: 19 pid: 25369 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.624090:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594024064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.624096:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6943 00010000:00010000:1.0:1746143758.624205:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.624207:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.624215:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.624224:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.624269:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.624282:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594298240:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143758.624362:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.624422:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594024448 00000100:00100000:1.0:1746143758.624428:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594024448 00002000:00100000:1.0:1746143758.624458:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1eed80 x1830963594024448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.624467:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963594024448 ext(1048576->2097151) 00002000:00010000:1.0:1746143758.624471:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eed80 00000100:00100000:1.0:1746143758.624502:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6088 00000100:00100000:1.0:1746143758.624509:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594024448:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143758.626112:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594023168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10969us (11034us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.626531:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6084 00002000:00100000:0.0:1746143758.626539:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f1ed180 x1830963594023168/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.626546:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed180 with x1830963594023168 ext(2097152->3145727) 00002000:00010000:0.0:1746143758.626550:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ed180 00000100:00100000:1.0:1746143758.628463:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594298240:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143758.628479:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.628508:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594024192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4493us (4695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.628517:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6944 00000100:00100000:2.0:1746143758.633839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.634047:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594024704 00000100:00100000:1.0:1746143758.634055:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594024704 00002000:00100000:1.0:1746143758.634169:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (8192->12287) req@ffff88009445bb80 x1830963594024704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.634178:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445bb80 with x1830963594024704 ext(8192->12287) 00002000:00010000:1.0:1746143758.634183:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445bb80 00000100:00100000:1.0:1746143758.634454:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6089 00000100:00100000:1.0:1746143758.634461:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594024704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143758.634877:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594024704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 415us (1045us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143758.634884:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6089 00002000:00100000:1.0:1746143758.634890:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (8192->12287) req@ffff88009445bb80 x1830963594024704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.634897:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445bb80 with x1830963594024704 ext(8192->12287) 00002000:00010000:1.0:1746143758.634900:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445bb80 00000100:00100000:1.0:1746143758.639571:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594023424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20005us (20832us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143758.639581:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6085 00002000:00100000:1.0:1746143758.639591:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f1ed500 x1830963594023424/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.639599:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ed500 with x1830963594023424 ext(3145728->4194303) 00002000:00010000:1.0:1746143758.639604:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ed500 00000100:00100000:2.0:1746143758.640713:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:1964:x1830963594023680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20571us (21256us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143758.640720:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6086 00002000:00100000:2.0:1746143758.640727:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093500700 x1830963594023680/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.640734:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500700 with x1830963594023680 ext(2097152->3145727) 00002000:00010000:2.0:1746143758.640738:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500700 00000100:00100000:0.0:1746143758.643482:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1964:x1830963594023936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23234us (24001us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.643494:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6087 00002000:00100000:0.0:1746143758.643506:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093503800 x1830963594023936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.643515:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503800 with x1830963594023936 ext(3145728->4194303) 00002000:00010000:0.0:1746143758.643520:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503800 00000100:00100000:2.0:1746143758.649812:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594024448:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 25296us (25963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143758.649822:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6088 00002000:00100000:2.0:1746143758.649833:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1eed80 x1830963594024448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.649841:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963594024448 ext(1048576->2097151) 00002000:00010000:2.0:1746143758.649846:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eed80 00000100:00100000:0.0:1746143758.651670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.651686:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594024960 00000100:00100000:3.0:1746143758.651693:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594024960 00002000:00100000:3.0:1746143758.651722:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (577536->581631) req@ffff88008f1ec380 x1830963594024960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.651731:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ec380 with x1830963594024960 ext(577536->581631) 00002000:00010000:3.0:1746143758.651735:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ec380 00000100:00100000:3.0:1746143758.651760:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6090 00000100:00100000:3.0:1746143758.651767:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594024960:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143758.652004:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594024960:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 127us (227us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143758.652011:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6090 00002000:00100000:3.0:1746143758.652017:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (577536->581631) req@ffff88008f1ec380 x1830963594024960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.652024:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ec380 with x1830963594024960 ext(577536->581631) 00002000:00010000:3.0:1746143758.652027:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ec380 00000100:00100000:2.0:1746143758.655445:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.655488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.655497:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594025088 00000100:00100000:3.0:1746143758.655505:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594025088 00000100:00100000:2.0:1746143758.655505:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594025344 00000100:00100000:2.0:1746143758.655508:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594025344 00000100:00100000:2.0:1746143758.655535:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3881 00000100:00100000:3.0:1746143758.655536:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13025 00000100:00100000:2.0:1746143758.655540:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31126:x1830963594025344:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143758.655542:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594025088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.655553:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.655566:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63ffc00/0xe984082ccd72ed2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fd6 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.655605:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298368:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143758.655663:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.655673:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31126:x1830963594025344:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 132us (184us total) trans 8589943395 rc 0/0 00000100:00100000:2.0:1746143758.655679:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3881 00002000:00010000:3.0:1746143758.657971:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime: 1746143756 -> 1746143758 00002000:00010000:3.0:1746143758.657976:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143755 -> 1746143758 00002000:00010000:3.0:1746143758.657978:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime: 1746143756 -> 1746143758 00000100:00100000:3.0:1746143758.657993:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298368:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143758.658013:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a63ffc00/0xe984082ccd72ed2f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fd6 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.658025:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63ffc00/0xe984082ccd72ed2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fd6 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.658033:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63ffc00, rc 0) 00000100:00100000:3.0:1746143758.658057:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594025088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2516us (2617us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143758.658064:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13025 00000100:00100000:2.0:1746143758.661134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.662734:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594025600 00000100:00100000:3.0:1746143758.662742:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594025600 00002000:00100000:3.0:1746143758.662778:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009ca6fb80 x1830963594025600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.662787:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6fb80 with x1830963594025600 ext(2097152->3145727) 00002000:00010000:3.0:1746143758.662792:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6fb80 00000100:00100000:3.0:1746143758.663059:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6091 00000100:00100000:3.0:1746143758.663067:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594025600:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143758.665000:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.665976:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594025856 00000100:00100000:0.0:1746143758.665982:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594025856 00002000:00100000:0.0:1746143758.666013:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88008f3cb100 x1830963594025856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.666028:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb100 with x1830963594025856 ext(4194304->4755455) 00002000:00010000:0.0:1746143758.666032:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb100 00000100:00100000:0.0:1746143758.666054:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6092 00000100:00100000:0.0:1746143758.666063:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594025856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.676653:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594025600:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13579us (15515us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.676664:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6091 00002000:00100000:3.0:1746143758.676674:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009ca6fb80 x1830963594025600/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.676683:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6fb80 with x1830963594025600 ext(2097152->3145727) 00002000:00010000:3.0:1746143758.676688:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6fb80 00000100:00100000:3.0:1746143758.677124:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594025856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11063us (12127us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143758.677132:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6092 00002000:00100000:3.0:1746143758.677154:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88008f3cb100 x1830963594025856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.677162:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb100 with x1830963594025856 ext(4194304->4755455) 00002000:00010000:3.0:1746143758.677166:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb100 00000001:00080000:3.0:1746143758.680923:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873016 is committed 00000001:00080000:3.0:1746143758.680941:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873004 is committed 00000001:00080000:3.0:1746143758.680948:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179872991 is committed 00000001:00080000:3.0:1746143758.680965:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873007 is committed 00000001:00080000:3.0:1746143758.680970:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873006 is committed 00000001:00080000:3.0:1746143758.681008:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873026 is committed 00000001:00080000:3.0:1746143758.681026:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873010 is committed 00000001:00080000:3.0:1746143758.681173:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873028 is committed 00000001:00080000:3.0:1746143758.681182:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873027 is committed 00000100:00100000:0.0:1746143758.685484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.685532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.685950:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594026112 00000100:00100000:2.0:1746143758.685959:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594026112 00000100:00100000:3.0:1746143758.685980:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594025984 00000100:00100000:3.0:1746143758.685984:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594025984 00000100:00100000:3.0:1746143758.686216:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13026 00000100:00100000:3.0:1746143758.686224:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31124:x1830963594026112:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:1.0:1746143758.686224:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13027 00000100:00100000:1.0:1746143758.686230:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594025984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.686242:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.686242:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.686265:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fe4 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.686265:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a014d800/0xe984082ccd72ed36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6fdd expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.686287:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 12 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.686294:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 17 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.686300:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.686301:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.686304:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.686304:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594298496:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143758.686318:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 17 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.686327:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 17 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.686333:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298624:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.686369:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143758.686382:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 12 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.686389:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 12 pid: 4581 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.686396:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298752:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.686413:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.688308:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298624:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.688316:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594298752:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.688328:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594298496:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143758.688340:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.688343:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a014d800/0xe984082ccd72ed36 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fdd expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.688353:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d800/0xe984082ccd72ed36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fdd expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.688357:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013125b600, rc 0) 00000100:00100000:3.0:1746143758.688385:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31124:x1830963594026112:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2161us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.688392:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13026 00010000:00010000:1.0:1746143758.689162:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014d800, rc 0) 00000100:00100000:1.0:1746143758.689193:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594025984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2963us (3659us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143758.689198:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13027 00000100:00100000:0.0:1746143758.690301:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.690376:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594026240 00000100:00100000:1.0:1746143758.690382:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594026240 00000100:00100000:1.0:1746143758.690416:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13028 00000100:00100000:1.0:1746143758.690422:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31129:x1830963594026240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.690434:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.690772:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6feb expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.690793:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.690799:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.690805:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143758.690807:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.690835:0:8497:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.690846:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.690858:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014d200, rc 0) 00000100:00100000:1.0:1746143758.690882:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31129:x1830963594026240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 460us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.690888:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13028 00000100:00100000:0.0:1746143758.691670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.691721:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594026368 00000100:00100000:1.0:1746143758.691725:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594026368 00000100:00100000:1.0:1746143758.691759:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13029 00000100:00100000:1.0:1746143758.691764:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31122:x1830963594026368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.691774:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.691782:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ff2 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.691794:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.691796:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.691801:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.691812:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.691819:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014de00, rc 0) 00000100:00100000:1.0:1746143758.691837:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31122:x1830963594026368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.691842:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13029 00000100:00100000:0.0:1746143758.695852:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.696056:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.696732:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594026496 00000100:00100000:1.0:1746143758.696739:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594026496 00010000:00010000:1.0:1746143758.696775:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 11 pid: 4581 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.696813:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594026624 00000100:00100000:1.0:1746143758.696816:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594026624 00010000:00010000:1.0:1746143758.696828:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 19 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.696844:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6945 00000100:00100000:1.0:1746143758.696850:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594026496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.696862:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.696880:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 11 pid: 4581 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.696890:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 11 pid: 4581 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.696914:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131253200/0xe984082ccd72eb76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee1 expref: 11 pid: 4581 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.696927:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.696960:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594026496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.696966:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6945 00000100:00100000:1.0:1746143758.696979:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6946 00000100:00100000:1.0:1746143758.696983:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594026624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.696991:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.696998:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 19 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.697006:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 19 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.697015:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801376cb200/0xe984082ccd72ebfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f27 expref: 19 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.697024:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.697026:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.697031:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.697037:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.697062:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 9 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.697072:0:7150:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 9 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.697086:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594299008:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143758.697759:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.699927:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.699962:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.700082:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594299008:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143758.700097:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.700123:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594026624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3139us (4067us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.700131:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6946 00000100:00100000:1.0:1746143758.700173:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594026752 00000100:00100000:1.0:1746143758.700176:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594026752 00000100:00100000:1.0:1746143758.700192:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594026880 00000100:00100000:1.0:1746143758.700193:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594026880 00000100:00100000:1.0:1746143758.700210:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13030 00000100:00100000:1.0:1746143758.700215:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594026752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.700229:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.700241:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a6ff9 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.700292:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594299136:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143758.700297:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13031 00000100:00100000:2.0:1746143758.700304:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594026880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143758.700312:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.700323:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd72ed59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7000 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.700328:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143758.700340:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd72ed59 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7000 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.700508:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd72ed59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7000 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.700519:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bb800, rc 0) 00000100:00100000:0.0:1746143758.700522:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.700537:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594026880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 233us (574us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143758.700542:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13031 00000100:00100000:3.0:1746143758.700615:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594027136 00000100:00100000:3.0:1746143758.700619:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594027136 00002000:00100000:3.0:1746143758.700642:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4075520->4079615) req@ffff88008f1ef480 x1830963594027136/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.700650:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef480 with x1830963594027136 ext(4075520->4079615) 00010000:00010000:3.0:1746143758.700656:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.700667:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.700674:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1ef480 00000100:00100000:3.0:1746143758.700685:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1731 00000100:00100000:3.0:1746143758.700690:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594027136:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.700804:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594027136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 113us (281us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143758.700810:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1731 00002000:00100000:3.0:1746143758.700815:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4075520->4079615) req@ffff88008f1ef480 x1830963594027136/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.700828:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef480 with x1830963594027136 ext(4075520->4079615) 00010000:00010000:3.0:1746143758.700832:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.700840:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.700845:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1ef480 00000100:00100000:1.0:1746143758.702184:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594299136:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143758.702202:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed52 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff9 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.702212:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff9 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.702220:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014d600, rc 0) 00000100:00100000:1.0:1746143758.702259:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594026752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2044us (2337us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143758.702268:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13030 00000100:00100000:2.0:1746143758.703851:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.703959:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594027392 00000100:00100000:3.0:1746143758.703965:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594027392 00002000:00100000:3.0:1746143758.703998:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4751360->4755455) req@ffff88009ca6ca80 x1830963594027392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.704007:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ca80 with x1830963594027392 ext(4751360->4755455) 00002000:00010000:3.0:1746143758.704011:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6ca80 00000100:00100000:3.0:1746143758.704038:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6093 00000100:00100000:3.0:1746143758.704045:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594027392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143758.704209:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594027392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 164us (360us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143758.704214:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6093 00002000:00100000:3.0:1746143758.704220:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4751360->4755455) req@ffff88009ca6ca80 x1830963594027392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.704226:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ca80 with x1830963594027392 ext(4751360->4755455) 00002000:00010000:3.0:1746143758.704229:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6ca80 00000100:00100000:0.0:1746143758.706532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.706582:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.706652:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594027776 00000100:00100000:1.0:1746143758.706658:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594027776 00000100:00100000:1.0:1746143758.706692:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13032 00000100:00100000:1.0:1746143758.706698:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31124:x1830963594027776:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143758.706711:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.706724:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7007 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.706747:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72eb84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee8 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.706754:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.706759:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.706760:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.706764:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->3936255] (req 3145728->3936255) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.706788:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.706797:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 20 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.706807:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594299264:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.706875:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72eb84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee8 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.706882:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72eb84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee8 expref: 10 pid: 12618 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.706889:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594299392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.706907:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.707049:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594027648 00000100:00100000:2.0:1746143758.707053:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594027648 00002000:00100000:2.0:1746143758.707077:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4075520->4194303) req@ffff8800a5c20380 x1830963594027648/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.707086:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963594027648 ext(4075520->4194303) 00010000:00010000:2.0:1746143758.707092:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 10 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.707100:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 10 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:2.0:1746143758.707106:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5c20380 00000100:00100000:2.0:1746143758.707120:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1732 00000100:00100000:2.0:1746143758.707125:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594027648:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143758.711908:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594299264:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.711921:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594299392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.711965:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->3936255] (req 3145728->3936255) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.711980:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014c000, rc 0) 00000100:00100000:1.0:1746143758.713213:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31124:x1830963594027776:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6511us (6626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.713221:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13032 00000100:00100000:3.0:1746143758.713565:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594027648:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6439us (7038us total) trans 21474840350 rc 0/0 00000100:00100000:3.0:1746143758.713573:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1732 00002000:00100000:3.0:1746143758.713581:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4075520->4194303) req@ffff8800a5c20380 x1830963594027648/t21474840350(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.713590:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20380 with x1830963594027648 ext(4075520->4194303) 00010000:00010000:3.0:1746143758.713598:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.713609:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.713615:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5c20380 00000100:00100000:0.0:1746143758.714492:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.714588:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594028032 00000100:00100000:2.0:1746143758.714595:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594028032 00000100:00100000:2.0:1746143758.714640:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3882 00000100:00100000:2.0:1746143758.714646:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31122:x1830963594028032:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143758.714811:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31122:x1830963594028032:12345-192.168.202.48@tcp:35:cat.0 Request processed in 164us (319us total) trans 8589943396 rc 0/0 00000100:00100000:2.0:1746143758.714817:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3882 00000100:00100000:0.0:1746143758.715374:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.715550:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594028160 00000100:00100000:1.0:1746143758.715555:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594028160 00010000:00010000:1.0:1746143758.715576:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.715607:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6947 00000100:00100000:1.0:1746143758.715613:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594028160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.715621:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.715640:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.715650:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.715667:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801376ca600/0xe984082ccd72ec02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f2e expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.715691:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.715716:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594028160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.715722:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6947 00000100:00100000:0.0:1746143758.719351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.719560:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594028288 00000100:00100000:2.0:1746143758.719568:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594028288 00010000:00010000:2.0:1746143758.719597:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72eb84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee8 expref: 10 pid: 12618 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.719644:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6948 00000100:00100000:2.0:1746143758.719652:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594028288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.719663:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.719684:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72eb84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee8 expref: 10 pid: 12618 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.719694:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72eb84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee8 expref: 10 pid: 12618 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.719714:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a23a1200/0xe984082ccd72eb84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ee8 expref: 10 pid: 12618 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.719747:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.719748:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.719755:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.719762:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.719789:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.719799:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594299520:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143758.720423:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.725667:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.725802:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594028416 00000100:00100000:1.0:1746143758.725810:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594028416 00010000:00010000:1.0:1746143758.725839:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.725864:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6949 00000100:00100000:2.0:1746143758.725867:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594299520:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143758.725870:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594028416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.725882:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143758.725882:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143758.725898:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143757 -> 1746143758 00002000:00010000:1.0:1746143758.725900:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143757 -> 1746143758 00010000:00010000:1.0:1746143758.725905:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.725914:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594028288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6263us (6569us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143758.725916:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.725921:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6948 00010000:00010000:1.0:1746143758.725934:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013125b600/0xe984082ccd72ed3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4075520->4194303] (req 4075520->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fe4 expref: 12 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.725948:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.725950:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.725956:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.725963:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.725988:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.725998:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594299648:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143758.726038:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.729321:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594299648:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143758.729339:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.729628:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594028416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3756us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.729638:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6949 00000100:00100000:2.0:1746143758.731648:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.731781:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594028672 00000100:00100000:3.0:1746143758.731789:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594028672 00002000:00100000:3.0:1746143758.731830:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009ca6d180 x1830963594028672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.731840:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d180 with x1830963594028672 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.731846:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6d180 00000100:00100000:3.0:1746143758.731869:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6094 00000100:00100000:3.0:1746143758.731875:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594028672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.735227:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.735278:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594028928 00000100:00100000:1.0:1746143758.735285:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594028928 00002000:00100000:1.0:1746143758.735320:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3932160->3936255) req@ffff8800a5c23480 x1830963594028928/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.735334:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23480 with x1830963594028928 ext(3932160->3936255) 00002000:00010000:1.0:1746143758.735340:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c23480 00000100:00100000:1.0:1746143758.735370:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6095 00000100:00100000:1.0:1746143758.735377:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594028928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143758.735501:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594028928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 124us (280us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143758.735507:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6095 00002000:00100000:1.0:1746143758.735512:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3932160->3936255) req@ffff8800a5c23480 x1830963594028928/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143758.735518:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23480 with x1830963594028928 ext(3932160->3936255) 00002000:00010000:1.0:1746143758.735520:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c23480 00000100:00100000:3.0:1746143758.746643:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594028672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14757us (14988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.746656:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6094 00002000:00100000:3.0:1746143758.746667:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009ca6d180 x1830963594028672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.746681:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d180 with x1830963594028672 ext(3145728->4194303) 00002000:00010000:3.0:1746143758.746687:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6d180 00000100:00100000:0.0:1746143758.747669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.747883:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594029056 00000100:00100000:1.0:1746143758.747890:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594029056 00000100:00100000:1.0:1746143758.747935:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9096 00000100:00100000:1.0:1746143758.747943:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31132:x1830963594029056:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143758.747964:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.747981:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72ed67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a700e expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.748038:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748049:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748058:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748072:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748078:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748083:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748374:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748385:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.748391:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.748915:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.748928:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 11 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.748939:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594299776:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.749832:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.752724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.752839:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594299776:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.752861:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143758.753476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.753529:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594029440 00000100:00100000:1.0:1746143758.753534:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594029440 00000100:00100000:1.0:1746143758.753581:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3883 00000100:00100000:1.0:1746143758.753588:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:27138:x1830963594029440:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143758.753774:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:27138:x1830963594029440:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 186us (297us total) trans 8589943397 rc 0/0 00000100:00100000:1.0:1746143758.753781:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3883 00000100:00100000:2.0:1746143758.754175:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594029184 00000100:00100000:2.0:1746143758.754180:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594029184 00000100:00100000:2.0:1746143758.754211:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13033 00000100:00100000:2.0:1746143758.754216:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31129:x1830963594029184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143758.754226:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.754238:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7015 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.754266:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.754273:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143758.754274:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143758.754277:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.754637:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.754651:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 8 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.754661:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594299904:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.754726:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.756712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.756780:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.756842:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594029568 00000100:00100000:2.0:1746143758.756844:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594299904:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.756848:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594029568 00010000:00010000:2.0:1746143758.756864:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.756872:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 13 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.756879:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938baa00, rc 0) 00000100:00100000:1.0:1746143758.756893:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6950 00000100:00100000:1.0:1746143758.756899:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594029568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143758.756907:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31129:x1830963594029184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2691us (4191us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143758.756908:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.756913:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 13 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.756914:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13033 00010000:00010000:1.0:1746143758.756922:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 13 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.756937:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72ecb8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f9e expref: 13 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.756985:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594029696 00000100:00100000:3.0:1746143758.756988:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594029696 00002000:00100000:3.0:1746143758.757013:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3936255) req@ffff8800a5c23100 x1830963594029696/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.757020:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23100 with x1830963594029696 ext(3145728->3936255) 00010000:00010000:3.0:1746143758.757025:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 9 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.757034:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 9 pid: 8497 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.757040:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c23100 00000100:00100000:3.0:1746143758.757063:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1733 00000100:00100000:3.0:1746143758.757069:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594029696:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:1.0:1746143758.757282:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.757287:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.757296:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.757302:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.757454:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.757486:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594029568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 586us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.757492:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6950 00010000:00010000:1.0:1746143758.757530:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.757536:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143758.757957:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143758.757962:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143758.757975:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.757985:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.757993:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.757999:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758004:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758011:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a014c200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.758015:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758020:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758027:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143758.758029:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.758032:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758036:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72ed6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758044:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758048:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758051:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758055:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a014d000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.758056:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758061:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758066:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74100) 00010000:00010000:1.0:1746143758.758067:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.758069:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758073:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d000/0xe984082ccd72ed75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.758099:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72ed67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.758108:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 7 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.758113:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.758115:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143758.758116:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014d600, rc 0) 00000100:00100000:1.0:1746143758.758165:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31132:x1830963594029056:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10222us (10497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.758171:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9096 00010000:00010000:1.0:1746143758.762187:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143758.764705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.765931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.765948:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594029824 00000100:00100000:2.0:1746143758.765957:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594029824 00000100:00100000:2.0:1746143758.766003:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13034 00000100:00100000:2.0:1746143758.766011:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1965:x1830963594029824:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143758.766025:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.766037:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938bb400/0xe984082ccd72ed8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a701c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.766080:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594300032:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143758.766134:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.766205:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594030080 00000100:00100000:0.0:1746143758.766208:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594030080 00000100:00100000:0.0:1746143758.766226:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13035 00000100:00100000:0.0:1746143758.766231:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1965:x1830963594030080:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.766237:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.766256:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a702a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.766268:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.766269:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.766277:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 6 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.766290:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 6 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.766299:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095710a00, rc 0) 00000100:00100000:0.0:1746143758.766321:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594030080:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 89us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.766326:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13035 00000100:00100000:1.0:1746143758.766341:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.766356:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594029952 00000100:00100000:0.0:1746143758.766359:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594029952 00000100:00100000:1.0:1746143758.766363:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.766407:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594030336 00000100:00100000:0.0:1746143758.766409:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594030336 00000100:00100000:0.0:1746143758.766422:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13036 00000100:00100000:0.0:1746143758.766427:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963594029952:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.766433:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.766439:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7023 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.766448:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.766449:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.766454:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.766462:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 7 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.766469:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095711c00, rc 0) 00000100:00100000:0.0:1746143758.766484:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594029952:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.766489:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13036 00000100:00100000:0.0:1746143758.766499:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13037 00000100:00100000:0.0:1746143758.766504:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594030336:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.766511:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.766517:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7038 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.766526:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.766527:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.766531:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 8 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.766540:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 8 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.766547:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095711e00, rc 0) 00000100:00100000:0.0:1746143758.766561:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594030336:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.766566:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13037 00000100:00100000:0.0:1746143758.766600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.766644:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594030208 00000100:00100000:2.0:1746143758.766647:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594030208 00000100:00100000:2.0:1746143758.766663:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13038 00000100:00100000:2.0:1746143758.766667:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594030208:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143758.766673:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.766678:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7031 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.766688:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.766689:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.766693:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.766701:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.766706:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba200, rc 0) 00000100:00100000:2.0:1746143758.766724:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594030208:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.766728:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13038 00000100:00100000:0.0:1746143758.766833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.766964:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594030464 00000100:00100000:2.0:1746143758.766967:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594030464 00000100:00100000:3.0:1746143758.767411:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13039 00000100:00100000:3.0:1746143758.767419:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594030464:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143758.767426:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.767434:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009505f400/0xe984082ccd72edad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a703f expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.767461:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594300160:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143758.767959:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.769552:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594300032:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143758.769570:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938bb400/0xe984082ccd72ed8a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a701c expref: 8 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.769579:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938bb400/0xe984082ccd72ed8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a701c expref: 8 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.769599:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bb400, rc 0) 00000100:00100000:3.0:1746143758.769622:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594029824:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3612us (4924us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143758.769626:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13034 00002000:00010000:3.0:1746143758.772378:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143757 -> 1746143758 00002000:00010000:3.0:1746143758.772384:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143757 -> 1746143758 00002000:00010000:3.0:1746143758.772386:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143757 -> 1746143758 00000100:00100000:3.0:1746143758.772400:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594300160:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143758.772427:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009505f400/0xe984082ccd72edad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a703f expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.772438:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009505f400/0xe984082ccd72edad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a703f expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.772448:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009505f400, rc 0) 00000100:00100000:3.0:1746143758.772477:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594030464:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5060us (5644us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143758.772484:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13039 00000100:00100000:0.0:1746143758.774117:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1962:x1830963594029696:12345-192.168.202.48@tcp:4:cat.0 Request processed in 17043us (17332us total) trans 17179873029 rc 0/0 00000100:00100000:0.0:1746143758.774125:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1733 00002000:00100000:0.0:1746143758.774133:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3936255) req@ffff8800a5c23100 x1830963594029696/t17179873029(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143758.774154:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23100 with x1830963594029696 ext(3145728->3936255) 00010000:00010000:0.0:1746143758.774160:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.774176:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00002000:00010000:0.0:1746143758.774182:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c23100 00000100:00100000:0.0:1746143758.774766:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.774806:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594030720 00000100:00100000:1.0:1746143758.774812:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594030720 00000100:00100000:1.0:1746143758.774856:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9097 00000100:00100000:1.0:1746143758.774863:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31132:x1830963594030720:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143758.774877:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.774891:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd72edb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7046 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.774970:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.774983:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.774989:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.775012:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.775025:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 8 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.775034:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594300288:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.775109:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.775859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.775915:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594030848 00000100:00100000:1.0:1746143758.775919:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594030848 00010000:00010000:1.0:1746143758.775937:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.775963:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6951 00000100:00100000:1.0:1746143758.775968:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1962:x1830963594030848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.775976:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.775992:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.776001:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.776021:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72ed60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3936255) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7007 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.776687:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.776689:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.776695:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.776702:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.776727:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.776737:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594300416:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143758.777037:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.777506:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594300288:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.777529:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143758.778350:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.778504:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594030976 00000100:00100000:3.0:1746143758.778511:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594030976 00010000:00010000:3.0:1746143758.778534:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.778556:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6952 00000100:00100000:3.0:1746143758.778561:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594030976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.778570:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.778575:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.778584:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.778599:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72ed7c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a700e expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.778612:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.778615:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143758.778622:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143758.778628:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143758.778638:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594300416:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143758.778646:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143758.778652:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143758.778734:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.778739:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143758.778756:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:3.0:1746143758.778783:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594030976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 221us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.778789:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6952 00010000:00010000:0.0:1746143758.778867:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7000/0xe984082ccd72edb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.778895:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.778901:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.778903:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143758.778905:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc6000, rc 0) 00000100:00100000:1.0:1746143758.778934:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594030848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2702us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.778940:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6951 00000100:00100000:0.0:1746143758.779080:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594030720:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4216us (4386us total) trans 8589943398 rc 0/0 00000100:00100000:0.0:1746143758.779086:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9097 00000100:00100000:0.0:1746143758.780992:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.781034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.781096:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594031360 00000100:00100000:2.0:1746143758.781100:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594031360 00002000:00100000:2.0:1746143758.781126:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a5c23800 x1830963594031360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.781133:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23800 with x1830963594031360 ext(3145728->4194303) 00002000:00010000:2.0:1746143758.781136:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c23800 00000100:00100000:2.0:1746143758.781179:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6096 00000100:00100000:2.0:1746143758.781185:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594031360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143758.781329:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594031104 00000100:00100000:1.0:1746143758.781333:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594031104 00000100:00100000:1.0:1746143758.781354:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9098 00000100:00100000:1.0:1746143758.781359:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594031104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143758.781371:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.781382:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72edc9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a704d expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.781442:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.781451:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.781458:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.781478:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.781488:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.781497:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594300544:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.781554:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.787178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.788178:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594031488 00000100:00100000:2.0:1746143758.788186:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594031488 00010000:00010000:2.0:1746143758.788213:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 10 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.788241:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6953 00000100:00100000:2.0:1746143758.788265:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594031488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.788277:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.788282:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 10 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.788292:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 10 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.788311:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.788315:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143758.788321:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143758.788327:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143758.788340:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.788383:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594031488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 136us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.788390:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6953 00010000:00010000:1.0:1746143758.788542:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6000/0xe984082ccd72edbb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7046 expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.788566:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594300544:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.788587:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.788593:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.788598:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143758.788636:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143758.788639:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143758.788651:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.788674:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd72edc9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a704d expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.788683:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a704d expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.788689:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.788691:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143758.788693:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc6a00, rc 0) 00000100:00100000:1.0:1746143758.788713:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594031104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7354us (7678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.788718:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9098 00000100:00100000:2.0:1746143758.791055:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594031360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9863us (10059us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143758.791065:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6096 00002000:00100000:2.0:1746143758.791074:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a5c23800 x1830963594031360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143758.791082:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23800 with x1830963594031360 ext(3145728->4194303) 00002000:00010000:2.0:1746143758.791087:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c23800 00000100:00100000:1.0:1746143758.792077:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.792396:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.792471:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594031616 00000100:00100000:2.0:1746143758.792477:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594031616 00000100:00100000:3.0:1746143758.792504:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594031744 00000100:00100000:3.0:1746143758.792508:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594031744 00000100:00100000:2.0:1746143758.792509:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13040 00000100:00100000:2.0:1746143758.792515:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594031616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143758.792527:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143758.792528:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13041 00000100:00100000:3.0:1746143758.792532:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594031744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143758.792537:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.792539:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938ba400/0xe984082ccd72edd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7054 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.792544:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a705b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.792556:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.792558:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.792564:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.792575:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143758.792577:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594300672:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143758.792583:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6171600, rc 0) 00000100:00100000:3.0:1746143758.792604:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594031744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.792609:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13041 00000100:00100000:2.0:1746143758.792614:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.797622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.797756:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594300672:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143758.797785:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938ba400/0xe984082ccd72edd7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7054 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.797798:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938ba400/0xe984082ccd72edd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7054 expref: 8 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.797817:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba400, rc 0) 00000100:00100000:2.0:1746143758.797867:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594031616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5351us (5791us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143758.797873:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13040 00000100:00100000:3.0:1746143758.797948:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594032000 00000100:00100000:3.0:1746143758.797953:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594032000 00002000:00100000:3.0:1746143758.797986:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880136919180 x1830963594032000/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.797994:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919180 with x1830963594032000 ext(4194304->4755455) 00002000:00010000:3.0:1746143758.797999:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136919180 00000100:00100000:3.0:1746143758.798013:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6097 00000100:00100000:3.0:1746143758.798020:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594032000:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143758.802677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.803227:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594032256 00000100:00100000:1.0:1746143758.803234:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594032256 00000100:00100000:0.0:1746143758.803311:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9099 00000100:00100000:0.0:1746143758.803319:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594032256:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.803334:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.803350:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8e00/0xe984082ccd72ede5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7062 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.803427:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143758.803437:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143758.803447:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143758.803457:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143758.803544:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8e00/0xe984082ccd72ede5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.803664:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594032000:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5642us (6138us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143758.803672:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6097 00002000:00100000:3.0:1746143758.803680:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880136919180 x1830963594032000/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/440 e 0 to 0 dl 1746143769 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.803690:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919180 with x1830963594032000 ext(4194304->4755455) 00002000:00010000:3.0:1746143758.803838:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136919180 00010000:00010000:0.0:1746143758.803887:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.803894:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.803896:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143758.803899:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8c00, rc 0) 00000100:00100000:0.0:1746143758.803917:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31132:x1830963594032256:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 600us (1248us total) trans 8589943399 rc 0/0 00000100:00100000:0.0:1746143758.803922:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9099 00000100:00100000:0.0:1746143758.806604:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.806636:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.806821:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594032384 00000100:00100000:3.0:1746143758.806827:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594032384 00000100:00100000:3.0:1746143758.806858:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594032640 00000100:00100000:3.0:1746143758.806860:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594032640 00000100:00100000:3.0:1746143758.806881:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13042 00000100:00100000:3.0:1746143758.806887:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594032384:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143758.806918:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.806932:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.806939:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143758.806940:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143758.806942:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.806965:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.806980:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 17 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.806990:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594300800:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.807201:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.807215:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13043 00000100:00100000:3.0:1746143758.807221:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594032640:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143758.807237:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.807261:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 9 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.807267:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 8 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.807272:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.807277:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.807278:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.807280:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.807295:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.807303:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 20 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.807311:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594300928:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.807373:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.807388:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594032896 00000100:00100000:0.0:1746143758.807392:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594032896 00000100:00100000:0.0:1746143758.807410:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13044 00000100:00100000:0.0:1746143758.807416:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594032896:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143758.807432:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807442:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807450:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 8 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.807456:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.807458:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143758.807460:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143758.807462:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143758.807464:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.807470:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594032512 00000100:00100000:2.0:1746143758.807473:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594032512 00010000:00010000:0.0:1746143758.807480:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807492:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 10 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.807500:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594301056:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.807504:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13045 00000100:00100000:2.0:1746143758.807510:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594032512:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143758.807525:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.807535:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143758.807539:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143758.807543:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.807549:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.807555:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.807556:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.807558:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.807578:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.807586:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 9 pid: 2839 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.807586:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.807594:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594301184:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.807606:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.807607:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 8 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.807614:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 9 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.807615:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 8 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.807623:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594301312:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.807623:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594301440:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.807625:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.807633:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 9 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.807641:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594301568:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.807648:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 9 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807653:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.807655:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 9 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:0.0:1746143758.807660:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.807663:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594301696:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.807664:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594032768 00010000:00010000:2.0:1746143758.807665:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143758.807667:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594032768 00000100:00100000:0.0:1746143758.807667:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594301824:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.807672:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 20 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:3.0:1746143758.807677:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.807679:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594301952:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.807689:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033024 00000100:00100000:1.0:1746143758.807691:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033024 00000100:00100000:2.0:1746143758.807695:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.807697:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13046 00000100:00100000:0.0:1746143758.807703:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594032768:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:1.0:1746143758.807715:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13047 00010000:00010000:0.0:1746143758.807717:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.807724:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594033024:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143758.807728:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807734:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.807739:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807741:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807746:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.807747:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.807749:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807749:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.807755:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.807759:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.807760:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.807762:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807764:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807771:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 17 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.807775:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143758.807778:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594302080:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.807781:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 10 pid: 4581 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.807787:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594302208:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143758.807799:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.807806:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:1.0:1746143758.807810:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.807817:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 20 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.807818:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594302336:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.807825:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594302464:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.807840:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00010000:00010000:0.0:1746143758.807840:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.807848:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.807855:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594302592:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.807874:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.807883:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143758.809875:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.809931:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033152 00000100:00100000:2.0:1746143758.809936:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033152 00010000:00010000:2.0:1746143758.809959:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.809979:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6954 00000100:00100000:2.0:1746143758.809984:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1962:x1830963594033152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.809993:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.810011:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.810021:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.810174:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594300800:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.810192:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.810220:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594300928:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143758.810291:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014de00/0xe984082ccd72ed4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6ff2 expref: 11 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.810305:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594301056:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.810365:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.810397:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594033152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 412us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.810403:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6954 00000100:00100000:2.0:1746143758.813729:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594301184:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.813872:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594302080:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.813931:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594301568:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.813939:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594301952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.813960:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.814028:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594301312:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143758.814038:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594301696:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143758.814057:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.814086:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594301440:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.814095:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594301824:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.814112:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.814281:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594302208:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.814288:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594302336:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.814289:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594302464:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.814296:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594302592:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.814306:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.814312:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.816304:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.816347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.816439:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033920 00000100:00100000:2.0:1746143758.816445:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033920 00010000:00010000:2.0:1746143758.816475:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 10 pid: 2839 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.816946:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034560 00000100:00100000:2.0:1746143758.816949:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034560 00010000:00010000:2.0:1746143758.816961:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.816982:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6955 00000100:00100000:2.0:1746143758.816988:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594033920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143758.816989:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6956 00010000:00010000:2.0:1746143758.816998:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143758.816999:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594034560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.817008:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.817017:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 10 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.817018:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.817026:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 10 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.817161:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.817181:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3a1200/0xe984082ccd72ebe6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f12 expref: 21 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.817288:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd72ec1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f3c expref: 10 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.817337:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.817376:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963594034560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 380us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.817383:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6956 00000100:00100000:0.0:1746143758.817653:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143758.817907:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.818020:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034816 00000100:00100000:3.0:1746143758.818025:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034816 00000100:00100000:2.0:1746143758.818040:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1963:x1830963594033920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1051us (1741us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143758.818041:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 18 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.818048:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6955 00000100:00100000:3.0:1746143758.818059:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6957 00000100:00100000:3.0:1746143758.818064:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594034816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.818071:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.818083:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 18 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.818090:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 18 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.818102:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094de9800/0xe984082ccd72ed28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fcf expref: 18 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.818111:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.818125:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594034816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.818130:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6957 00000100:00100000:0.0:1746143758.819822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819852:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819864:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819872:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.819949:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.820195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.820265:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033280 00000100:00100000:1.0:1746143758.820270:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033280 00010000:00010000:1.0:1746143758.820291:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 20 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.820307:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033536 00000100:00100000:1.0:1746143758.820309:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033536 00010000:00010000:1.0:1746143758.820319:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 11 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.820326:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033792 00000100:00100000:1.0:1746143758.820327:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033792 00010000:00010000:1.0:1746143758.820332:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 12 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.820338:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034176 00000100:00100000:1.0:1746143758.820339:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034176 00010000:00010000:1.0:1746143758.820345:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 13 pid: 4581 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.820352:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034432 00000100:00100000:1.0:1746143758.820354:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034432 00010000:00010000:1.0:1746143758.820362:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.820370:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034944 00000100:00100000:1.0:1746143758.820371:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034944 00010000:00010000:1.0:1746143758.820378:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.820385:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033664 00000100:00100000:1.0:1746143758.820386:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033664 00010000:00010000:1.0:1746143758.820393:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 10 pid: 6929 timeout: 937 lvb_type: 1 00000100:00100000:1.0:1746143758.820400:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034048 00000100:00100000:2.0:1746143758.820442:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034304 00000100:00100000:2.0:1746143758.820445:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034304 00010000:00010000:2.0:1746143758.820457:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 11 pid: 2839 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.820466:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594034688 00000100:00100000:2.0:1746143758.820467:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034688 00010000:00010000:2.0:1746143758.820475:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 21 pid: 8497 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.820484:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6958 00000100:00100000:2.0:1746143758.820489:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594033280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.820498:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143758.820511:0:7149:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:2.0:1746143758.820515:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 21 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820524:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 21 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820551:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f81a200/0xe984082ccd72ed1a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc1 expref: 21 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820563:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.820601:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594033280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 111us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.820608:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6958 00000100:00100000:2.0:1746143758.820620:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6959 00000100:00100000:2.0:1746143758.820625:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594033536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.820631:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.820638:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 13 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820644:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 13 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820654:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095710a00/0xe984082ccd72ed91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a702a expref: 13 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820662:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.820675:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594033536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.820679:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6959 00000100:00100000:2.0:1746143758.820687:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6960 00000100:00100000:2.0:1746143758.820692:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594033792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.820697:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.820705:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 11 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820711:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 11 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820730:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095711c00/0xe984082ccd72ed98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7023 expref: 11 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820737:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.820739:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.820742:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.820750:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.820769:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.820781:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594033792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 89us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.820786:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6960 00000100:00100000:2.0:1746143758.820797:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6961 00000100:00100000:2.0:1746143758.820801:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594034176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.820807:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.820815:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 9 pid: 4581 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820821:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 9 pid: 4581 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820831:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6171600/0xe984082ccd72edde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a705b expref: 9 pid: 4581 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.820842:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.820854:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594034176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.820859:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6961 00000100:00100000:2.0:1746143758.820868:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6962 00000100:00100000:2.0:1746143758.820872:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594034432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.820878:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.820889:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.820896:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.820906:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72ed44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6feb expref: 17 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.820914:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.820927:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594034432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.820932:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6962 00000100:00100000:2.0:1746143758.820941:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6963 00000100:00100000:2.0:1746143758.820945:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594034944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.820950:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.820958:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.820965:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.820974:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f81a800/0xe984082ccd72ed13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fba expref: 10 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.820981:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.820993:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594034944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.820998:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6963 00000100:00100000:2.0:1746143758.821007:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6964 00000100:00100000:2.0:1746143758.821011:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594033664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.821016:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.821022:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 11 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.821029:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 11 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.821038:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095711e00/0xe984082ccd72ed9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7038 expref: 11 pid: 6929 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.821044:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.821046:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.821048:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821055:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821070:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.821083:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594033664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.821088:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6964 00000100:00100000:2.0:1746143758.821106:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6965 00000100:00100000:2.0:1746143758.821110:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594034304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.821116:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.821123:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.821130:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.821163:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938ba200/0xe984082ccd72eda6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7031 expref: 9 pid: 2839 timeout: 937 lvb_type: 1 00010000:00010000:2.0:1746143758.821171:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.821172:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.821175:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821181:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.821191:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6966 00010000:00010000:2.0:1746143758.821198:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.821200:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594034688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143758.821213:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594034304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 102us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.821217:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6965 00010000:00010000:2.0:1746143758.821235:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821241:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821270:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821277:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821282:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821288:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a71e9000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143758.821291:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821297:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821309:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821314:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.821342:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594032768:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 13640us (13802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.821348:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13046 00010000:00010000:2.0:1746143758.821369:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821375:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821386:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821392:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821397:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821401:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143758.821404:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821410:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821417:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.821423:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd72ee0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.821449:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594032512:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 13940us (13991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.821453:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13045 00010000:00010000:3.0:1746143758.821493:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.821506:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 19 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.821519:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 19 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.821530:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72ed83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7015 expref: 19 pid: 8497 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.821538:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.821539:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.821542:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.821549:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.821565:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.821579:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594034688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 381us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.821584:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6966 00000100:00100000:3.0:1746143758.821608:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594033408 00000100:00100000:3.0:1746143758.821611:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594033408 00002000:00100000:3.0:1746143758.821638:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (8192->581631) req@ffff880136918e00 x1830963594033408/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/0 e 0 to 0 dl 1746143769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.821644:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918e00 with x1830963594033408 ext(8192->581631) 00010000:00010000:3.0:1746143758.821649:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 16 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.821662:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 16 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.821668:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136918e00 00000100:00100000:3.0:1746143758.821680:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1734 00000100:00100000:3.0:1746143758.821685:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594033408:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143758.822182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.822427:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594035200 00000100:00100000:3.0:1746143758.822430:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594035200 00000100:00100000:3.0:1746143758.822455:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3884 00000100:00100000:3.0:1746143758.822460:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31129:x1830963594035200:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143758.822601:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31129:x1830963594035200:12345-192.168.202.48@tcp:35:cat.0 Request processed in 140us (419us total) trans 8589943400 rc 0/0 00000100:00100000:3.0:1746143758.822606:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3884 00000100:00100000:1.0:1746143758.822673:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594034048 00010000:00010000:1.0:1746143758.822693:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 9 pid: 2839 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.822710:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6967 00000100:00100000:1.0:1746143758.822715:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594034048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.822722:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.822731:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 9 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.822738:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 9 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.822756:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090671600/0xe984082ccd72ecc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fa5 expref: 9 pid: 2839 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.822768:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.822770:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.822772:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822778:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822799:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143758.822808:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.822815:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594034048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (2883us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143758.822817:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.822820:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6967 00010000:00010000:2.0:1746143758.822832:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822837:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.822839:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822844:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.822845:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.822855:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6171e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143758.822855:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.822859:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822861:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.822865:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822866:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822870:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc6000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143758.822872:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.822875:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822878:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.822880:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6171e00/0xe984082ccd72ee01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822884:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822889:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc6000/0xe984082ccd72ee1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.822914:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594033024:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 15190us (15328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.822919:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13047 00000100:00100000:2.0:1746143758.822921:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594032640:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 15700us (16284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.822927:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13043 00010000:00010000:1.0:1746143758.822935:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822941:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822953:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822958:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822962:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822966:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a71e8600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143758.822968:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822973:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822981:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.822987:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8600/0xe984082ccd72ee08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.823014:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594032896:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 15598us (15642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.823020:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13044 00000100:00100000:3.0:1746143758.829836:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594033408:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8142us (9919us total) trans 21474840351 rc 0/0 00000100:00100000:3.0:1746143758.829847:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1734 00002000:00100000:3.0:1746143758.829856:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (8192->581631) req@ffff880136918e00 x1830963594033408/t21474840351(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:154/0 lens 488/448 e 0 to 0 dl 1746143769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143758.829867:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918e00 with x1830963594033408 ext(8192->581631) 00010000:00010000:3.0:1746143758.829876:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.829891:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 937 lvb_type: 0 00002000:00010000:3.0:1746143758.829898:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136918e00 00000100:00100000:0.0:1746143758.832563:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.832688:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594035328 00000100:00100000:3.0:1746143758.832698:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594035328 00010000:00010000:3.0:1746143758.832739:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.833996:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6968 00000100:00100000:3.0:1746143758.834011:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594035328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.834026:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.834049:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.834062:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.834083:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f81be00/0xe984082ccd72ed21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->581631) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fc8 expref: 18 pid: 21542 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.834096:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.834098:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.834103:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.834110:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.834376:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.834432:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594035328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 426us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.834438:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6968 00010000:00010000:2.0:1746143758.834763:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834773:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834796:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834802:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834808:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834814:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6171400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143758.834817:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834823:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834833:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.834838:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6171400/0xe984082ccd72edfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.834901:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1965:x1830963594032384:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 28014us (28302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.834908:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13042 00000100:00100000:0.0:1746143758.838314:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.838386:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594035584 00000100:00100000:2.0:1746143758.838396:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594035584 00000100:00100000:2.0:1746143758.838756:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9100 00000100:00100000:2.0:1746143758.838764:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31132:x1830963594035584:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143758.838812:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.838838:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6a00/0xe984082ccd72edd0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a704d expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.838856:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.838860:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143758.838889:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.838899:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.838906:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 247 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.838911:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.838916:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.838941:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.838950:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 247 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.838962:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594302720:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.839497:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 247 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.839506:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 247 pid: 21713 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.839515:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594302848:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.841226:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 11 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.841241:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 11 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.841263:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594302976:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.842608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.842664:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594035712 00000100:00100000:0.0:1746143758.842664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.842674:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594035712 00010000:00010000:1.0:1746143758.842713:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 248 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.842737:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594035840 00000100:00100000:1.0:1746143758.842740:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594035840 00010000:00010000:1.0:1746143758.842747:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 249 pid: 21713 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.842762:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6969 00000100:00100000:1.0:1746143758.842768:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963594035712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.842780:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143758.842785:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 249 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.842794:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 249 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.842814:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.842818:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.842824:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.842842:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6970 00000100:00100000:3.0:1746143758.842852:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1965:x1830963594035840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143758.842852:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963594035712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.842857:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6969 00010000:00010000:3.0:1746143758.842860:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.842865:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 249 pid: 21713 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.842873:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 248 pid: 21713 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.842883:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.842886:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.842891:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.842907:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1965:x1830963594035840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 59us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.842912:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6970 00000100:00100000:2.0:1746143758.842917:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f840 going to sleep for 11 seconds 00010000:00010000:2.0:1746143758.842941:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72ece2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6fac expref: 247 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.842953:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594302720:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.842962:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ec56 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f5f expref: 246 pid: 21713 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.842969:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594302848:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.844177:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594302976:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.844198:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143758.844722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.844792:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594035968 00000100:00100000:2.0:1746143758.844796:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594035968 00010000:00010000:2.0:1746143758.844818:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 12 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.844858:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6971 00000100:00100000:2.0:1746143758.844865:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594035968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.844875:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.844879:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 12 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.844887:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 12 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.844902:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8200/0xe984082ccd72ec4f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a6f58 expref: 12 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.844911:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.844915:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.844922:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.844927:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.844948:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143758.844986:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594035968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 122us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.844992:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6971 00010000:00010000:0.0:1746143758.845363:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143758.845371:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000040:00080000:0.0:1746143758.847223:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2623, 88 off221360 00000004:00080000:0.0:1746143758.847233:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857092446ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.847293:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2646, 88 off223560 00000004:00080000:0.0:1746143758.847297:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857157192ns, next at 833304778357ns, rc = 0 00000040:00080000:0.0:1746143758.847841:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2647, 88 off223648 00000004:00080000:0.0:1746143758.847846:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857705883ns, next at 833304778357ns, rc = 0 00000040:00080000:0.0:1746143758.847853:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2624, 88 off221448 00000004:00080000:0.0:1746143758.847856:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857716220ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.847914:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2625, 88 off221536 00000004:00080000:0.0:1746143758.847918:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857777996ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.847924:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2648, 88 off223736 00000004:00080000:0.0:1746143758.847926:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857786655ns, next at 833304778357ns, rc = 0 00000040:00080000:0.0:1746143758.847932:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2649, 88 off223824 00000004:00080000:0.0:1746143758.847934:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857794285ns, next at 833304778357ns, rc = 0 00000040:00080000:0.0:1746143758.847940:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2650, 88 off223912 00000004:00080000:0.0:1746143758.847942:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857802560ns, next at 833304778357ns, rc = 0 00000040:00080000:0.0:1746143758.847948:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2626, 88 off221624 00000004:00080000:0.0:1746143758.847951:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857811504ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.847957:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2651, 88 off224000 00000004:00080000:0.0:1746143758.847959:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857819553ns, next at 833304778357ns, rc = 0 00000040:00080000:0.0:1746143758.847964:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2627, 88 off221712 00000004:00080000:0.0:1746143758.847966:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857826786ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.847972:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2652, 88 off224088 00000004:00080000:0.0:1746143758.847974:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857834484ns, next at 833304778357ns, rc = 0 00000040:00080000:0.0:1746143758.847979:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2628, 88 off221800 00000004:00080000:0.0:1746143758.847981:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857841906ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.847987:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2629, 88 off221888 00000004:00080000:0.0:1746143758.847989:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857849396ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.847994:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2630, 88 off221976 00000004:00080000:0.0:1746143758.847996:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857856586ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.848002:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2631, 88 off222064 00000004:00080000:0.0:1746143758.848004:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837857864746ns, next at 788202887869ns, rc = 0 00000040:00080000:0.0:1746143758.848010:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2653, 88 off224176 00000004:00080000:0.0:1746143758.848012:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837857872403ns, next at 833304778357ns, rc = 0 00000004:00010000:0.0:1746143758.875530:0:20509:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f0adc00 reply state ffff88009c72c400 transno 8589943401 ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143758.875544:0:20509:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746143758.875646:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31132:x1830963594035584:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 36880us (37340us total) trans 8589943401 rc 0/0 00000100:00100000:0.0:1746143758.875658:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9100 00000001:00080000:0.0:1746143758.875691:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943401 is committed 00000004:00080000:0.0:1746143758.875696:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1989 committed 00000004:00080000:0.0:1746143758.875705:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1967 committed 00000004:00080000:0.0:1746143758.875710:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1966 committed 00000004:00080000:0.0:1746143758.875712:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1965 committed 00000004:00080000:0.0:1746143758.875713:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1964 committed 00000004:00080000:0.0:1746143758.875715:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1988 committed 00000004:00080000:0.0:1746143758.875716:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1963 committed 00000004:00080000:0.0:1746143758.875717:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1987 committed 00000004:00080000:0.0:1746143758.875719:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1962 committed 00000004:00080000:0.0:1746143758.875720:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1986 committed 00000004:00080000:0.0:1746143758.875723:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1985 committed 00000004:00080000:0.0:1746143758.875724:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746143758.875725:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1961 committed 00000004:00080000:0.0:1746143758.875727:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1960 committed 00000004:00080000:0.0:1746143758.875728:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746143758.875730:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746143758.875731:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1959 committed 00000001:00080000:0.0:1746143758.875743:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943397 is committed 00000001:00080000:0.0:1746143758.875748:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943394 is committed 00000001:00080000:0.0:1746143758.875765:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943395 is committed 00000001:00080000:0.0:1746143758.875778:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943400 is committed 00000100:00100000:0.0:1746143758.875882:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.875930:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.875963:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.875978:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.875991:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143758.875996:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.876007:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.876017:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.876022:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594303104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.876028:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.876041:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594304256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.876047:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143758.876061:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303744 00000100:00100000:0.0:1746143758.876061:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303232 00000100:00100000:2.0:1746143758.876066:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303744 00000100:00100000:1.0:1746143758.876066:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594303616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.876066:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303232 00000100:00100000:1.0:1746143758.876078:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.876088:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.876094:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303360 00000100:00100000:0.0:1746143758.876096:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303360 00000100:00100000:2.0:1746143758.876100:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303872 00000100:00100000:1.0:1746143758.876101:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143758.876103:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303872 00000100:00100000:1.0:1746143758.876123:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.876135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143758.876174:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.876181:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.876191:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.876197:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091025400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143758.876200:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.876206:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.876218:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.876221:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143758.876224:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.876229:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091025400/0xe984082ccd72ee24 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143758.876514:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303104 00000100:00100000:2.0:1746143758.876515:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303616 00000100:00100000:2.0:1746143758.876518:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303616 00000100:00100000:0.0:1746143758.876518:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303104 00000100:00100000:2.0:1746143758.876538:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304128 00000100:00100000:2.0:1746143758.876540:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304128 00000100:00100000:2.0:1746143758.876584:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13048 00000100:00100000:2.0:1746143758.876591:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3292:x1830963594303232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.876607:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13049 00000100:00100000:0.0:1746143758.876613:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3292:x1830963594303744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.876641:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13050 00000100:00100000:0.0:1746143758.876646:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3292:x1830963594303360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.876736:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746143758.876742:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594303488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.876762:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.876766:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963594303360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (756us total) trans 17179873030 rc 0/0 00000100:00100000:1.0:1746143758.876770:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.876772:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13050 00000100:00100000:1.0:1746143758.876780:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.876781:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304640 00000100:00100000:0.0:1746143758.876784:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304640 00000100:00100000:1.0:1746143758.876787:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.876791:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303488 00000100:00100000:0.0:1746143758.876793:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303488 00000100:00100000:0.0:1746143758.876799:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304000 00000100:00100000:0.0:1746143758.876801:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304000 00000100:00100000:1.0:1746143758.876802:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143758.876804:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594303232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (873us total) trans 17179873031 rc 0/0 00000100:00100000:0.0:1746143758.876807:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304512 00000100:00100000:0.0:1746143758.876808:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304512 00000100:00100000:2.0:1746143758.876809:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13048 00000100:00100000:1.0:1746143758.876809:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594305024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.876815:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13051 00000100:00100000:0.0:1746143758.876819:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963594303872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143758.876821:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13052 00000100:00100000:2.0:1746143758.876825:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594303616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.876829:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143758.876848:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305024 00000100:00100000:1.0:1746143758.876848:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594304384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.876851:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305024 00000100:00100000:2.0:1746143758.876862:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13053 00000100:00100000:1.0:1746143758.876864:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143758.876866:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594303104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.876870:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594304896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.876881:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.876889:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143758.876892:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594304768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.876905:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.876906:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594303872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (876us total) trans 17179873032 rc 0/0 00000100:00100000:0.0:1746143758.876912:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13051 00000100:00100000:1.0:1746143758.876918:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304384 00000100:00100000:0.0:1746143758.876920:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304896 00000100:00100000:1.0:1746143758.876921:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304384 00000100:00100000:0.0:1746143758.876923:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304896 00000100:00100000:0.0:1746143758.876930:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304768 00000100:00100000:0.0:1746143758.876932:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304768 00000100:00100000:1.0:1746143758.876936:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13054 00000100:00100000:1.0:1746143758.876940:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594304128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.876941:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13055 00000100:00100000:0.0:1746143758.876945:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594304640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.876974:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13056 00000100:00100000:1.0:1746143758.876979:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594303488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143758.876981:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594303104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (933us total) trans 17179873033 rc 0/0 00000100:00100000:2.0:1746143758.876986:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13053 00000100:00100000:2.0:1746143758.876995:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13057 00000100:00100000:2.0:1746143758.877000:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594304000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.877045:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594304640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (908us total) trans 21474840352 rc 0/0 00000100:00100000:0.0:1746143758.877050:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13055 00000100:00100000:0.0:1746143758.877059:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13058 00000100:00100000:0.0:1746143758.877062:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594304512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143758.877063:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143758.877066:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143758.877068:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143758.877070:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143758.877072:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143758.877079:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594304000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (297us total) trans 17179873035 rc 0/0 00000100:00100000:2.0:1746143758.877084:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13057 00000100:00100000:1.0:1746143758.877091:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594303488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (328us total) trans 17179873034 rc 0/0 00000100:00100000:2.0:1746143758.877094:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13059 00000100:00100000:1.0:1746143758.877097:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13056 00000100:00100000:2.0:1746143758.877098:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594305024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.877108:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13060 00000100:00100000:2.0:1746143758.877111:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13061 00000100:00100000:1.0:1746143758.877112:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963594304896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.877114:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963594304384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.877129:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594304512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (326us total) trans 21474840353 rc 0/0 00000100:00100000:0.0:1746143758.877134:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13058 00000100:00100000:2.0:1746143758.877156:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13062 00000100:00100000:2.0:1746143758.877160:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3293:x1830963594304768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.877223:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594304128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 281us (1120us total) trans 21474840354 rc 0/0 00000100:00100000:0.0:1746143758.877226:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143758.877228:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13054 00000100:00100000:2.0:1746143758.877236:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3293:x1830963594304768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (329us total) trans 21474840355 rc 0/0 00000100:00100000:1.0:1746143758.877237:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304256 00000100:00100000:1.0:1746143758.877240:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304256 00000100:00100000:2.0:1746143758.877241:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13062 00000100:00100000:2.0:1746143758.877260:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13063 00000100:00100000:2.0:1746143758.877264:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594304256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.877267:0:3292:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873027 gen 2 00000004:00080000:0.0:1746143758.877272:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc12680, transno 17179873012 00000004:00080000:0.0:1746143758.877277:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc13100, transno 17179873013 00000004:00080000:0.0:1746143758.877279:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc12300, transno 17179873014 00000004:00080000:1.0:1746143758.877282:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136918a80/2, rc 0, transno 21474840355 00000004:00080000:0.0:1746143758.877282:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc11500, transno 17179873015 00000004:00080000:0.0:1746143758.877284:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc11880, transno 17179873016 00000004:00080000:0.0:1746143758.877285:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc11c00, transno 17179873017 00000004:00080000:0.0:1746143758.877287:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc13480, transno 17179873018 00000004:00080000:0.0:1746143758.877289:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc10e00, transno 17179873019 00000100:00100000:1.0:1746143758.877290:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594304768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143758.877292:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0d880, transno 17179873020 00000004:00080000:0.0:1746143758.877295:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0ea00, transno 17179873021 00000004:00080000:0.0:1746143758.877297:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0d180, transno 17179873022 00000004:00080000:0.0:1746143758.877299:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0ed80, transno 17179873023 00000004:00080000:0.0:1746143758.877301:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0fb80, transno 17179873024 00000004:00080000:0.0:1746143758.877303:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0c380, transno 17179873025 00000004:00080000:0.0:1746143758.877305:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0f480, transno 17179873026 00000004:00080000:0.0:1746143758.877306:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0ca80, transno 17179873027 00000100:00100000:0.0:1746143758.877311:0:3292:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008f0ac380 x1830963594303360/t17179873030(17179873030) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143774 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143758.877318:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0ac380/2, rc 0, transno 17179873030 00000100:00100000:0.0:1746143758.877321:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143758.877329:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0adf80/2, rc 0, transno 17179873032 00000100:00100000:0.0:1746143758.877331:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143758.877334:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963594304256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (108us total) trans 21474840356 rc 0/0 00000004:00080000:0.0:1746143758.877337:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0af800/2, rc 0, transno 17179873031 00000100:00100000:2.0:1746143758.877338:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13063 00000100:00100000:0.0:1746143758.877340:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143758.877349:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca6f100/2, rc 0, transno 21474840356 00000100:00100000:0.0:1746143758.877352:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594304256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.877414:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594305024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (583us total) trans 21474840357 rc 0/0 00000100:00100000:2.0:1746143758.877419:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13059 00000100:00100000:1.0:1746143758.877827:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963594304896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 714us (943us total) trans 21474840358 rc 0/0 00000100:00100000:1.0:1746143758.877836:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13060 00000004:00080000:1.0:1746143758.877857:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691b480/2, rc 0, transno 21474840358 00000100:00100000:1.0:1746143758.877860:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594304896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.877869:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594305152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.877885:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143758.877900:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0ac000/2, rc 0, transno 17179873034 00000100:00100000:1.0:1746143758.877902:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594303488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.877908:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0aed80/2, rc 0, transno 17179873035 00000100:00100000:1.0:1746143758.877910:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.877915:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136919c00/2, rc 0, transno 21474840353 00000100:00100000:1.0:1746143758.877917:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.877920:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963594304384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 803us (1054us total) trans 21474840359 rc 0/0 00000004:00080000:1.0:1746143758.877922:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136919880/2, rc 0, transno 21474840357 00000100:00100000:1.0:1746143758.877925:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594305024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.877926:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13061 00000004:00080000:1.0:1746143758.877930:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691a300/2, rc 0, transno 21474840352 00000100:00100000:1.0:1746143758.877933:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.877937:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305152 00000100:00100000:3.0:1746143758.877939:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305152 00000004:00080000:1.0:1746143758.877939:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0aea00/2, rc 0, transno 17179873033 00000100:00100000:1.0:1746143758.877940:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594303104:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143758.877945:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca6dc00/2, rc 0, transno 21474840354 00000100:00100000:1.0:1746143758.877947:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594304128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.877952:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13064 00000100:00100000:3.0:1746143758.877956:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594305152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.878045:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594305152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (158us total) trans 21474840360 rc 0/0 00000100:00100000:3.0:1746143758.878050:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13064 00000004:00080000:3.0:1746143758.878070:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca6e680/2, rc 0, transno 21474840359 00000100:00100000:3.0:1746143758.878074:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594304384:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143758.878126:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093804380/2, rc 0, transno 21474840360 00000100:00100000:1.0:1746143758.878130:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594305152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143758.878863:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 16 done 00000100:00100000:3.0:1746143758.879311:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594303744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2697us (3329us total) trans 17179873036 rc 0/0 00000100:00100000:3.0:1746143758.879318:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13049 00000004:00080000:0.0:1746143758.879641:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0aca80/2, rc 0, transno 17179873036 00000100:00100000:0.0:1746143758.879646:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594303744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143758.879742:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594303616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2915us (3662us total) trans 17179873037 rc 0/0 00000100:00100000:2.0:1746143758.879748:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13052 00000004:00080000:1.0:1746143758.879835:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f0ae680/2, rc 0, transno 17179873037 00000100:00100000:1.0:1746143758.879840:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594303616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.883331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.883840:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594036096 00000100:00100000:0.0:1746143758.883847:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594036096 00000100:00100000:0.0:1746143758.883896:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9101 00000100:00100000:0.0:1746143758.883904:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31132:x1830963594036096:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.883926:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.883941:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7069 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.883990:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.884002:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.884017:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.884020:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143758.884022:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518bc00, rc 0) 00000100:00100000:0.0:1746143758.884070:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594036096:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 167us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.884076:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9101 00000100:00100000:0.0:1746143758.885347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.885717:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594036352 00000100:00100000:1.0:1746143758.885722:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594036352 00000100:00100000:1.0:1746143758.885756:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9102 00000100:00100000:1.0:1746143758.885761:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31136:x1830963594036352:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143758.885778:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.885788:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c66600/0xe984082ccd72ee32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7070 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.885945:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.885956:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.885964:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.885976:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.885981:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.885985:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.886068:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.886080:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.886086:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.886110:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.886120:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 7 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.886131:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594305280:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143758.886233:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.889681:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.890163:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594036480 00000100:00100000:1.0:1746143758.890170:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594036480 00000100:00100000:1.0:1746143758.890214:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9103 00000100:00100000:1.0:1746143758.890221:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594036480:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143758.890236:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.890261:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a600/0xe984082ccd72ee4e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7077 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.890331:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.890342:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.890351:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143758.890375:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143758.890378:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143758.890390:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143758.890409:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a600/0xe984082ccd72ee4e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.890420:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.890427:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.890429:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143758.890432:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652be00, rc 0) 00000100:00100000:1.0:1746143758.890480:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31132:x1830963594036480:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 259us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.890486:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9103 00000100:00100000:0.0:1746143758.890771:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594305280:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143758.890787:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143758.891773:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.891878:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594036608 00000100:00100000:3.0:1746143758.891883:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594036608 00010000:00010000:3.0:1746143758.891908:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.892068:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6972 00000100:00100000:3.0:1746143758.892075:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594036608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.892084:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.892088:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.892097:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.892112:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8c00/0xe984082ccd72edec lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7062 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.892123:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.892128:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143758.892135:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143758.892170:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143758.892186:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143758.892236:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892242:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143758.892269:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143758.892377:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892384:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892389:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892394:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bde00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.892398:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892404:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892411:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.892413:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143758.892416:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892420:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bde00/0xe984082ccd72ee47 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892433:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892437:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892442:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892449:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c67200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.892451:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892456:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892461:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143758.892462:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143758.892464:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892468:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c67200/0xe984082ccd72ee39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892476:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892481:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892485:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892488:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bcc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.892490:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892494:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892498:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74200) 00010000:00010000:0.0:1746143758.892500:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143758.892502:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892506:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ee40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.892537:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c66600/0xe984082ccd72ee32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7070 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.892543:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c66600/0xe984082ccd72ee32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7070 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.892550:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c66600, rc 0) 00000100:00100000:3.0:1746143758.892729:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594036608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 654us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.892735:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6972 00000100:00100000:0.0:1746143758.893278:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31136:x1830963594036352:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7515us (7931us total) trans 8589943402 rc 301/301 00000100:00100000:0.0:1746143758.893283:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9102 00000100:00100000:1.0:1746143758.893735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.893769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.893791:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.893803:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.893815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.893840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.893925:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594036736 00000100:00100000:0.0:1746143758.893930:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594036736 00000100:00100000:0.0:1746143758.893955:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594036992 00000100:00100000:0.0:1746143758.893957:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594036992 00000100:00100000:0.0:1746143758.893977:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594037248 00000100:00100000:0.0:1746143758.893979:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594037248 00000100:00100000:0.0:1746143758.893989:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594036864 00000100:00100000:0.0:1746143758.893990:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594036864 00000100:00100000:0.0:1746143758.893998:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594037120 00000100:00100000:0.0:1746143758.893999:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594037120 00000100:00100000:0.0:1746143758.894007:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594037376 00000100:00100000:0.0:1746143758.894009:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594037376 00000100:00100000:0.0:1746143758.894019:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13065 00000100:00100000:0.0:1746143758.894024:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963594036736:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.894038:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.894053:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a707e expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.894054:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13066 00000100:00100000:3.0:1746143758.894061:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963594036992:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143758.894069:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746143758.894072:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a0e, atime: 0x68140a0b, ctime: 0x68140a0e, blocks: 0x7a7 00010000:00010000:3.0:1746143758.894078:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a708c expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.894086:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894088:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143758.894094:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a0e, atime: 0x68140a0c, ctime: 0x68140a0e, blocks: 0x821 00010000:00010000:0.0:1746143758.894095:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.894102:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.894103:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.894108:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894109:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894117:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8200, rc 0) 00010000:00010000:3.0:1746143758.894118:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143758.894162:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594036736:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 137us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.894167:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13065 00000100:00100000:0.0:1746143758.894180:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13067 00000100:00100000:0.0:1746143758.894184:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963594037248:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.894190:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.894196:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a709a expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143758.894206:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4755392, mtime: 0x68140a0e, atime: 0x68140a0b, ctime: 0x68140a0e, blocks: 0x1487 00010000:00010000:0.0:1746143758.894212:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894213:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894217:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894236:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894242:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8800, rc 0) 00000100:00100000:0.0:1746143758.894269:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594037248:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 84us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.894273:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13067 00000100:00100000:0.0:1746143758.894284:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13068 00000100:00100000:0.0:1746143758.894288:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594036864:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.894293:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.894300:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7085 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143758.894310:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a0d, atime: 0x68140a0c, ctime: 0x68140a0d, blocks: 0x81d 00010000:00010000:0.0:1746143758.894317:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894318:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894322:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.894325:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095387200, rc 0) 00010000:00010000:0.0:1746143758.894330:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894336:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8a00, rc 0) 00000100:00100000:3.0:1746143758.894343:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594036992:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 283us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.894349:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13066 00000100:00100000:0.0:1746143758.894351:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594036864:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 63us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.894359:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13068 00000100:00100000:0.0:1746143758.894370:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13069 00000100:00100000:0.0:1746143758.894374:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963594037120:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.894379:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.894386:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7093 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143758.894396:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a0e, atime: 0x68140a0e, ctime: 0x68140a0e, blocks: 0x81f 00010000:00010000:0.0:1746143758.894403:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894405:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894409:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894416:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894423:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e9000, rc 0) 00000100:00100000:0.0:1746143758.894437:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594037120:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 62us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.894441:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13069 00000100:00100000:0.0:1746143758.894449:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13070 00000100:00100000:0.0:1746143758.894453:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963594037376:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143758.894459:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.894467:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70a1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143758.894480:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a0e, atime: 0x68140a0d, ctime: 0x68140a0e, blocks: 0x1029 00010000:00010000:0.0:1746143758.894487:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894488:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.894491:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894497:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.894503:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8600, rc 0) 00000100:00100000:0.0:1746143758.894646:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594037376:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 191us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.894651:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13070 00000100:00100000:2.0:1746143758.903677:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.903763:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594037632 00000100:00100000:3.0:1746143758.903771:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594037632 00000100:00100000:3.0:1746143758.903835:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6098 00000100:00100000:3.0:1746143758.903842:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594037632:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143758.903870:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.903882:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.903883:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.903887:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.903903:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.906765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.906798:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.906876:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.907107:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594037888 00000100:00100000:1.0:1746143758.907116:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594037888 00000100:00100000:2.0:1746143758.907966:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594038144 00000100:00100000:1.0:1746143758.907967:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594038400 00000100:00100000:1.0:1746143758.907970:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594038400 00000100:00100000:2.0:1746143758.907971:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594038144 00000100:00100000:1.0:1746143758.908168:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6099 00000100:00100000:1.0:1746143758.908176:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594037888:12345-192.168.202.48@tcp:3:lfs.0 00000100:00100000:2.0:1746143758.908185:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6100 00000100:00100000:2.0:1746143758.908191:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594038400:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143758.908203:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.908207:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.908214:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.908215:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.908216:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.908218:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.908219:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.908221:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.908230:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.908230:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.909564:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6101 00000100:00100000:2.0:1746143758.909571:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594038144:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143758.909591:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.909598:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.909600:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.909602:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.909609:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.912437:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.912468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.912970:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594038528 00000100:00100000:0.0:1746143758.912977:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594038528 00000100:00100000:0.0:1746143758.913012:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9104 00000100:00100000:0.0:1746143758.913019:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31136:x1830963594038528:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143758.913039:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.913055:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8000/0xe984082ccd72eea9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70a8 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.913097:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594038784 00000100:00100000:3.0:1746143758.913102:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594038784 00010000:00010000:0.0:1746143758.913104:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8000/0xe984082ccd72eea9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a8 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.913119:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8000/0xe984082ccd72eea9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a8 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.913133:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6102 00010000:00010000:0.0:1746143758.913134:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.913136:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143758.913152:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594038784:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143758.913156:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8000, rc 0) 00010000:00010000:3.0:1746143758.913171:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.913181:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.913183:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.913186:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.913189:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31136:x1830963594038528:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 170us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.913194:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9104 00010000:00010000:3.0:1746143758.913196:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.918095:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.918130:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.918171:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594039040 00000100:00100000:2.0:1746143758.918179:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594039040 00000100:00100000:0.0:1746143758.918180:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.918228:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594039296 00000100:00100000:2.0:1746143758.918230:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594039296 00000100:00100000:2.0:1746143758.918257:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594039552 00000100:00100000:2.0:1746143758.918259:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594039552 00000100:00100000:2.0:1746143758.918277:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6103 00000100:00100000:2.0:1746143758.918284:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594039040:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143758.918316:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.918329:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.918331:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.918335:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.918347:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.919542:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6104 00000100:00100000:1.0:1746143758.919553:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594039296:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143758.919578:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.919588:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.919590:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.919594:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.919604:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.920090:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6105 00000100:00100000:0.0:1746143758.920099:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594039552:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143758.920118:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.920126:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.920127:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.920136:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.920171:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.923262:0:26145:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.923276:0:26145:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.923289:0:26145:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.923295:0:26145:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bc600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143758.923298:0:26145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.923305:0:26145:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.923320:0:26145:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.923326:0:26145:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ee9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.923386:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594038400:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 15192us (16506us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.923395:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6100 00010000:00010000:3.0:1746143758.930095:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.930109:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.930116:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.930127:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094768e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143758.930131:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.930165:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.930182:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.930188:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ee8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.930256:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594037632:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 26399us (26572us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143758.930264:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6098 00010000:00010000:0.0:1746143758.933218:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.933232:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.933239:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.933255:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bcc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143758.933259:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.933266:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.933281:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.933287:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02bcc00/0xe984082ccd72eea2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.933364:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594038144:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 23788us (26559us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.933371:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6101 00010000:00010000:0.0:1746143758.937556:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.937573:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.937585:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.937591:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094768400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143758.937594:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.937601:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.937616:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.937622:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094768400/0xe984082ccd72eeb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.937696:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594038784:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 24554us (25223us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.937704:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6102 00000100:00100000:3.0:1746143758.937909:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.938373:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594039808 00000100:00100000:0.0:1746143758.938380:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594039808 00000100:00100000:0.0:1746143758.938945:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9105 00000100:00100000:0.0:1746143758.938953:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31136:x1830963594039808:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143758.938968:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.938970:0:21713:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143758.938988:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8000/0xe984082ccd72eea9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a8 expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.939001:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.939004:0:21713:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143758.939013:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8e00/0xe984082ccd72eecc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70af expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.939054:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143758.939064:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.939071:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.939076:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143758.939099:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.939108:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 7 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.939119:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594305408:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143758.939237:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.939254:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 7 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:0.0:1746143758.939428:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594305536:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143758.939460:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143758.943310:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594305408:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.943322:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594305536:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143758.943347:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143758.943665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.943872:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594040064 00000100:00100000:1.0:1746143758.943878:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594040064 00000100:00100000:1.0:1746143758.943913:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9106 00000100:00100000:1.0:1746143758.943921:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:31140:x1830963594040064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.943937:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.943950:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72eeda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70b6 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.944041:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944051:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944059:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944069:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944074:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944079:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944196:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944204:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.944209:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143758.944217:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:3.0:1746143758.944238:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.944306:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594040320 00000100:00100000:2.0:1746143758.944309:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594040320 00000100:00100000:3.0:1746143758.944310:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143758.944325:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 8 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.944341:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594040192 00000100:00100000:2.0:1746143758.944343:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594040192 00010000:00010000:2.0:1746143758.944351:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.944385:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6973 00000100:00100000:2.0:1746143758.944392:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594040320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143758.944398:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.944402:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.944415:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.944423:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6974 00010000:00010000:2.0:1746143758.944429:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009518bc00/0xe984082ccd72ee2b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7069 expref: 9 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.944431:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594040192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143758.944439:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143758.944444:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 8 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.944449:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.944454:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143758.944462:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143758.944467:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143758.944486:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 8 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.944507:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652be00/0xe984082ccd72ee55 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7077 expref: 8 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:2.0:1746143758.944507:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594040320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.944513:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6973 00010000:00010000:3.0:1746143758.944523:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.944526:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143758.944532:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143758.944537:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143758.944693:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143758.944711:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1963:x1830963594040192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 282us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.944720:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6974 00010000:00010000:2.0:1746143758.944772:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143758.944779:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000040:00080000:2.0:1746143758.945317:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2632, 88 off222152 00000004:00080000:2.0:1746143758.945322:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955182037ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945374:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2654, 88 off224264 00000004:00080000:2.0:1746143758.945377:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955237236ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143758.945393:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2655, 88 off224352 00000004:00080000:2.0:1746143758.945396:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955255913ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143758.945403:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2633, 88 off222240 00000004:00080000:2.0:1746143758.945405:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955265284ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945411:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2634, 88 off222328 00000004:00080000:2.0:1746143758.945413:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955273391ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945419:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2656, 88 off224440 00000004:00080000:2.0:1746143758.945421:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955281584ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143758.945427:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2657, 88 off224528 00000004:00080000:2.0:1746143758.945429:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955289801ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143758.945435:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2658, 88 off224616 00000004:00080000:2.0:1746143758.945437:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955297629ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143758.945444:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2635, 88 off222416 00000004:00080000:2.0:1746143758.945446:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955306379ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945451:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2659, 88 off224704 00000004:00080000:2.0:1746143758.945454:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955314113ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143758.945459:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2636, 88 off222504 00000004:00080000:2.0:1746143758.945463:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955323279ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945468:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2660, 88 off224792 00000004:00080000:2.0:1746143758.945470:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955330097ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143758.945475:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2637, 88 off222592 00000004:00080000:2.0:1746143758.945476:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955336829ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945482:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2638, 88 off222680 00000004:00080000:2.0:1746143758.945484:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955344544ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945490:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2639, 88 off222768 00000004:00080000:2.0:1746143758.945493:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955353054ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945498:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2640, 88 off222856 00000004:00080000:2.0:1746143758.945502:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 837955362274ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143758.945508:0:21713:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2661, 88 off224880 00000004:00080000:2.0:1746143758.945510:0:21713:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 837955370197ns, next at 833304778357ns, rc = 0 00010000:00010000:2.0:1746143758.947310:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.947322:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.947330:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.947335:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091025400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143758.947338:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.947347:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.947614:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947624:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947629:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947633:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095711e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.947636:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947640:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947650:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143758.947652:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143758.947655:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947659:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095711e00/0xe984082ccd72eeef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947681:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947686:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947690:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947694:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bdc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.947696:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947704:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947710:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143758.947712:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.947714:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947718:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72eee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947725:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947729:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947734:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947738:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bc600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143758.947740:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947744:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947749:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74200) 00010000:00010000:1.0:1746143758.947751:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143758.947753:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947757:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72eee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.947801:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72eeda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70b6 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.947808:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72eeda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70b6 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.947815:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02bcc00, rc 0) 00000100:00100000:1.0:1746143758.947854:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31140:x1830963594040064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3933us (4190us total) trans 8589943403 rc 301/301 00000100:00100000:1.0:1746143758.947861:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9106 00010000:00010000:1.0:1746143758.948032:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.948039:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.948045:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.948050:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652a600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143758.948052:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.948058:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.948067:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.948073:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a600/0xe984082ccd72ee94 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.948105:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594037888:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 39930us (41348us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143758.948112:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6099 00010000:00010000:2.0:1746143758.949655:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.949667:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091025400/0xe984082ccd72eeb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.949745:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594039040:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 31458us (31656us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143758.949754:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6103 00000100:00100000:0.0:1746143758.952587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.952608:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594040576 00000100:00100000:0.0:1746143758.952614:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594040576 00000100:00100000:0.0:1746143758.952645:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9107 00000100:00100000:0.0:1746143758.952651:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31142:x1830963594040576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.952666:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.952679:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd72eefd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70bd expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.952762:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.952771:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.952780:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.952791:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.952796:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.952801:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143758.953488:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.953498:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.953505:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.953510:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652aa00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143758.953514:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.953520:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.953533:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.953538:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a652aa00/0xe984082ccd72eebe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.954489:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594039296:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 34934us (36354us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143758.954497:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6104 00010000:00010000:0.0:1746143758.955111:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955122:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955130:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:0.0:1746143758.955153:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143758.955281:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955287:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955292:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955296:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba27a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.955299:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955305:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955312:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.955314:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143758.955317:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955322:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27a00/0xe984082ccd72ef12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955343:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955348:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955352:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955356:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a623e400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.955358:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955362:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955367:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143758.955369:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143758.955370:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955374:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623e400/0xe984082ccd72ef04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955381:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955386:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955390:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955394:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba27000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.955396:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955401:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955406:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd600) 00010000:00010000:0.0:1746143758.955408:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143758.955410:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955414:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27000/0xe984082ccd72ef0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.955448:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd72eefd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70bd expref: 246 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955455:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a623f200/0xe984082ccd72eefd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70bd expref: 246 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955462:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a623f200, rc 0) 00000100:00100000:0.0:1746143758.955492:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31142:x1830963594040576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2841us (2910us total) trans 8589943405 rc 301/301 00000100:00100000:0.0:1746143758.955498:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9107 00010000:00010000:0.0:1746143758.955937:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955945:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955951:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955957:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a71e8c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143758.955960:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955967:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955977:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.955982:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8c00/0xe984082ccd72eec5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.956012:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594039552:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 35915us (37831us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143758.956018:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6105 00000100:00100000:2.0:1746143758.963039:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.963068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.963112:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594040832 00000100:00100000:0.0:1746143758.963119:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594040832 00000100:00100000:0.0:1746143758.963161:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594040704 00000100:00100000:0.0:1746143758.963163:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594040704 00000100:00100000:0.0:1746143758.963186:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9108 00000100:00100000:0.0:1746143758.963192:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31142:x1830963594040832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.963208:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.963221:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27c00/0xe984082ccd72ef20 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70cb expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.963300:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143758.963309:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143758.963313:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143758.963327:0:20509:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143758.963335:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143758.963353:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9109 00000100:00100000:0.0:1746143758.963358:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31140:x1830963594040704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.963367:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.963373:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5549e00/0xe984082ccd72ef2e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70c4 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.963398:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.963403:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143758.963408:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143758.967156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.967212:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594041088 00000100:00100000:3.0:1746143758.967219:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594041088 00000100:00100000:3.0:1746143758.967260:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9110 00000100:00100000:3.0:1746143758.967266:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31132:x1830963594041088:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1746143758.967329:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143758.967340:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.967345:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143758.967353:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 5/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143758.967364:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143758.967369:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143758.967376:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143758.977578:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.977602:0:14764:0:(service.c:3346:ptlrpc_start_thread()) mdt[0] started 6 min 3 max 116 00000100:00100000:2.0:1746143758.977609:0:14764:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'mdt00_006' 00000100:00100000:2.0:1746143758.977657:0:14764:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594041344 00000100:00100000:2.0:1746143758.977663:0:14764:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594041344 00000100:00100000:2.0:1746143758.977808:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9111 00000100:00100000:2.0:1746143758.977815:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31144:x1830963594041344:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143758.977830:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.977847:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ef43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70d2 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.977941:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.977954:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.977964:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.977976:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.977982:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.977986:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978072:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978079:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978083:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143758.978090:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143758.978482:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978489:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978493:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978498:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bdc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143758.978501:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978505:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978515:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.978517:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143758.978520:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978525:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bdc00/0xe984082ccd72ef58 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978537:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978541:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978544:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978547:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bcc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143758.978549:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978553:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978557:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143758.978559:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143758.978561:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978564:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bcc00/0xe984082ccd72ef4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978569:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978573:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978576:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978579:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bc600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143758.978581:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978585:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978589:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130c67d00) 00010000:00010000:2.0:1746143758.978591:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143758.978592:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978596:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02bc600/0xe984082ccd72ef51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143758.978794:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ef43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d2 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.978801:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd72ef43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d2 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.978808:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26800, rc 0) 00000100:00100000:2.0:1746143758.979155:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31144:x1830963594041344:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1339us (1581us total) trans 8589943406 rc 301/301 00000100:00100000:2.0:1746143758.979162:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9111 00000001:00080000:0.0:1746143758.981398:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943402 is committed 00000001:00080000:0.0:1746143758.981412:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943403 is committed 00000001:00080000:0.0:1746143758.981416:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943404 is committed 00000004:00080000:0.0:1746143758.981419:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1997 committed 00000004:00080000:0.0:1746143758.981428:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1976 committed 00000004:00080000:0.0:1746143758.981433:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1975 committed 00000004:00080000:0.0:1746143758.981434:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1974 committed 00000004:00080000:0.0:1746143758.981436:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1973 committed 00000004:00080000:0.0:1746143758.981437:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1996 committed 00000004:00080000:0.0:1746143758.981439:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1972 committed 00000004:00080000:0.0:1746143758.981440:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1995 committed 00000004:00080000:0.0:1746143758.981441:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1971 committed 00000004:00080000:0.0:1746143758.981443:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1994 committed 00000004:00080000:0.0:1746143758.981444:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1993 committed 00000004:00080000:0.0:1746143758.981445:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1992 committed 00000004:00080000:0.0:1746143758.981446:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1970 committed 00000004:00080000:0.0:1746143758.981448:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1969 committed 00000004:00080000:0.0:1746143758.981449:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1991 committed 00000004:00080000:0.0:1746143758.981450:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1990 committed 00000004:00080000:0.0:1746143758.981451:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1968 committed 00000100:00100000:0.0:1746143758.981548:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594305664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981596:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.981639:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594306176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981655:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.981669:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143758.981674:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594305792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981687:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.981697:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594306304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981709:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.981725:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594306048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981740:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.981755:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594306560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981768:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.981779:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143758.981783:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594305920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981797:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.981812:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594306432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.981825:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143758.981841:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 245 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.981845:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305664 00000100:00100000:0.0:1746143758.981850:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305664 00010000:00010000:2.0:1746143758.981852:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.981855:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143758.981858:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.981868:0:21713:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.981873:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.981877:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143758.981879:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306176 00000100:00100000:0.0:1746143758.981881:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306176 00010000:00010000:2.0:1746143758.981883:0:21713:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143758.981887:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14763 initiator: MDT0 00000100:00100000:0.0:1746143758.981889:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305792 00000100:00100000:0.0:1746143758.981890:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305792 00010000:00010000:2.0:1746143758.981892:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143758.981898:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306304 00000100:00100000:0.0:1746143758.981899:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306304 00000100:00100000:0.0:1746143758.981906:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306048 00000100:00100000:0.0:1746143758.981908:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306048 00000100:00100000:2.0:1746143758.981913:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305920 00000100:00100000:0.0:1746143758.981913:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306560 00000100:00100000:0.0:1746143758.981914:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306560 00000100:00100000:2.0:1746143758.981915:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305920 00000100:00100000:0.0:1746143758.981919:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306432 00000100:00100000:0.0:1746143758.981921:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306432 00000100:00100000:2.0:1746143758.981926:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13071 00000100:00100000:2.0:1746143758.981931:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963594305664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143758.982023:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594306816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.982045:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.982057:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594307328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.982067:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.982075:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746143758.982078:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594306688:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143758.982080:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143758.982082:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143757 -> 1746143757 00002000:00010000:2.0:1746143758.982085:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143756 -> 1746143756 00002000:00010000:2.0:1746143758.982086:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143757 -> 1746143757 00002000:00010000:2.0:1746143758.982088:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746143758.982099:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.982107:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594307200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982114:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594305664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (518us total) trans 17179873038 rc 0/0 00000100:00100000:3.0:1746143758.982119:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.982132:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306816 00000100:00100000:3.0:1746143758.982134:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306816 00000100:00100000:0.0:1746143758.982191:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307328 00000100:00100000:0.0:1746143758.982195:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307328 00000100:00100000:1.0:1746143758.982205:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13072 00000100:00100000:0.0:1746143758.982211:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306688 00000100:00100000:1.0:1746143758.982213:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594306176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.982213:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306688 00000100:00100000:0.0:1746143758.982219:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307200 00000100:00100000:0.0:1746143758.982220:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307200 00000100:00100000:0.0:1746143758.982228:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13073 00000100:00100000:0.0:1746143758.982233:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594305792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143758.982278:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13071 00000100:00100000:2.0:1746143758.982291:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13074 00000100:00100000:2.0:1746143758.982296:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594306304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143758.982311:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13075 00000100:00100000:1.0:1746143758.982315:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963594306176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (659us total) trans 17179873039 rc 0/0 00000100:00100000:3.0:1746143758.982318:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594306048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143758.982318:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143758.982320:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00000100:00100000:1.0:1746143758.982321:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13072 00002000:00010000:0.0:1746143758.982322:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143756 -> 1746143756 00002000:00010000:0.0:1746143758.982324:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.982326:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143758.982332:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13076 00000100:00100000:1.0:1746143758.982337:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594306560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.982345:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3292:x1830963594305792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (658us total) trans 17179873040 rc 0/0 00000100:00100000:0.0:1746143758.982351:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13073 00000100:00100000:0.0:1746143758.982362:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13077 00000100:00100000:2.0:1746143758.982366:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594306304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (656us total) trans 17179873041 rc 0/0 00000100:00100000:0.0:1746143758.982366:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594305920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143758.982370:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13074 00000100:00100000:2.0:1746143758.982378:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13078 00000100:00100000:2.0:1746143758.982381:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594306432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143758.982390:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143758.982392:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143758.982394:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143758.982396:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143758.982398:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143758.982418:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594306048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (676us total) trans 17179873042 rc 0/0 00000100:00100000:3.0:1746143758.982424:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13075 00000100:00100000:0.0:1746143758.982428:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13079 00000100:00100000:0.0:1746143758.982432:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3293:x1830963594307328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.982434:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13080 00000100:00100000:3.0:1746143758.982439:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3293:x1830963594306688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982451:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594306432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (625us total) trans 17179873043 rc 0/0 00000100:00100000:2.0:1746143758.982455:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13078 00000100:00100000:1.0:1746143758.982462:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594306560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (692us total) trans 17179873045 rc 0/0 00000100:00100000:0.0:1746143758.982464:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13081 00000100:00100000:2.0:1746143758.982466:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13082 00000100:00100000:0.0:1746143758.982468:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3293:x1830963594307200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982470:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3293:x1830963594306816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.982475:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13076 00000100:00100000:2.0:1746143758.982502:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594306944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982521:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746143758.982522:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143758.982524:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:3.0:1746143758.982526:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143755 -> 1746143755 00002000:00010000:3.0:1746143758.982527:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:3.0:1746143758.982528:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 1959 -> 1959 00000100:00100000:2.0:1746143758.982535:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594307456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.982541:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3293:x1830963594307200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (421us total) trans 21474840362 rc 0/0 00000100:00100000:0.0:1746143758.982546:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13081 00000100:00100000:3.0:1746143758.982550:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3293:x1830963594306688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (450us total) trans 21474840361 rc 0/0 00000100:00100000:2.0:1746143758.982550:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.982555:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13080 00000100:00100000:0.0:1746143758.982555:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306944 00000100:00100000:0.0:1746143758.982557:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306944 00000100:00100000:2.0:1746143758.982559:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143758.982563:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594307072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143758.982565:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307456 00000100:00100000:3.0:1746143758.982567:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307456 00000100:00100000:0.0:1746143758.982568:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13083 00000100:00100000:0.0:1746143758.982572:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3294:x1830963594306944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982574:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.982578:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307072 00000100:00100000:3.0:1746143758.982580:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307072 00000100:00100000:2.0:1746143758.982582:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594307584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.982586:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13084 00000100:00100000:1.0:1746143758.982591:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3294:x1830963594307456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982593:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143758.982595:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13085 00000100:00100000:3.0:1746143758.982599:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3294:x1830963594307072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982607:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307584 00000100:00100000:2.0:1746143758.982609:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307584 00000100:00100000:2.0:1746143758.982622:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13086 00000100:00100000:2.0:1746143758.982625:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594307584:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143758.982648:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094763b80/2, rc 0, transno 17179873040 00000100:00100000:0.0:1746143758.982652:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594305792:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143758.982656:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e8e00/0xe984082ccd72eecc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 245 pid: 21713 timeout: 0 lvb_type: 3 00000004:00080000:0.0:1746143758.982658:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc12680/2, rc 0, transno 17179873041 00000100:00100000:0.0:1746143758.982661:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594306304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143758.982666:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094762300/2, rc 0, transno 17179873038 00000100:00100000:0.0:1746143758.982668:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594305664:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143758.982669:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 244 pid: 21713 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746143758.982673:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094762680/2, rc 0, transno 17179873039 00000100:00100000:0.0:1746143758.982675:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594306176:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143758.982690:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e9a00, rc 0) 00002000:00010000:0.0:1746143758.982699:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:0.0:1746143758.982701:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.982703:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143755 -> 1746143755 00002000:00010000:0.0:1746143758.982704:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.982705:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5255 00000100:00100000:3.0:1746143758.982716:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3293:x1830963594307328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 283us (647us total) trans 21474840366 rc 0/0 00000100:00100000:2.0:1746143758.982720:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31136:x1830963594039808:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 43769us (44812us total) trans 8589943404 rc 0/0 00000100:00100000:3.0:1746143758.982721:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13079 00000100:00100000:0.0:1746143758.982724:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3294:x1830963594306944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (203us total) trans 21474840363 rc 0/0 00000100:00100000:2.0:1746143758.982726:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9105 00000100:00100000:0.0:1746143758.982728:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13083 00000004:00080000:3.0:1746143758.982741:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c277480/2, rc 0, transno 21474840361 00010000:00010000:2.0:1746143758.982743:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000004:00080000:0.0:1746143758.982745:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274000/2, rc 0, transno 21474840363 00000100:00100000:3.0:1746143758.982748:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594306688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143758.982748:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594306944:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143758.982749:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000004:00080000:3.0:1746143758.982758:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1edc00/2, rc 0, transno 21474840362 00000100:00100000:3.0:1746143758.982761:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594307200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143758.982766:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3294:x1830963594307584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (171us total) trans 21474840367 rc 0/0 00000004:00080000:3.0:1746143758.982767:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1efb80/2, rc 0, transno 21474840366 00000100:00100000:3.0:1746143758.982769:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594307328:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143758.982770:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746143758.982771:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13086 00002000:00010000:0.0:1746143758.982772:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.982773:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143757 -> 1746143757 00000004:00200000:2.0:1746143758.982775:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00002000:00010000:0.0:1746143758.982775:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143758.982777:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000004:00200000:2.0:1746143758.982779:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00080000:3.0:1746143758.982782:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc13100/2, rc 0, transno 17179873043 00000100:00100000:3.0:1746143758.982785:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594306432:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143758.982792:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094760700/2, rc 0, transno 17179873042 00000004:00010000:2.0:1746143758.982792:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000100:00100000:3.0:1746143758.982795:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594306048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143758.982795:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594305920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 429us (997us total) trans 17179873044 rc 0/0 00000100:00100000:0.0:1746143758.982799:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13077 00000004:00080000:3.0:1746143758.982801:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc12300/2, rc 0, transno 17179873045 00000100:00100000:3.0:1746143758.982803:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594306560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143758.982806:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3294:x1830963594307456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (256us total) trans 21474840364 rc 0/0 00000004:00080000:3.0:1746143758.982810:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094762d80/2, rc 0, transno 17179873044 00000100:00100000:1.0:1746143758.982810:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13084 00000100:00100000:3.0:1746143758.982812:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594305920:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143758.982813:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5549e00/0xe984082ccd72ef2e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70c4 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746143758.982817:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ef100/2, rc 0, transno 21474840367 00000100:00100000:0.0:1746143758.982820:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594307584:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143758.982826:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70c4 expref: 8 pid: 14763 timeout: 937 lvb_type: 0 00000004:00080000:0.0:1746143758.982826:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1edf80/2, rc 0, transno 21474840364 00000100:00100000:0.0:1746143758.982828:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594307456:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143758.982833:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70c4 expref: 8 pid: 14763 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.982836:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143758.982841:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594307712:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143758.982842:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5548400, rc 0) 00000100:00100000:1.0:1746143758.982844:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594307072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (269us total) trans 21474840365 rc 0/0 00000100:00100000:1.0:1746143758.982851:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13085 00000100:00100000:2.0:1746143758.982858:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31140:x1830963594040704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 19500us (19789us total) trans 0 rc 0/0 00000004:00080000:0.0:1746143758.982858:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a3480/2, rc 0, transno 21474840365 00000100:00100000:3.0:1746143758.982860:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143758.982861:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594307072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.982863:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9109 00000100:00100000:1.0:1746143758.982873:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307712 00000100:00100000:1.0:1746143758.982876:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307712 00010000:00010000:2.0:1746143758.982877:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.982882:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143758.982889:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13087 00000100:00100000:1.0:1746143758.982893:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3293:x1830963594307712:12345-0@lo:2:osp-syn-0-0.0 00000004:00200000:2.0:1746143758.982896:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:2.0:1746143758.982897:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143758.982903:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143758.982919:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27c00/0xe984082ccd72ef20 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70cb expref: 244 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.982927:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70cb expref: 243 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.982933:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70cb expref: 243 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.982937:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26c00, rc 0) 00000100:00100000:2.0:1746143758.982955:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31142:x1830963594040832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 19764us (19923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.982958:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9108 00000100:00100000:1.0:1746143758.982966:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963594307712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (105us total) trans 21474840368 rc 0/0 00000100:00100000:1.0:1746143758.982971:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13087 00000004:00080000:3.0:1746143758.982977:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca6ce00/2, rc 0, transno 21474840368 00000100:00100000:3.0:1746143758.982981:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594307712:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143758.983099:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143758.983101:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143758.983103:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143758.983104:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143758.983106:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143758.983127:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963594306816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 656us (1081us total) trans 21474840369 rc 0/0 00000100:00100000:2.0:1746143758.983132:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13082 00000004:00080000:3.0:1746143758.983135:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c276300/2, rc 0, transno 21474840369 00000100:00100000:3.0:1746143758.983166:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594306816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143758.988204:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.988226:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594041472 00000100:00100000:2.0:1746143758.988229:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.988233:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594041472 00000100:00100000:2.0:1746143758.988269:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.988275:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9112 00000100:00100000:2.0:1746143758.988282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143758.988285:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31140:x1830963594041472:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143758.988304:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143758.988305:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143758.988316:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143758.988319:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70d9 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143758.988323:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594041728 00000100:00100000:2.0:1746143758.988325:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.988328:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594041728 00000100:00100000:2.0:1746143758.988335:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143758.988346:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.988350:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594041856 00000100:00100000:1.0:1746143758.988352:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594041856 00000100:00100000:1.0:1746143758.988364:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594042112 00000100:00100000:1.0:1746143758.988365:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594042112 00010000:00010000:3.0:1746143758.988369:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.988369:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143758.988375:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594042368 00000100:00100000:1.0:1746143758.988377:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594042368 00010000:00010000:3.0:1746143758.988380:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143758.988383:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594041600 00000100:00100000:2.0:1746143758.988385:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594041600 00000100:00100000:1.0:1746143758.988386:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594041984 00000100:00100000:1.0:1746143758.988387:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594041984 00010000:00010000:3.0:1746143758.988395:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00000100:00100000:1.0:1746143758.988396:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594042240 00010000:00010000:3.0:1746143758.988397:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143758.988397:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594042240 00010000:00010000:2.0:1746143758.988399:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70c4 expref: 10 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.988400:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1c800, rc 0) 00000100:00100000:1.0:1746143758.988406:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594042496 00000100:00100000:1.0:1746143758.988408:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594042496 00000100:00100000:2.0:1746143758.988412:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594042624 00000100:00100000:2.0:1746143758.988414:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594042624 00000100:00100000:1.0:1746143758.988417:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13088 00010000:00010000:2.0:1746143758.988422:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70cb expref: 243 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:1.0:1746143758.988423:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31136:x1830963594041728:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143758.988431:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143758.988434:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6975 00000100:00100000:3.0:1746143758.988439:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31140:x1830963594041472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 154us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.988439:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594041600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143758.988440:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70e0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.988444:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9112 00010000:00010000:2.0:1746143758.988445:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.988449:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70c4 expref: 10 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:2.0:1746143758.988457:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70c4 expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:1.0:1746143758.988459:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 7 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143758.988462:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13089 00000100:00100000:3.0:1746143758.988466:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594041856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.988467:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.988468:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.988469:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5548400/0xe984082ccd72ef35 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70c4 expref: 9 pid: 14763 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.988471:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.988471:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3899392->4190207] (req 3899392->4190207) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.988477:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70e7 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.988479:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143758.988482:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143758.988487:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.988487:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143758.988489:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.988494:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.988494:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 7 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.988504:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143758.988504:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594041600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (274us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143758.988505:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 7 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:2.0:1746143758.988509:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6975 00010000:00010000:3.0:1746143758.988511:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1c400, rc 0) 00000100:00100000:1.0:1746143758.988516:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594307840:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143758.988519:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6976 00000100:00100000:3.0:1746143758.988523:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594041856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.988523:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1965:x1830963594042624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143758.988527:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13089 00010000:00010000:2.0:1746143758.988528:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143758.988531:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70cb expref: 243 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.988535:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13090 00010000:00010000:2.0:1746143758.988538:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70cb expref: 243 pid: 20509 timeout: 937 lvb_type: 0 00000100:00100000:3.0:1746143758.988539:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594042112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.988545:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143758.988551:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd72ef27 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70cb expref: 243 pid: 20509 timeout: 937 lvb_type: 0 00010000:00010000:3.0:1746143758.988552:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70f5 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.988558:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.988560:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.988560:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143758.988562:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143758.988564:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00010000:00010000:3.0:1746143758.988565:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.988566:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143758.988570:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143758.988573:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.988578:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1ca00, rc 0) 00000100:00100000:1.0:1746143758.988582:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13091 00010000:00010000:2.0:1746143758.988583:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143758.988588:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594042368:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143758.988591:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594042112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143758.988592:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1965:x1830963594042624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143758.988594:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143758.988595:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13090 00000100:00100000:2.0:1746143758.988596:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6976 00010000:00010000:1.0:1746143758.988599:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd72ef82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7103 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.988603:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13092 00000100:00100000:3.0:1746143758.988607:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594041984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143758.988608:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143758.988612:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13093 00010000:00010000:1.0:1746143758.988613:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd72ef82 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7103 expref: 22 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.988614:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143758.988616:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594042240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143758.988619:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70ee expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143758.988620:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.988621:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009518b600/0xe984082ccd72ef82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7103 expref: 22 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.988625:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a70fc expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.988626:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.988627:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.988630:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.988632:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.988632:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b600, rc 0) 00010000:00010000:2.0:1746143758.988633:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143758.988637:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143758.988649:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143758.988650:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594042368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 62us (332us total) trans 0 rc 301/301 00010000:00010000:2.0:1746143758.988655:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26600, rc 0) 00000100:00100000:1.0:1746143758.988655:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13091 00000100:00100000:1.0:1746143758.988670:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13094 00000100:00100000:2.0:1746143758.988673:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594042240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.988676:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594042496:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143758.988677:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13093 00010000:00010000:1.0:1746143758.988681:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143758.988687:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a710a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.988698:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.988699:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143758.988703:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 22 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.988711:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 22 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143758.988718:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009518b000, rc 0) 00000100:00100000:1.0:1746143758.988729:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594042496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.988734:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13094 00010000:00010000:3.0:1746143758.989322:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 21 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.989330:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1d600, rc 0) 00000100:00100000:3.0:1746143758.989362:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594041984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 753us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.989367:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13092 00010000:00010000:3.0:1746143758.989385:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143758.989390:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00010000:3.0:1746143758.989519:0:16090:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136918700 reply state ffff8800a64f2000 transno 8589943407 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143758.989526:0:16090:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143758.989571:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594041088:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 22305us (22432us total) trans 8589943407 rc 0/0 00000100:00100000:3.0:1746143758.989577:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9110 00000100:00100000:0.0:1746143758.994988:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.995028:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.995056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.995086:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.995100:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.995113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.995170:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143758.995220:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143758.995263:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143758.995272:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143758.995278:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143758.995284:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6171600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143758.995288:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143758.995293:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143758.995310:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143758.995312:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143758.995316:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143758.995324:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6171600/0xe984082ccd72ef3c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143758.995362:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594043520 00000100:00100000:0.0:1746143758.995369:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594043520 00010000:00010000:0.0:1746143758.995400:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 8 pid: 4582 timeout: 937 lvb_type: 1 00000100:00100000:0.0:1746143758.995430:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6977 00000100:00100000:0.0:1746143758.995442:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594043520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143758.995457:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143758.995485:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 8 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.995496:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 8 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:0.0:1746143758.995516:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995518:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995523:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.995532:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.995561:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143758.995578:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594307968:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143758.995647:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143758.995662:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594042880 00000100:00100000:0.0:1746143758.995665:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594042880 00000100:00100000:0.0:1746143758.995682:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594043136 00000100:00100000:0.0:1746143758.995684:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594043136 00000100:00100000:0.0:1746143758.995693:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594043392 00000100:00100000:0.0:1746143758.995694:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594043392 00000100:00100000:0.0:1746143758.995703:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594042752 00000100:00100000:0.0:1746143758.995704:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594042752 00000100:00100000:0.0:1746143758.995714:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594043008 00000100:00100000:0.0:1746143758.995716:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594043008 00000100:00100000:0.0:1746143758.995722:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594043264 00000100:00100000:0.0:1746143758.995724:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594043264 00000100:00100000:0.0:1746143758.995732:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13095 00000100:00100000:0.0:1746143758.995736:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594042880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.995748:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.995758:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7118 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.995770:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995771:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995776:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.995785:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.995796:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2400, rc 0) 00000100:00100000:0.0:1746143758.995815:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594042880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 78us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.995819:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13095 00000100:00100000:0.0:1746143758.995832:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13096 00000100:00100000:0.0:1746143758.995836:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594043136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.995845:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.995852:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7126 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.995861:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995862:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995866:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.995873:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.995879:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805000, rc 0) 00000100:00100000:0.0:1746143758.995894:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594043136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.995898:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13096 00000100:00100000:0.0:1746143758.995907:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13097 00000100:00100000:0.0:1746143758.995911:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594043392:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.995918:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.995924:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7134 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.995932:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995934:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995937:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.995944:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143758.995950:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805200, rc 0) 00000100:00100000:0.0:1746143758.995964:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594043392:12345-192.168.202.48@tcp:101:cat.0 Request processed in 52us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.995968:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13097 00000100:00100000:0.0:1746143758.995976:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13098 00000100:00100000:0.0:1746143758.995980:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594042752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.995985:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.995990:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7111 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.995994:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13099 00010000:00010000:0.0:1746143758.995998:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143758.995999:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143758.996001:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594043008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.996002:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.996007:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.996009:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143758.996012:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a711f expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143758.996015:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805800, rc 0) 00010000:00010000:3.0:1746143758.996021:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.996022:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143758.996026:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143758.996027:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594042752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 47us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143758.996031:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13098 00010000:00010000:3.0:1746143758.996034:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143758.996039:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13100 00010000:00010000:3.0:1746143758.996041:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1c000, rc 0) 00000100:00100000:0.0:1746143758.996042:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594043264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143758.996047:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143758.996051:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba27c00/0xe984082ccd72efc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a712d expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143758.996053:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594043008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.996058:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13099 00000100:00100000:3.0:1746143758.996072:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594043648 00000100:00100000:0.0:1746143758.996072:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594308096:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143758.996075:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594043648 00000100:00100000:0.0:1746143758.996089:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143758.996093:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9113 00000100:00100000:3.0:1746143758.996097:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31132:x1830963594043648:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143758.996107:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143758.996114:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1da00/0xe984082ccd72efc8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a713b expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.996170:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1da00/0xe984082ccd72efc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a713b expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143758.996179:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1da00/0xe984082ccd72efc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a713b expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.996186:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8800/0xe984082ccd72ee71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a709a expref: 8 pid: 4582 timeout: 937 lvb_type: 1 00010000:00010000:3.0:1746143758.996192:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143758.996194:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143758.996196:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1da00, rc 0) 00000100:00100000:1.0:1746143758.996201:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594307840:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143758.996218:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143758.996225:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094768e00, rc 0) 00000100:00100000:1.0:1746143758.996237:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31136:x1830963594041728:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7815us (7968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143758.996242:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13088 00000100:00100000:3.0:1746143758.996808:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594043648:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 709us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143758.996813:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9113 00000100:00100000:1.0:1746143759.001405:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594307968:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143759.001425:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1746143759.001459:0:9527:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143755 -> 1746143758 00000100:00100000:1.0:1746143759.001462:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594043520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6024us (6290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.001470:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6977 00000100:00100000:0.0:1746143759.001477:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594308096:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143759.001498:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27c00/0xe984082ccd72efc1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a712d expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.001508:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27c00/0xe984082ccd72efc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a712d expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.001517:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba27c00, rc 0) 00000100:00100000:0.0:1746143759.001535:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594043264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5492us (6421us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143759.001541:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13100 00000100:00100000:0.0:1746143759.004616:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.004654:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.004687:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594043904 00000100:00100000:2.0:1746143759.004695:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594043904 00000100:00100000:1.0:1746143759.004724:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594044160 00000100:00100000:1.0:1746143759.004729:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594044160 00000100:00100000:0.0:1746143759.004736:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143759.004739:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3899392->3903487) req@ffff8800a0a94e00 x1830963594043904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.004748:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94e00 with x1830963594043904 ext(3899392->3903487) 00002000:00010000:2.0:1746143759.004753:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a94e00 00000100:00100000:1.0:1746143759.004756:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594044032 00000100:00100000:1.0:1746143759.004758:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594044032 00000100:00100000:1.0:1746143759.004773:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13101 00000100:00100000:1.0:1746143759.004779:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594044160:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:2.0:1746143759.004783:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6106 00000100:00100000:2.0:1746143759.004789:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594043904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.004918:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594043904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 128us (308us total) trans 0 rc 4096/4096 00002000:00010000:1.0:1746143759.004921:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746143759.004923:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6106 00002000:00010000:1.0:1746143759.004924:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143757 -> 1746143758 00002000:00010000:1.0:1746143759.004926:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143756 -> 1746143758 00002000:00100000:2.0:1746143759.004928:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3899392->3903487) req@ffff8800a0a94e00 x1830963594043904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746143759.004928:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143757 -> 1746143758 00002000:00010000:1.0:1746143759.004930:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00100000:2.0:1746143759.004935:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94e00 with x1830963594043904 ext(3899392->3903487) 00002000:00010000:2.0:1746143759.004938:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a94e00 00000100:00100000:1.0:1746143759.004951:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594044160:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 173us (296us total) trans 17179873046 rc 0/0 00000100:00100000:1.0:1746143759.004957:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13101 00000100:00100000:2.0:1746143759.004961:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13102 00000100:00100000:2.0:1746143759.004967:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963594044032:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143759.005045:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143759.005048:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143759.005050:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143755 -> 1746143758 00002000:00010000:2.0:1746143759.005052:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143759.005053:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 1959 -> 1959 00000100:00100000:2.0:1746143759.005069:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594044032:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 102us (334us total) trans 21474840370 rc 0/0 00000100:00100000:2.0:1746143759.005074:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13102 00000100:00100000:0.0:1746143759.006526:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.006549:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.006567:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594044416 00000100:00100000:0.0:1746143759.006571:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.006572:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594044416 00000100:00100000:0.0:1746143759.006594:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.006618:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594044672 00000100:00100000:2.0:1746143759.006621:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594044672 00000100:00100000:1.0:1746143759.006627:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594044288 00000100:00100000:3.0:1746143759.006629:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594044544 00000100:00100000:3.0:1746143759.006631:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594044544 00000100:00100000:1.0:1746143759.006631:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594044288 00000100:00100000:2.0:1746143759.006637:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13103 00000100:00100000:2.0:1746143759.006642:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594044416:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:3.0:1746143759.006647:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13104 00000100:00100000:3.0:1746143759.006652:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594044672:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:0.0:1746143759.006652:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13105 00000100:00100000:1.0:1746143759.006658:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13106 00000100:00100000:0.0:1746143759.006659:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594044544:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:1.0:1746143759.006664:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594044288:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143759.006722:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143759.006725:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143759.006727:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143759.006728:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143759.006730:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:0.0:1746143759.006734:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:0.0:1746143759.006737:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143759.006739:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143759.006741:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143759.006743:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5255 00000100:00100000:0.0:1746143759.006765:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594044544:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 106us (170us total) trans 21474840372 rc 0/0 00000100:00100000:2.0:1746143759.006766:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594044416:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 122us (241us total) trans 21474840371 rc 0/0 00000100:00100000:0.0:1746143759.006770:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13105 00000100:00100000:2.0:1746143759.006773:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13103 00002000:00010000:3.0:1746143759.006895:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143759.006897:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:3.0:1746143759.006899:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143757 -> 1746143758 00002000:00010000:3.0:1746143759.006900:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:3.0:1746143759.006902:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:0.0:1746143759.006910:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143759.006912:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143759.006914:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143756 -> 1746143758 00002000:00010000:0.0:1746143759.006916:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143759.006918:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143759.006934:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963594044672:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 281us (384us total) trans 17179873047 rc 0/0 00000100:00100000:0.0:1746143759.006934:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594044288:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 270us (362us total) trans 17179873048 rc 0/0 00000100:00100000:0.0:1746143759.006939:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13106 00000100:00100000:3.0:1746143759.006947:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13104 00000100:00100000:0.0:1746143759.011459:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.011657:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594044928 00000100:00100000:3.0:1746143759.011666:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594044928 00000100:00100000:3.0:1746143759.011704:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3885 00000100:00100000:3.0:1746143759.011711:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31132:x1830963594044928:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143759.011909:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31132:x1830963594044928:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 197us (457us total) trans 8589943408 rc 0/0 00000100:00100000:3.0:1746143759.011915:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3885 00000100:00100000:0.0:1746143759.013127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.013458:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594045312 00000100:00100000:2.0:1746143759.013463:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594045312 00000100:00100000:2.0:1746143759.013493:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3886 00000100:00100000:2.0:1746143759.013502:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31132:x1830963594045312:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143759.013619:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31132:x1830963594045312:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 116us (493us total) trans 8589943409 rc 0/0 00000100:00100000:2.0:1746143759.013624:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3886 00000100:00100000:0.0:1746143759.017303:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.017332:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.017350:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.017361:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.017368:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594045568 00000100:00100000:2.0:1746143759.017376:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594045568 00000100:00100000:0.0:1746143759.017383:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.017397:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594045952 00000100:00100000:0.0:1746143759.017400:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594045952 00002000:00100000:2.0:1746143759.017409:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (4186112->4190207) req@ffff8800a0a97480 x1830963594045568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.017415:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a0a95f80 x1830963594045952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.017418:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97480 with x1830963594045568 ext(4186112->4190207) 00002000:00010000:2.0:1746143759.017421:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a97480 00002000:00100000:0.0:1746143759.017422:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95f80 with x1830963594045952 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.017425:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95f80 00000100:00100000:2.0:1746143759.017442:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594045824 00000100:00100000:2.0:1746143759.017444:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594045824 00002000:00100000:2.0:1746143759.017459:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0a94a80 x1830963594045824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143759.017465:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594045696 00002000:00100000:2.0:1746143759.017466:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94a80 with x1830963594045824 ext(1048576->2097151) 00000100:00100000:0.0:1746143759.017467:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594045696 00002000:00010000:2.0:1746143759.017469:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a94a80 00002000:00100000:0.0:1746143759.017476:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a0a94380 x1830963594045696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143759.017482:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594046208 00002000:00100000:0.0:1746143759.017482:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94380 with x1830963594045696 ext(0->1048575) 00000100:00100000:2.0:1746143759.017484:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594046208 00002000:00010000:0.0:1746143759.017485:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a94380 00002000:00100000:2.0:1746143759.017495:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0a95180 x1830963594046208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143759.017495:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6107 00000100:00100000:0.0:1746143759.017500:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594045568:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:2.0:1746143759.017502:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95180 with x1830963594046208 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.017505:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a95180 00000100:00100000:2.0:1746143759.017514:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6108 00000100:00100000:2.0:1746143759.017519:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594045952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.017620:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594045568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 120us (323us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143759.017626:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6107 00002000:00100000:0.0:1746143759.017630:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4186112->4190207) req@ffff8800a0a97480 x1830963594045568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.017642:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97480 with x1830963594045568 ext(4186112->4190207) 00002000:00010000:0.0:1746143759.017644:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a97480 00000100:00100000:0.0:1746143759.017656:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6109 00000100:00100000:0.0:1746143759.017660:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594045824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143759.017705:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6110 00000100:00100000:1.0:1746143759.017711:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594045696:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.017725:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6111 00000100:00100000:3.0:1746143759.017733:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594046208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.028536:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.028649:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.028679:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.028707:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.028726:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.028741:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594046592 00000100:00100000:1.0:1746143759.028748:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594046592 00002000:00100000:1.0:1746143759.028782:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a5d81180 x1830963594046592/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.028791:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830963594046592 ext(0->1048575) 00002000:00010000:1.0:1746143759.028795:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81180 00000100:00100000:3.0:1746143759.028799:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594047104 00000100:00100000:3.0:1746143759.028802:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594047104 00000100:00100000:1.0:1746143759.028809:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594047360 00000100:00100000:1.0:1746143759.028811:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594047360 00002000:00100000:3.0:1746143759.028818:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a5d82680 x1830963594047104/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.028818:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a5d81880 x1830963594047360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.028824:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82680 with x1830963594047104 ext(1048576->2097151) 00002000:00100000:1.0:1746143759.028824:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830963594047360 ext(1048576->2097151) 00002000:00010000:3.0:1746143759.028827:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82680 00002000:00010000:1.0:1746143759.028827:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81880 00000100:00100000:1.0:1746143759.029091:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594047616 00000100:00100000:1.0:1746143759.029094:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594047616 00002000:00100000:1.0:1746143759.029105:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a5d80700 x1830963594047616/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.029114:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830963594047616 ext(1048576->2097151) 00002000:00010000:1.0:1746143759.029117:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80700 00000100:00100000:3.0:1746143759.029176:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6112 00000100:00100000:3.0:1746143759.029183:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594046592:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.029304:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6113 00000100:00100000:0.0:1746143759.029312:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594047360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143759.029313:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6114 00000100:00100000:1.0:1746143759.029318:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594047104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.030396:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6115 00000100:00100000:0.0:1746143759.030402:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594047616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.031078:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594046848 00000100:00100000:3.0:1746143759.031082:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594046848 00000100:00100000:2.0:1746143759.032341:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3887 00000100:00100000:2.0:1746143759.032349:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31136:x1830963594046848:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143759.032493:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31136:x1830963594046848:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 145us (3844us total) trans 8589943410 rc 0/0 00000100:00100000:2.0:1746143759.032500:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3887 00000100:00100000:3.0:1746143759.035320:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594046208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17582us (17929us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.035328:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6111 00002000:00100000:3.0:1746143759.035337:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0a95180 x1830963594046208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.035351:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95180 with x1830963594046208 ext(1048576->2097151) 00002000:00010000:3.0:1746143759.035356:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a95180 00000100:00100000:1.0:1746143759.040756:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594045696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23035us (23383us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.040766:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6110 00002000:00100000:1.0:1746143759.040777:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a0a94380 x1830963594045696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.040786:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94380 with x1830963594045696 ext(0->1048575) 00002000:00010000:1.0:1746143759.040792:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a94380 00000100:00100000:2.0:1746143759.042960:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594045824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25291us (25600us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.042970:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6109 00002000:00100000:2.0:1746143759.042978:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0a94a80 x1830963594045824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.042986:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a94a80 with x1830963594045824 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.042990:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a94a80 00000100:00100000:1.0:1746143759.051367:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594047360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22047us (22650us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.051378:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6113 00002000:00100000:1.0:1746143759.051388:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a5d81880 x1830963594047360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.051397:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81880 with x1830963594047360 ext(1048576->2097151) 00002000:00010000:1.0:1746143759.051402:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81880 00000100:00100000:2.0:1746143759.051410:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594045952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33889us (34075us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.051417:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6108 00002000:00100000:2.0:1746143759.051423:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a0a95f80 x1830963594045952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.051430:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95f80 with x1830963594045952 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.051434:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95f80 00000100:00100000:1.0:1746143759.056806:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594047104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27478us (28116us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.056816:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6114 00002000:00100000:1.0:1746143759.056826:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a5d82680 x1830963594047104/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.056835:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82680 with x1830963594047104 ext(1048576->2097151) 00002000:00010000:1.0:1746143759.056841:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82680 00000100:00100000:3.0:1746143759.065266:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594046592:12345-192.168.202.48@tcp:3:cat.0 Request processed in 36075us (36728us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.065279:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6112 00002000:00100000:3.0:1746143759.065289:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a5d81180 x1830963594046592/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.065298:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830963594046592 ext(0->1048575) 00002000:00010000:3.0:1746143759.065302:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81180 00000100:00100000:0.0:1746143759.069824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.069867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.070418:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.070446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.071222:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594047872 00000100:00100000:3.0:1746143759.071232:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594047872 00002000:00100000:3.0:1746143759.071276:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a0a95c00 x1830963594047872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.071285:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95c00 with x1830963594047872 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.071291:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95c00 00000100:00100000:3.0:1746143759.071307:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594048128 00000100:00100000:3.0:1746143759.071309:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594048128 00002000:00100000:3.0:1746143759.071321:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a0084a80 x1830963594048128/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 504/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.071328:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084a80 with x1830963594048128 ext(3145728->4194303) 00002000:00010000:3.0:1746143759.071330:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0084a80 00000100:00100000:3.0:1746143759.071339:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594048512 00000100:00100000:3.0:1746143759.071341:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594048512 00002000:00100000:3.0:1746143759.071351:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a0086a00 x1830963594048512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.071358:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086a00 with x1830963594048512 ext(3145728->4194303) 00002000:00010000:3.0:1746143759.071360:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086a00 00000100:00100000:3.0:1746143759.071367:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594048384 00000100:00100000:3.0:1746143759.071370:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594048384 00002000:00100000:3.0:1746143759.071379:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a0084e00 x1830963594048384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.071385:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084e00 with x1830963594048384 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.071386:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084e00 00000100:00100000:3.0:1746143759.071397:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6116 00000100:00100000:3.0:1746143759.071403:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594047872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.072619:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6117 00000100:00100000:3.0:1746143759.072626:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594048128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.073354:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594047616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 42951us (44626us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143759.073361:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6115 00002000:00100000:0.0:1746143759.073366:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a5d80700 x1830963594047616/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.073374:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80700 with x1830963594047616 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.073377:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80700 00000100:00100000:0.0:1746143759.073392:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6118 00000100:00100000:0.0:1746143759.073398:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594048512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143759.074929:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6119 00000100:00100000:1.0:1746143759.074939:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594048384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.090537:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594047872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19124us (20710us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.090547:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6116 00002000:00100000:3.0:1746143759.090558:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a0a95c00 x1830963594047872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.090567:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95c00 with x1830963594047872 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.090572:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95c00 00000100:00100000:1.0:1746143759.094306:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594048512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20901us (23881us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.094315:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6118 00002000:00100000:1.0:1746143759.094323:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a0086a00 x1830963594048512/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.094332:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086a00 with x1830963594048512 ext(3145728->4194303) 00002000:00010000:1.0:1746143759.094337:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086a00 00000100:00100000:0.0:1746143759.096062:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.096128:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594048768 00000100:00100000:3.0:1746143759.096135:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594048768 00000100:00100000:3.0:1746143759.097433:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13107 00000100:00100000:3.0:1746143759.097443:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31140:x1830963594048768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.097457:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.097471:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7142 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.097494:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.097501:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.097502:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.097505:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 12 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.097531:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.097542:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 21 pid: 25369 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.097551:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594308224:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.097992:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.103032:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594048384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28088us (32577us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.103042:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6119 00002000:00100000:1.0:1746143759.103052:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a0084e00 x1830963594048384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.103061:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084e00 with x1830963594048384 ext(2097152->3145727) 00002000:00010000:1.0:1746143759.103066:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0084e00 00000100:00100000:3.0:1746143759.105213:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594048128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 32580us (35338us total) trans 0 rc 757760/757760 00000100:00100000:3.0:1746143759.105225:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6117 00002000:00100000:3.0:1746143759.105235:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a0084a80 x1830963594048128/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 504/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.105251:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084a80 with x1830963594048128 ext(3145728->4194303) 00010000:00010000:3.0:1746143759.105260:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143759.105274:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143759.105286:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0084a80 00000100:00100000:0.0:1746143759.105458:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.106020:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594048896 00000100:00100000:2.0:1746143759.106027:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594048896 00002000:00100000:2.0:1746143759.106053:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3899392->4190207) req@ffff8800a0085180 x1830963594048896/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.106059:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085180 with x1830963594048896 ext(3899392->4190207) 00010000:00010000:2.0:1746143759.106063:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.106071:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 20 pid: 25369 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.106077:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0085180 00000100:00100000:2.0:1746143759.106093:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1735 00000100:00100000:2.0:1746143759.106098:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594048896:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143759.106481:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594308224:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.106499:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 12 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.106510:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094769c00, rc 0) 00000100:00100000:3.0:1746143759.106528:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31140:x1830963594048768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9088us (10471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.106534:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13107 00000100:00100000:0.0:1746143759.112100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.112435:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594049024 00000100:00100000:3.0:1746143759.112443:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594049024 00000100:00100000:3.0:1746143759.112494:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13108 00000100:00100000:3.0:1746143759.112502:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31142:x1830963594049024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.112517:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.112536:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7149 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.112559:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.112561:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.112565:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.112575:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.112588:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1ce00, rc 0) 00000100:00100000:3.0:1746143759.112632:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31142:x1830963594049024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 131us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.112637:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13108 00000100:00100000:2.0:1746143759.114745:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594048896:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8642us (9283us total) trans 21474840373 rc 0/0 00000100:00100000:2.0:1746143759.114754:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1735 00002000:00100000:2.0:1746143759.114762:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3899392->4190207) req@ffff8800a0085180 x1830963594048896/t21474840373(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.114770:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0085180 with x1830963594048896 ext(3899392->4190207) 00010000:00010000:2.0:1746143759.114777:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 23 pid: 25369 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.114790:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 23 pid: 25369 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.114796:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0085180 00000100:00100000:0.0:1746143759.119946:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.120037:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594049152 00000100:00100000:3.0:1746143759.120044:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594049152 00000100:00100000:3.0:1746143759.120093:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13109 00000100:00100000:3.0:1746143759.120100:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31144:x1830963594049152:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143759.120116:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.120129:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7150 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.120274:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.120282:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.120289:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.120294:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.120295:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.120298:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3108864->3145727] (req 3108864->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 12 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.120328:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.120337:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 20 pid: 6929 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.120347:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594308352:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.121443:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.121453:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 12 pid: 9527 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.121461:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594308480:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.121492:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.121500:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.121507:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594308608:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.121525:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.123181:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.123205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.123222:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594049408 00000100:00100000:0.0:1746143759.123222:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594049280 00000100:00100000:0.0:1746143759.123226:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594049280 00000100:00100000:1.0:1746143759.123227:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594049408 00010000:00010000:1.0:1746143759.123263:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143759.123264:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 23 pid: 25369 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143759.123296:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6978 00000100:00100000:0.0:1746143759.123303:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594049280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143759.123310:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594308352:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143759.123312:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143759.123321:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594308480:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.123327:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594308608:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143759.123331:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 23 pid: 25369 timeout: 938 lvb_type: 0 00010000:00010000:0.0:1746143759.123340:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 23 pid: 25369 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.123349:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6979 00010000:00010000:3.0:1746143759.123355:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3108864->3145727] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.123356:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594049408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143759.123358:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094768e00/0xe984082ccd72ef6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3899392->4190207) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e0 expref: 23 pid: 25369 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.123363:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143759.123366:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c1d200, rc 0) 00010000:00010000:1.0:1746143759.123376:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143759.123378:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.123380:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.123384:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143759.123386:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143759.123394:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31144:x1830963594049152:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3295us (3456us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143759.123396:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805200/0xe984082ccd72efac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7134 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143759.123397:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143759.123400:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13109 00010000:00010000:0.0:1746143759.123404:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.123405:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.123408:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143759.123408:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.123414:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.123424:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594049408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.123428:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6979 00010000:00010000:0.0:1746143759.123435:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.123444:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594308736:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143759.123480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143759.123483:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.123489:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594308864:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143759.123494:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594049536 00000100:00100000:1.0:1746143759.123497:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594049536 00000100:00100000:0.0:1746143759.123503:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00010000:00010000:1.0:1746143759.123506:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 11 pid: 4582 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143759.123519:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6980 00000100:00100000:1.0:1746143759.123523:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594049536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.123528:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.123535:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 11 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.123542:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 11 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.123553:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8600/0xe984082ccd72ee86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70a1 expref: 11 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.123561:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.123576:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594049536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.123581:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6980 00000100:00100000:2.0:1746143759.129438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.129451:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594308736:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143759.129460:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594308864:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.129469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143759.129476:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.129483:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594049664 00000100:00100000:1.0:1746143759.129489:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594049664 00000100:00100000:3.0:1746143759.129513:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594049920 00010000:00010000:1.0:1746143759.129517:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 21 pid: 6929 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.129519:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594049920 00000100:00100000:0.0:1746143759.129521:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594049280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6218us (6314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.129529:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6978 00000100:00100000:0.0:1746143759.129546:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6981 00000100:00100000:2.0:1746143759.129547:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.129552:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594049664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143759.129557:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594050176 00000100:00100000:1.0:1746143759.129559:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594050176 00010000:00010000:0.0:1746143759.129561:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143759.129579:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 21 pid: 6929 timeout: 938 lvb_type: 1 00002000:00100000:1.0:1746143759.129580:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a5d82d80 x1830963594050176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.129586:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a5d82a00 x1830963594049920/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.129588:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963594050176 ext(3145728->4194303) 00010000:00010000:0.0:1746143759.129590:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 21 pid: 6929 timeout: 938 lvb_type: 1 00002000:00010000:1.0:1746143759.129591:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82d80 00002000:00100000:3.0:1746143759.129594:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963594049920 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.129597:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:1.0:1746143759.129602:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6120 00000100:00100000:1.0:1746143759.129607:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594050176:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.129615:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6121 00000100:00100000:3.0:1746143759.129621:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594049920:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:0.0:1746143759.129740:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009518b000/0xe984082ccd72ef97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a710a expref: 21 pid: 6929 timeout: 938 lvb_type: 1 00010000:00010000:0.0:1746143759.129759:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.129761:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.129766:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 10 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.129773:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 10 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.129794:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 10 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143759.129803:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594308992:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143759.129846:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.132685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.132773:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594050432 00000100:00100000:2.0:1746143759.132779:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594050432 00002000:00100000:2.0:1746143759.132810:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3108864->3112959) req@ffff8800930d3480 x1830963594050432/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.132819:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3480 with x1830963594050432 ext(3108864->3112959) 00002000:00010000:2.0:1746143759.132823:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d3480 00000100:00100000:1.0:1746143759.133289:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594308992:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143759.133306:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.133342:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594049664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3790us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.133350:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6981 00000100:00100000:2.0:1746143759.134261:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6122 00000100:00100000:2.0:1746143759.134270:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594050432:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143759.134496:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594050432:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 226us (1817us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143759.134502:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6122 00002000:00100000:2.0:1746143759.134507:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3108864->3112959) req@ffff8800930d3480 x1830963594050432/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.134515:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3480 with x1830963594050432 ext(3108864->3112959) 00002000:00010000:2.0:1746143759.134518:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d3480 00000100:00100000:3.0:1746143759.139858:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594049920:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10229us (10380us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.139868:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6121 00002000:00100000:3.0:1746143759.139878:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a5d82a00 x1830963594049920/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.139893:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963594049920 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.139898:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:2.0:1746143759.143013:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594050176:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13399us (13459us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.143020:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6120 00002000:00100000:2.0:1746143759.143027:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a5d82d80 x1830963594050176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.143033:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963594050176 ext(3145728->4194303) 00002000:00010000:2.0:1746143759.143037:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d82d80 00000100:00100000:0.0:1746143759.145807:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.145842:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.145868:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594050688 00000100:00100000:2.0:1746143759.145874:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594050688 00002000:00100000:2.0:1746143759.145911:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3108863) req@ffff8800930d2a00 x1830963594050688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143759.145919:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594050944 00002000:00100000:2.0:1746143759.145919:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2a00 with x1830963594050688 ext(2097152->3108863) 00000100:00100000:3.0:1746143759.145923:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594050944 00002000:00010000:2.0:1746143759.145923:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d2a00 00002000:00100000:3.0:1746143759.145938:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800930d0700 x1830963594050944/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143759.145940:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6123 00002000:00100000:3.0:1746143759.145944:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0700 with x1830963594050944 ext(3145728->4194303) 00000100:00100000:2.0:1746143759.145945:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594050688:12345-192.168.202.48@tcp:3:multiop.0 00002000:00010000:3.0:1746143759.145947:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0700 00000100:00100000:3.0:1746143759.145961:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6124 00000100:00100000:3.0:1746143759.145965:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594050944:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143759.148636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.150159:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594051200 00000100:00100000:1.0:1746143759.150169:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594051200 00002000:00100000:1.0:1746143759.150210:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a5d82300 x1830963594051200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.150220:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830963594051200 ext(3145728->4194303) 00002000:00010000:1.0:1746143759.150225:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:1.0:1746143759.150262:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6125 00000100:00100000:1.0:1746143759.150268:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594051200:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143759.151797:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.151837:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.152295:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594051328 00000100:00100000:1.0:1746143759.152301:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594051328 00000100:00100000:1.0:1746143759.152327:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594051456 00000100:00100000:1.0:1746143759.152329:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594051456 00000100:00100000:1.0:1746143759.152357:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13110 00000100:00100000:1.0:1746143759.152363:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31144:x1830963594051328:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143759.152374:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.152388:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7157 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143759.152395:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13111 00000100:00100000:3.0:1746143759.152402:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31142:x1830963594051456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.152409:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.152409:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.152417:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a715e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.152417:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.152424:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.152426:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.152429:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.152429:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3969023] (req 3145728->3969023) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.152435:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.152436:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.152438:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.152452:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.152453:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.152463:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.152475:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594309120:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.152540:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42180 going to sleep for 11 seconds 00010000:00010000:1.0:1746143759.152708:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 21 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.152718:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309248:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143759.152747:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.152754:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 15 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.152762:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309376:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143759.152777:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143759.156754:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594309120:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.156784:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.156799:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652a000, rc 0) 00000100:00100000:3.0:1746143759.156832:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31142:x1830963594051456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4431us (4994us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.156840:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13111 00000100:00100000:1.0:1746143759.157594:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309248:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143759.157604:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309376:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143759.157621:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3969023] (req 3145728->3969023) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.157635:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5804c00, rc 0) 00000100:00100000:1.0:1746143759.157651:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31144:x1830963594051328:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5288us (5858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.157656:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13110 00000100:00100000:2.0:1746143759.158130:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594050688:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12184us (12327us total) trans 0 rc 1011712/1011712 00000100:00100000:2.0:1746143759.158157:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6123 00002000:00100000:2.0:1746143759.158166:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3108863) req@ffff8800930d2a00 x1830963594050688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1011712/1011712 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.158174:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2a00 with x1830963594050688 ext(2097152->3108863) 00010000:00010000:2.0:1746143759.158181:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.158192:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.158197:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930d2a00 00000100:00100000:0.0:1746143759.160635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.160672:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.160815:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594051712 00000100:00100000:1.0:1746143759.160821:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594051712 00010000:00010000:1.0:1746143759.160848:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 22 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.160873:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6982 00000100:00100000:1.0:1746143759.160879:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594051712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.160889:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.160904:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 22 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.160913:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 22 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.160932:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c1ce00/0xe984082ccd72efd6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7149 expref: 22 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.160949:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.160979:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594051712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.160985:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6982 00000100:00100000:1.0:1746143759.161293:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1962:x1830963594051200:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11024us (12664us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.161299:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6125 00000100:00100000:3.0:1746143759.161304:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594050944:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15336us (15459us total) trans 0 rc 1048576/1048576 00002000:00100000:1.0:1746143759.161307:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a5d82300 x1830963594051200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143759.161311:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6124 00002000:00100000:1.0:1746143759.161315:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830963594051200 ext(3145728->4194303) 00002000:00100000:3.0:1746143759.161317:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800930d0700 x1830963594050944/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143759.161321:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 11 pid: 4581 timeout: 938 lvb_type: 0 00002000:00100000:3.0:1746143759.161325:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0700 with x1830963594050944 ext(3145728->4194303) 00010000:00010000:1.0:1746143759.161330:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 11 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143759.161331:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143759.161335:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82300 00010000:00010000:3.0:1746143759.161340:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143759.161347:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0700 00000100:00100000:1.0:1746143759.161348:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594051584 00000100:00100000:1.0:1746143759.161350:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594051584 00002000:00100000:1.0:1746143759.161368:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3108864->3145727) req@ffff8800930d0a80 x1830963594051584/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.161375:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0a80 with x1830963594051584 ext(3108864->3145727) 00010000:00010000:1.0:1746143759.161930:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 11 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.161938:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 11 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143759.161944:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930d0a80 00000100:00100000:1.0:1746143759.162451:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1736 00000100:00100000:1.0:1746143759.162458:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594051584:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143759.164364:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594051584:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 1901us (3685us total) trans 17179873049 rc 0/0 00000100:00100000:1.0:1746143759.164372:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1736 00002000:00100000:1.0:1746143759.164380:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3108864->3145727) req@ffff8800930d0a80 x1830963594051584/t17179873049(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.164388:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0a80 with x1830963594051584 ext(3108864->3145727) 00010000:00010000:1.0:1746143759.164396:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.164405:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143759.164412:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930d0a80 00000100:00100000:0.0:1746143759.166493:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.167810:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594051840 00000100:00100000:2.0:1746143759.167820:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594051840 00010000:00010000:2.0:1746143759.167852:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.167925:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6983 00000100:00100000:2.0:1746143759.167933:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594051840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.167946:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.167965:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.167976:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.167995:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094769c00/0xe984082ccd72efcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7142 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.168584:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.168587:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.168594:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.168602:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.168630:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.168641:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594309504:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.168727:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.170209:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.170269:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594051968 00000100:00100000:1.0:1746143759.170275:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594051968 00000100:00100000:1.0:1746143759.170319:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13112 00000100:00100000:1.0:1746143759.170325:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31140:x1830963594051968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.170337:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.170349:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7165 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.170369:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.170375:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.170376:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.170379:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.170398:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.170407:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 14 pid: 9527 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.170414:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309632:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143759.170461:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.170622:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594309504:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.170634:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.170654:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594051840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2721us (4168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.170662:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6983 00000100:00100000:1.0:1746143759.171833:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309632:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143759.171852:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 13 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.171863:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2211800, rc 0) 00000100:00100000:1.0:1746143759.171994:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31140:x1830963594051968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1568us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.172002:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13112 00000100:00100000:0.0:1746143759.176879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.176981:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594052096 00000100:00100000:2.0:1746143759.176990:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594052096 00010000:00010000:2.0:1746143759.177022:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.177060:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6984 00000100:00100000:2.0:1746143759.177067:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594052096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.177080:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.177099:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.177109:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.177127:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d200/0xe984082ccd72efdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7150 expref: 13 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.177608:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.177610:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.177617:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.177630:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.177657:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.177667:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594309760:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.177740:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.180095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.180185:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594309760:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.180199:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.180228:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594052096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3161us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.180237:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6984 00000100:00100000:1.0:1746143759.180257:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594052352 00000100:00100000:1.0:1746143759.180263:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594052352 00002000:00100000:1.0:1746143759.180292:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3964928->3969023) req@ffff8800930d1880 x1830963594052352/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.180301:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1880 with x1830963594052352 ext(3964928->3969023) 00010000:00010000:1.0:1746143759.180308:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 13 pid: 9527 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.180321:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 13 pid: 9527 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143759.180327:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d1880 00000100:00100000:1.0:1746143759.180354:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1737 00000100:00100000:1.0:1746143759.180361:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594052352:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143759.180560:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594052352:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 199us (469us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143759.180565:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1737 00002000:00100000:1.0:1746143759.180570:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3964928->3969023) req@ffff8800930d1880 x1830963594052352/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.180577:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1880 with x1830963594052352 ext(3964928->3969023) 00010000:00010000:1.0:1746143759.180582:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 13 pid: 9527 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.180590:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 13 pid: 9527 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143759.180595:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d1880 00000100:00100000:0.0:1746143759.185695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.185730:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.185763:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.185818:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594052992 00000100:00100000:3.0:1746143759.185826:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594052992 00002000:00100000:3.0:1746143759.185865:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800930d0e00 x1830963594052992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.185875:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0e00 with x1830963594052992 ext(3145728->4194303) 00002000:00010000:3.0:1746143759.185879:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0e00 00000100:00100000:3.0:1746143759.185894:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594053120 00000100:00100000:3.0:1746143759.185897:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594053120 00002000:00100000:3.0:1746143759.185910:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3969023) req@ffff88012b7cc700 x1830963594053120/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.185916:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc700 with x1830963594053120 ext(3145728->3969023) 00010000:00010000:3.0:1746143759.185922:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 13 pid: 9527 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143759.185934:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 13 pid: 9527 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143759.185940:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cc700 00000100:00100000:3.0:1746143759.185952:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1738 00000100:00100000:3.0:1746143759.185958:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594053120:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143759.186647:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6126 00000100:00100000:3.0:1746143759.186654:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594052992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.187087:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594052864 00000100:00100000:2.0:1746143759.187091:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594052864 00000100:00100000:2.0:1746143759.187113:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3888 00000100:00100000:2.0:1746143759.187117:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31144:x1830963594052864:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143759.187279:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31144:x1830963594052864:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 160us (1589us total) trans 8589943411 rc 0/0 00000100:00100000:2.0:1746143759.187285:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3888 00000100:00100000:3.0:1746143759.196282:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594052992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9621us (10542us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.196294:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6126 00002000:00100000:3.0:1746143759.196304:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800930d0e00 x1830963594052992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.196314:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0e00 with x1830963594052992 ext(3145728->4194303) 00002000:00010000:3.0:1746143759.196320:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0e00 00000100:00100000:0.0:1746143759.201232:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.201296:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594053248 00000100:00100000:1.0:1746143759.201304:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594053248 00000100:00100000:1.0:1746143759.201356:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13113 00000100:00100000:1.0:1746143759.201363:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594053248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.201379:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.201393:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf13600/0xe984082ccd72eff9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a716c expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.201434:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309888:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143759.201500:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.203698:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594053120:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 17735us (17929us total) trans 21474840374 rc 0/0 00000100:00100000:2.0:1746143759.203708:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1738 00002000:00100000:2.0:1746143759.203717:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3969023) req@ffff88012b7cc700 x1830963594053120/t21474840374(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.203726:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc700 with x1830963594053120 ext(3145728->3969023) 00010000:00010000:2.0:1746143759.203733:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.203745:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.203750:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cc700 00000100:00100000:1.0:1746143759.203767:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594309888:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143759.203788:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf13600/0xe984082ccd72eff9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a716c expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.203798:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13600/0xe984082ccd72eff9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a716c expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.203823:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13600, rc 0) 00000100:00100000:1.0:1746143759.203841:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594053248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2479us (2616us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143759.203845:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13113 00000100:00100000:0.0:1746143759.206556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.206620:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594053376 00000100:00100000:1.0:1746143759.206627:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594053376 00000100:00100000:1.0:1746143759.206669:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13114 00000100:00100000:1.0:1746143759.206674:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31142:x1830963594053376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.206687:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.206701:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7173 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.206720:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.206722:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.206726:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4755455] (req 4194304->4755455) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.206734:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4755455] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 22 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.206742:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13200, rc 0) 00000100:00100000:1.0:1746143759.206779:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31142:x1830963594053376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.206784:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13114 00000100:00100000:0.0:1746143759.209332:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.209420:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594053504 00000100:00100000:2.0:1746143759.209427:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594053504 00010000:00010000:2.0:1746143759.209456:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.209691:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6985 00000100:00100000:2.0:1746143759.209697:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594053504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.209708:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.209726:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.209736:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.209754:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5804c00/0xe984082ccd72efe4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7157 expref: 15 pid: 9527 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.209860:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.209862:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.209868:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.209876:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.209883:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.209884:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.209887:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.209893:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.209919:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 21 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.209930:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594310016:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.211335:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.211345:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594310144:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.211371:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.214135:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594310016:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.214175:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594310144:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.214194:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.214232:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594053504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4533us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.214254:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6985 00000100:00100000:0.0:1746143759.214798:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.215163:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594053888 00000100:00100000:3.0:1746143759.215170:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594053888 00002000:00100000:3.0:1746143759.215202:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88012b7cc000 x1830963594053888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.215212:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc000 with x1830963594053888 ext(4194304->4755455) 00002000:00010000:3.0:1746143759.215216:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cc000 00000100:00100000:3.0:1746143759.215251:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6127 00000100:00100000:3.0:1746143759.215258:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594053888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.215765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.215812:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594054144 00000100:00100000:2.0:1746143759.215816:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594054144 00002000:00100000:2.0:1746143759.215831:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b7ce300 x1830963594054144/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.215838:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ce300 with x1830963594054144 ext(3145728->4194303) 00002000:00010000:2.0:1746143759.215841:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ce300 00000100:00100000:2.0:1746143759.215863:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6128 00000100:00100000:2.0:1746143759.215872:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594054144:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143759.223868:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594054144:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7990us (8094us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.223877:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6128 00002000:00100000:2.0:1746143759.223887:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b7ce300 x1830963594054144/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.223895:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ce300 with x1830963594054144 ext(3145728->4194303) 00002000:00010000:2.0:1746143759.223901:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ce300 00000100:00100000:3.0:1746143759.224916:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594053888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9656us (10117us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143759.224923:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6127 00002000:00100000:3.0:1746143759.224929:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88012b7cc000 x1830963594053888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.224937:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc000 with x1830963594053888 ext(4194304->4755455) 00002000:00010000:3.0:1746143759.224941:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cc000 00000100:00100000:0.0:1746143759.228126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.228499:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594054272 00000100:00100000:2.0:1746143759.228508:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594054272 00000100:00100000:2.0:1746143759.228835:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13115 00000100:00100000:2.0:1746143759.228843:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31140:x1830963594054272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.228860:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.228873:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a717a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.228892:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.228893:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.229064:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.229080:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.229089:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009513be00, rc 0) 00000100:00100000:2.0:1746143759.229676:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31140:x1830963594054272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 833us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.229683:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13115 00000100:00100000:0.0:1746143759.231507:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.232226:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594054528 00000100:00100000:2.0:1746143759.232233:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594054528 00000100:00100000:2.0:1746143759.232279:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3889 00000100:00100000:2.0:1746143759.232286:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31142:x1830963594054528:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143759.232557:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31142:x1830963594054528:12345-192.168.202.48@tcp:35:cat.0 Request processed in 270us (1051us total) trans 8589943412 rc 0/0 00000100:00100000:2.0:1746143759.232563:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3889 00000100:00100000:0.0:1746143759.232804:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.232863:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594054784 00000100:00100000:3.0:1746143759.232869:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594054784 00002000:00100000:3.0:1746143759.232895:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012b7cce00 x1830963594054784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.232903:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cce00 with x1830963594054784 ext(3145728->4194303) 00002000:00010000:3.0:1746143759.232907:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cce00 00000100:00100000:3.0:1746143759.232932:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6129 00000100:00100000:3.0:1746143759.232937:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594054784:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143759.244997:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594054784:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12050us (12184us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.245007:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6129 00002000:00100000:3.0:1746143759.245018:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012b7cce00 x1830963594054784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.245026:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cce00 with x1830963594054784 ext(3145728->4194303) 00002000:00010000:3.0:1746143759.245031:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7cce00 00000100:00100000:0.0:1746143759.252206:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.252304:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594055040 00000100:00100000:3.0:1746143759.252312:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594055040 00002000:00100000:3.0:1746143759.252351:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88012b7cdc00 x1830963594055040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.252361:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdc00 with x1830963594055040 ext(4194304->4755455) 00002000:00010000:3.0:1746143759.252366:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cdc00 00000100:00100000:3.0:1746143759.252382:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6130 00000100:00100000:3.0:1746143759.252388:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594055040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.258422:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.259408:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594055296 00000100:00100000:3.0:1746143759.259417:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594055296 00000100:00100000:3.0:1746143759.259474:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9114 00000100:00100000:3.0:1746143759.259481:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31150:x1830963594055296:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143759.259501:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.259516:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72f00e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7181 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.259609:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259620:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259628:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259640:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259645:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259649:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259735:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259741:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259747:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143759.259755:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143759.259828:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259834:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259839:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259844:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090670000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143759.259847:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259852:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.259860:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143759.259863:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143759.259994:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.260000:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670000/0xe984082ccd72f015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143759.260055:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594055040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7665us (7853us total) trans 0 rc 561152/561152 00000100:00100000:2.0:1746143759.260068:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6130 00002000:00100000:2.0:1746143759.260077:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88012b7cdc00 x1830963594055040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.260090:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdc00 with x1830963594055040 ext(4194304->4755455) 00002000:00010000:2.0:1746143759.260094:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cdc00 00010000:00010000:3.0:1746143759.260989:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.260996:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.261001:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.261006:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090671600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143759.261008:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.261014:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.261021:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090762d00) 00010000:00010000:3.0:1746143759.261024:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143759.261026:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.261030:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671600/0xe984082ccd72f01c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.261063:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670a00/0xe984082ccd72f00e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 247 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.261072:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 246 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.261077:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.261078:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143759.261080:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090671200, rc 0) 00000100:00100000:3.0:1746143759.261111:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31150:x1830963594055296:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1631us (2697us total) trans 8589943413 rc 0/0 00000100:00100000:3.0:1746143759.261116:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9114 00000100:00100000:0.0:1746143759.271843:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.271949:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594055552 00000100:00100000:2.0:1746143759.271958:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594055552 00000100:00100000:2.0:1746143759.272405:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3890 00000100:00100000:2.0:1746143759.272414:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31140:x1830963594055552:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143759.272618:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31140:x1830963594055552:12345-192.168.202.48@tcp:35:cat.0 Request processed in 205us (782us total) trans 8589943414 rc 0/0 00000100:00100000:2.0:1746143759.272624:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3890 00000100:00100000:0.0:1746143759.275003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.275644:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594055680 00000100:00100000:2.0:1746143759.275651:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594055680 00000100:00100000:2.0:1746143759.275698:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13116 00000100:00100000:2.0:1746143759.275705:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31150:x1830963594055680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143759.275722:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.275758:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7188 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.275787:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.275794:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.275800:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.275807:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.275809:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.275811:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.275836:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.275846:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.275857:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310272:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.276088:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.276097:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 12 pid: 9527 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.276164:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310400:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.276204:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.276212:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 9 pid: 4582 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.276337:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310528:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.276362:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.278970:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310272:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.278982:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310400:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.278989:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310528:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.279015:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.279029:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009513a000, rc 0) 00000100:00100000:2.0:1746143759.279075:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31150:x1830963594055680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3369us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.279082:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13116 00000100:00100000:0.0:1746143759.279570:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.279652:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594055936 00000100:00100000:0.0:1746143759.279657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.279658:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594055936 00000100:00100000:0.0:1746143759.279692:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.279709:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594056064 00000100:00100000:1.0:1746143759.279713:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594056064 00010000:00010000:1.0:1746143759.279734:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.279747:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143759.279778:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594055808 00000100:00100000:1.0:1746143759.279781:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594055808 00000100:00100000:2.0:1746143759.279783:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6986 00000100:00100000:2.0:1746143759.279789:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594056064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.279789:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.279802:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143759.279802:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6987 00000100:00100000:1.0:1746143759.279806:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594055936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.279811:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.279820:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.279820:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.279829:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.279836:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.279875:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6988 00000100:00100000:3.0:1746143759.279887:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594055808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143759.279893:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.279926:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c1d600/0xe984082ccd72ef89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70ee expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.279929:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2400/0xe984082ccd72ef9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7118 expref: 13 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.279941:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143759.279979:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.279991:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.280001:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8a00/0xe984082ccd72ee78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7085 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.280020:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.280022:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143759.280023:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594056064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 234us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.280027:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6986 00010000:00010000:1.0:1746143759.280027:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.280034:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.280058:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.280068:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594310656:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143759.280220:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143759.280251:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594055808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 359us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.280257:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6988 00000100:00100000:1.0:1746143759.280328:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.281177:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594310656:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143759.281189:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.281209:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594055936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1401us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.281214:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6987 00000100:00100000:0.0:1746143759.281661:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.281751:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594056320 00000100:00100000:2.0:1746143759.281756:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594056320 00002000:00100000:2.0:1746143759.281787:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1916928->1921023) req@ffff8800949f2300 x1830963594056320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.281796:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2300 with x1830963594056320 ext(1916928->1921023) 00002000:00010000:2.0:1746143759.281799:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f2300 00000100:00100000:2.0:1746143759.281825:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6131 00000100:00100000:2.0:1746143759.281831:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594056320:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143759.281969:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594056320:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 138us (308us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143759.281974:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6131 00002000:00100000:2.0:1746143759.281979:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1916928->1921023) req@ffff8800949f2300 x1830963594056320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.281991:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2300 with x1830963594056320 ext(1916928->1921023) 00002000:00010000:2.0:1746143759.281994:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f2300 00000100:00100000:0.0:1746143759.285838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.285913:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594056448 00000100:00100000:2.0:1746143759.285921:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594056448 00000100:00100000:2.0:1746143759.285968:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13117 00000100:00100000:2.0:1746143759.285975:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31150:x1830963594056448:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143759.285988:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.286001:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a718f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.286024:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.286031:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.286037:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.286042:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.286044:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.286047:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->1146879] (req 1048576->1146879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.286071:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.286086:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.286096:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310784:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.286343:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.286352:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 11 pid: 8496 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.286360:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310912:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.286383:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 8 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.286390:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 8 pid: 8495 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.286396:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594311040:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.286412:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.288216:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310784:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.288227:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594310912:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.288232:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594311040:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.288270:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->1146879] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.288284:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6dfc00, rc 0) 00000100:00100000:2.0:1746143759.288326:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31150:x1830963594056448:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2351us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.288334:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13117 00000100:00100000:1.0:1746143759.288413:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.288452:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594056704 00000100:00100000:2.0:1746143759.288456:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594056704 00010000:00010000:2.0:1746143759.288474:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 9 pid: 8495 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.288491:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6989 00000100:00100000:2.0:1746143759.288495:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594056704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.288504:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.288520:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 9 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.288528:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 9 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.288545:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095387200/0xe984082ccd72ee6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a708c expref: 9 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.288560:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.288584:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594056704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.288589:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6989 00000100:00100000:1.0:1746143759.290051:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.290128:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594056576 00000100:00100000:2.0:1746143759.290133:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594056576 00010000:00010000:2.0:1746143759.290171:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.290198:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6990 00000100:00100000:2.0:1746143759.290204:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594056576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.290212:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.290226:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.290234:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.290259:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c1ca00/0xe984082ccd72ef7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70f5 expref: 22 pid: 8495 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.290269:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.290307:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594056576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 103us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.290309:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.290313:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6990 00000100:00100000:2.0:1746143759.290324:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594056832 00000100:00100000:2.0:1746143759.290326:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594056832 00010000:00010000:2.0:1746143759.290336:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 12 pid: 8496 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.290398:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6991 00000100:00100000:2.0:1746143759.290404:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594056832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.290411:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.290418:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 12 pid: 8496 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.290426:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 12 pid: 8496 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.290436:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c1c000/0xe984082ccd72efba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a711f expref: 12 pid: 8496 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.290443:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.290445:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.290450:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.290456:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.290483:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.290492:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594311168:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.290544:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.291877:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594311168:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.291891:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.291929:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594056832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1524us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.291937:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6991 00000100:00100000:0.0:1746143759.293451:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.293536:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594057088 00000100:00100000:2.0:1746143759.293542:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594057088 00002000:00100000:2.0:1746143759.293580:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1142784->1146879) req@ffff8800949f3480 x1830963594057088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.293588:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3480 with x1830963594057088 ext(1142784->1146879) 00002000:00010000:2.0:1746143759.293592:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3480 00000100:00100000:2.0:1746143759.293619:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6132 00000100:00100000:2.0:1746143759.293625:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594057088:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143759.293788:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594057088:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 163us (341us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143759.293794:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6132 00002000:00100000:2.0:1746143759.293799:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1142784->1146879) req@ffff8800949f3480 x1830963594057088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.293806:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3480 with x1830963594057088 ext(1142784->1146879) 00002000:00010000:2.0:1746143759.293809:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f3480 00000100:00100000:0.0:1746143759.298427:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.298597:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594057344 00000100:00100000:2.0:1746143759.298605:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594057344 00000100:00100000:2.0:1746143759.298643:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3891 00000100:00100000:2.0:1746143759.298650:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31150:x1830963594057344:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143759.298885:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31150:x1830963594057344:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 235us (464us total) trans 8589943415 rc 0/0 00000100:00100000:2.0:1746143759.298892:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3891 00000100:00100000:0.0:1746143759.315809:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.315935:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594057600 00000100:00100000:3.0:1746143759.315943:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594057600 00000100:00100000:3.0:1746143759.315990:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9115 00000100:00100000:3.0:1746143759.315997:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31154:x1830963594057600:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143759.316017:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.316031:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f03f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7196 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.316205:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316216:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316225:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316236:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316265:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316271:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316360:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316367:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316373:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143759.316380:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143759.316453:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316459:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316463:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316469:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090671400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143759.316472:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316477:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316486:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143759.316488:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143759.316492:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316496:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671400/0xe984082ccd72f046 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316672:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316678:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316681:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316686:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090670800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143759.316688:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316692:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316699:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1f4f00) 00010000:00010000:3.0:1746143759.316701:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143759.316703:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316707:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670800/0xe984082ccd72f04d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.316737:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f03f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.316810:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 12 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.316816:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.316818:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143759.316820:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090670400, rc 0) 00000100:00100000:3.0:1746143759.316999:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31154:x1830963594057600:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1003us (1198us total) trans 8589943416 rc 0/0 00000100:00100000:3.0:1746143759.317004:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9115 00000100:00100000:0.0:1746143759.366407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.366999:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594057856 00000100:00100000:3.0:1746143759.367010:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594057856 00000100:00100000:3.0:1746143759.367084:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9116 00000100:00100000:3.0:1746143759.367095:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31157:x1830963594057856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.367117:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.367133:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72f062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a719d expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.367293:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.367309:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.367319:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143759.367330:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143759.367449:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72f062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 250 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.367486:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 249 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.367495:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.367498:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143759.367501:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090670e00, rc 0) 00000100:00100000:3.0:1746143759.367577:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31157:x1830963594057856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 482us (1175us total) trans 8589943417 rc 0/0 00000100:00100000:3.0:1746143759.367583:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9116 00000100:00100000:0.0:1746143759.384272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.384343:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594058112 00000100:00100000:2.0:1746143759.384351:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594058112 00002000:00100000:2.0:1746143759.384388:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1916927) req@ffff8801305cb480 x1830963594058112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.384397:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb480 with x1830963594058112 ext(1048576->1916927) 00002000:00010000:2.0:1746143759.384402:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cb480 00000100:00100000:2.0:1746143759.384419:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6133 00000100:00100000:2.0:1746143759.384425:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594058112:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.392739:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.393481:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594058112:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9054us (9217us total) trans 0 rc 868352/868352 00000100:00100000:2.0:1746143759.393488:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6133 00002000:00100000:2.0:1746143759.393496:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1916927) req@ffff8801305cb480 x1830963594058112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.393503:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb480 with x1830963594058112 ext(1048576->1916927) 00002000:00010000:2.0:1746143759.393507:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cb480 00000100:00100000:2.0:1746143759.393522:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594058368 00000100:00100000:2.0:1746143759.393526:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594058368 00002000:00100000:2.0:1746143759.393543:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1146880->2097151) req@ffff8801305c8700 x1830963594058368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.393547:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8700 with x1830963594058368 ext(1146880->2097151) 00002000:00010000:2.0:1746143759.393549:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8700 00000100:00100000:2.0:1746143759.393558:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6134 00000100:00100000:2.0:1746143759.393561:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594058368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.403479:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.404566:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594058368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11000us (11832us total) trans 0 rc 950272/950272 00000100:00100000:2.0:1746143759.404575:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6134 00002000:00100000:2.0:1746143759.404586:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1146880->2097151) req@ffff8801305c8700 x1830963594058368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.404594:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8700 with x1830963594058368 ext(1146880->2097151) 00002000:00010000:2.0:1746143759.404600:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8700 00000100:00100000:3.0:1746143759.405058:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594058624 00000100:00100000:3.0:1746143759.405065:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594058624 00000100:00100000:3.0:1746143759.405101:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9117 00000100:00100000:3.0:1746143759.405107:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31160:x1830963594058624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.405124:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.405154:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72f077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71a4 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.405251:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.405261:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.405269:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143759.405277:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143759.405371:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671800/0xe984082ccd72f077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 15 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.405389:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 14 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.405395:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.405397:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143759.405400:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090671e00, rc 0) 00000100:00100000:3.0:1746143759.405430:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31160:x1830963594058624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 324us (1960us total) trans 8589943418 rc 0/0 00000100:00100000:3.0:1746143759.405435:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9117 00000100:00100000:0.0:1746143759.411535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.411630:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594058752 00000100:00100000:2.0:1746143759.411638:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594058752 00000100:00100000:2.0:1746143759.411689:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13118 00000100:00100000:2.0:1746143759.411696:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594058752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.411716:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.411729:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72f08c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71ab expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.411774:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594311296:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143759.413583:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.414026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.414065:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594058880 00000100:00100000:1.0:1746143759.414079:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594058880 00000100:00100000:1.0:1746143759.414119:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13119 00000100:00100000:1.0:1746143759.414124:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594058880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.414134:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.414161:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72f093 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71b2 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.414194:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594311424:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143759.414263:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.418181:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.418372:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594059008 00000100:00100000:2.0:1746143759.418379:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594059008 00000100:00100000:2.0:1746143759.418417:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13120 00000100:00100000:2.0:1746143759.418424:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31154:x1830963594059008:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143759.418439:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.418455:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71b9 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.418483:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.418490:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 15 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.418496:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.418501:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.418502:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.418505:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1810431] (req 1048576->1810431) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.418530:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.418540:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 21 pid: 4581 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.418549:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594311552:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.418624:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 15 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.418631:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 15 pid: 9527 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.418637:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594311680:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.418659:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.418665:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 9 pid: 4582 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.418671:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594311808:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.418683:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746143759.418958:0:4581:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime: 1746143758 -> 1746143759 00002000:00010000:3.0:1746143759.418961:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143758 -> 1746143759 00002000:00010000:3.0:1746143759.418963:0:4581:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime: 1746143758 -> 1746143759 00000100:00100000:3.0:1746143759.418980:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594311296:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143759.419000:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72f08c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ab expref: 14 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.419009:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72f08c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ab expref: 14 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.419021:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7bce00, rc 0) 00000100:00100000:3.0:1746143759.419052:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594058752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7355us (7522us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143759.419059:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13118 00002000:00010000:1.0:1746143759.420553:0:9527:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143758 -> 1746143759 00002000:00010000:1.0:1746143759.420559:0:9527:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143758 -> 1746143759 00002000:00010000:1.0:1746143759.420561:0:9527:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143758 -> 1746143759 00000100:00100000:1.0:1746143759.420574:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594311424:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143759.420594:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72f093 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b2 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.420604:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3e00/0xe984082ccd72f093 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b2 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.420616:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e3e00, rc 0) 00000100:00100000:1.0:1746143759.420654:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594058880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6529us (6629us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143759.420660:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13119 00000100:00100000:2.0:1746143759.425877:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594311552:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.425897:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594311680:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.425909:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594311808:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.425953:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1810431] (req 1048576->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.425977:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7bca00, rc 0) 00000100:00100000:2.0:1746143759.426603:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31154:x1830963594059008:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8178us (8427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.426612:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13120 00000100:00100000:0.0:1746143759.427410:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.427454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.427504:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594059136 00000100:00100000:3.0:1746143759.427511:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594059136 00010000:00010000:3.0:1746143759.427537:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.427567:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594059264 00000100:00100000:3.0:1746143759.427570:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594059264 00010000:00010000:3.0:1746143759.427579:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 22 pid: 4581 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.427593:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6992 00000100:00100000:3.0:1746143759.427598:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594059136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143759.427608:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143759.427625:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.427634:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.427651:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e9000/0xe984082ccd72ee7f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7093 expref: 10 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.427665:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143759.427684:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594059136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.427689:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6992 00000100:00100000:3.0:1746143759.427721:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6993 00000100:00100000:3.0:1746143759.427726:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594059264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143759.427731:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143759.427738:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 22 pid: 4581 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.427746:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 22 pid: 4581 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.427756:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba26600/0xe984082ccd72ef90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70fc expref: 22 pid: 4581 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.427763:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143759.427776:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594059264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.427781:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6993 00000100:00100000:0.0:1746143759.428605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.428643:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594059392 00000100:00100000:1.0:1746143759.428647:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594059392 00010000:00010000:1.0:1746143759.428662:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 15 pid: 9527 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143759.428695:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6994 00000100:00100000:1.0:1746143759.428700:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594059392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.428707:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.428715:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 15 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.428764:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 15 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.428776:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805000/0xe984082ccd72efa5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7126 expref: 15 pid: 9527 timeout: 938 lvb_type: 1 00010000:00010000:1.0:1746143759.428798:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.428800:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.428809:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 14 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.428815:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 14 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.428865:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 14 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.428877:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594311936:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143759.429164:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.431214:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594311936:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143759.431231:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.431269:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594059392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2568us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.431276:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6994 00000100:00100000:0.0:1746143759.432201:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.432340:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594059520 00000100:00100000:2.0:1746143759.432345:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594059520 00000100:00100000:2.0:1746143759.432384:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13121 00000100:00100000:2.0:1746143759.432390:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31160:x1830963594059520:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143759.432395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143759.432404:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.432417:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71c0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.432438:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.432445:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143759.432447:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143759.432450:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.432472:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.432482:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 20 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.432492:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594312064:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.432549:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.433094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.433120:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.433132:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594059776 00000100:00100000:0.0:1746143759.433133:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594060032 00000100:00100000:0.0:1746143759.433135:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594060032 00000100:00100000:1.0:1746143759.433137:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594059776 00002000:00100000:0.0:1746143759.433175:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094c0d180 x1830963594060032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.433179:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1052671) req@ffff880094c0ea00 x1830963594059776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.433186:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963594059776 ext(1048576->1052671) 00002000:00100000:0.0:1746143759.433187:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d180 with x1830963594060032 ext(2097152->3145727) 00002000:00010000:0.0:1746143759.433190:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d180 00002000:00010000:1.0:1746143759.433191:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ea00 00000100:00100000:1.0:1746143759.433209:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594060288 00000100:00100000:1.0:1746143759.433212:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594060288 00002000:00100000:1.0:1746143759.433226:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c0ed80 x1830963594060288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.433233:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ed80 with x1830963594060288 ext(3145728->4194303) 00002000:00010000:1.0:1746143759.433239:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ed80 00000100:00100000:3.0:1746143759.433494:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6135 00000100:00100000:3.0:1746143759.433502:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594059776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143759.433505:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6136 00000100:00100000:1.0:1746143759.433511:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594060032:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.433532:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6137 00000100:00100000:0.0:1746143759.433538:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594060288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.433616:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594059776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 116us (1221us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143759.433621:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6135 00002000:00100000:3.0:1746143759.433625:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1052671) req@ffff880094c0ea00 x1830963594059776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.433631:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963594059776 ext(1048576->1052671) 00002000:00010000:3.0:1746143759.433634:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ea00 00000100:00100000:3.0:1746143759.433684:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.433730:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594060544 00000100:00100000:3.0:1746143759.433733:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594060544 00002000:00100000:3.0:1746143759.433744:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012b79c380 x1830963594060544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.433750:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c380 with x1830963594060544 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.433753:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79c380 00000100:00100000:3.0:1746143759.433766:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6138 00000100:00100000:3.0:1746143759.433770:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594060544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.433863:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594312064:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.433877:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.433885:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bcae200, rc 0) 00000100:00100000:3.0:1746143759.433902:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31160:x1830963594059520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1513us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.433907:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13121 00000100:00100000:0.0:1746143759.435236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.435418:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594060672 00000100:00100000:3.0:1746143759.435422:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594060672 00002000:00100000:3.0:1746143759.435440:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1916928->2097151) req@ffff880094c0fb80 x1830963594060672/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.435447:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0fb80 with x1830963594060672 ext(1916928->2097151) 00010000:00010000:3.0:1746143759.435452:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 23 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143759.435465:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 23 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143759.435470:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0fb80 00000100:00100000:3.0:1746143759.435486:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1739 00000100:00100000:3.0:1746143759.435491:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594060672:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143759.442606:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594060288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9059us (9476us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.442617:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6137 00002000:00100000:1.0:1746143759.442628:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c0ed80 x1830963594060288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.442637:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ed80 with x1830963594060288 ext(3145728->4194303) 00002000:00010000:1.0:1746143759.442641:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ed80 00000100:00100000:2.0:1746143759.443100:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594060672:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7608us (7866us total) trans 17179873050 rc 0/0 00000100:00100000:2.0:1746143759.443108:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1739 00002000:00100000:2.0:1746143759.443113:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1916928->2097151) req@ffff880094c0fb80 x1830963594060672/t17179873050(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.443120:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0fb80 with x1830963594060672 ext(1916928->2097151) 00010000:00010000:2.0:1746143759.443129:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.443159:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.443166:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0fb80 00000100:00100000:3.0:1746143759.446004:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594060544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12225us (12311us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.446015:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6138 00002000:00100000:3.0:1746143759.446025:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012b79c380 x1830963594060544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.446034:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c380 with x1830963594060544 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.446039:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79c380 00000100:00100000:1.0:1746143759.446888:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594060032:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13375us (13792us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.446894:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6136 00002000:00100000:1.0:1746143759.446900:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094c0d180 x1830963594060032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.446907:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d180 with x1830963594060032 ext(2097152->3145727) 00002000:00010000:1.0:1746143759.446911:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d180 00000100:00100000:0.0:1746143759.451630:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.451680:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.451876:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594061056 00000100:00100000:2.0:1746143759.451883:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594061056 00010000:00010000:2.0:1746143759.451914:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 23 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.451950:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6995 00000100:00100000:2.0:1746143759.451956:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594061056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.451967:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.451986:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 23 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.451996:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 23 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.452018:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009513a000/0xe984082ccd72f031 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7188 expref: 23 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.452042:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.452044:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.452051:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 11 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.452063:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 11 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.452093:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 11 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.452103:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594312192:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143759.452132:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594060928 00000100:00100000:1.0:1746143759.452137:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594060928 00000100:00100000:2.0:1746143759.452193:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fea80 going to sleep for 11 seconds 00002000:00100000:1.0:1746143759.452195:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1806336->1810431) req@ffff880094c0c380 x1830963594060928/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.452207:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963594060928 ext(1806336->1810431) 00002000:00010000:1.0:1746143759.452212:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0c380 00000100:00100000:1.0:1746143759.452229:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6139 00000100:00100000:1.0:1746143759.452234:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594060928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143759.452888:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594060928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 651us (1264us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143759.452894:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6139 00002000:00100000:1.0:1746143759.452899:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1806336->1810431) req@ffff880094c0c380 x1830963594060928/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.452906:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963594060928 ext(1806336->1810431) 00002000:00010000:1.0:1746143759.452909:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0c380 00000100:00100000:0.0:1746143759.456432:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.456525:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594312192:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.456543:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.456582:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594061056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4626us (4901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.456592:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6995 00000100:00100000:1.0:1746143759.456669:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594061312 00000100:00100000:1.0:1746143759.456676:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594061312 00002000:00100000:1.0:1746143759.456709:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094c0ca80 x1830963594061312/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.456719:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963594061312 ext(1048576->2097151) 00002000:00010000:1.0:1746143759.456722:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ca80 00000100:00100000:1.0:1746143759.456736:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6140 00000100:00100000:1.0:1746143759.456741:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594061312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.458191:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.458928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.459560:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594061440 00000100:00100000:3.0:1746143759.459566:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594061440 00000100:00100000:3.0:1746143759.459597:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594061568 00000100:00100000:3.0:1746143759.459599:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594061568 00000100:00100000:3.0:1746143759.459614:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13122 00000100:00100000:3.0:1746143759.459620:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594061440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.459633:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.459647:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71c7 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.459665:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.459667:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.459680:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.459694:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.459710:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81ba00, rc 0) 00000100:00100000:3.0:1746143759.459741:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594061440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 120us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.459746:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13122 00000100:00100000:3.0:1746143759.459759:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13123 00000100:00100000:3.0:1746143759.459764:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594061568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.459771:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.459779:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f81b600/0xe984082ccd72f0af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71ce expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143759.459811:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594312320:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143759.459858:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.462606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.464016:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594061824 00000100:00100000:2.0:1746143759.464025:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594061824 00000100:00100000:2.0:1746143759.464059:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3892 00000100:00100000:2.0:1746143759.464065:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31154:x1830963594061824:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143759.464259:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31154:x1830963594061824:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 192us (1662us total) trans 8589943419 rc 0/0 00000100:00100000:2.0:1746143759.464265:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3892 00002000:00010000:3.0:1746143759.464473:0:2839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime: 1746143758 -> 1746143759 00002000:00010000:3.0:1746143759.464477:0:2839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143758 -> 1746143759 00002000:00010000:3.0:1746143759.464479:0:2839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime: 1746143758 -> 1746143759 00000100:00100000:3.0:1746143759.464493:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594312320:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143759.464520:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f81b600/0xe984082ccd72f0af lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ce expref: 22 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.464531:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f81b600/0xe984082ccd72f0af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ce expref: 22 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.464545:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81b600, rc 0) 00000100:00100000:3.0:1746143759.464570:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594061568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4806us (5644us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143759.464576:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13123 00000100:00100000:1.0:1746143759.464959:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594061312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8217us (8538us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.464967:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6140 00002000:00100000:1.0:1746143759.464975:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094c0ca80 x1830963594061312/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.464982:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963594061312 ext(1048576->2097151) 00002000:00010000:1.0:1746143759.464986:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ca80 00000100:00100000:0.0:1746143759.468318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.468420:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594061952 00000100:00100000:3.0:1746143759.468427:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594061952 00000100:00100000:3.0:1746143759.468470:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13124 00000100:00100000:3.0:1746143759.468477:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594061952:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.468491:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.468505:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f81b400/0xe984082ccd72f0b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71d5 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143759.468547:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594312448:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143759.468615:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143759.470500:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594312448:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143759.470527:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f81b400/0xe984082ccd72f0b6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71d5 expref: 22 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.470539:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f81b400/0xe984082ccd72f0b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71d5 expref: 22 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.470559:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81b400, rc 0) 00000100:00100000:3.0:1746143759.470597:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594061952:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2120us (2285us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143759.470605:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13124 00000100:00100000:0.0:1746143759.471709:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.472124:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594062080 00000100:00100000:3.0:1746143759.472130:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594062080 00000100:00100000:3.0:1746143759.472188:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13125 00000100:00100000:3.0:1746143759.472195:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31160:x1830963594062080:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.472208:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.472220:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71dc expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.472250:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.472257:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.472259:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.472262:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.472284:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 22 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.472295:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 22 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.472306:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594312576:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.473193:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143759.475349:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594312576:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.475374:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.475388:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81ac00, rc 0) 00000100:00100000:3.0:1746143759.475425:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31160:x1830963594062080:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3229us (3720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.475432:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13125 00000100:00100000:0.0:1746143759.476179:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.476214:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.476303:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594062336 00000100:00100000:1.0:1746143759.476309:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594062336 00000100:00100000:1.0:1746143759.476341:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594062464 00000100:00100000:1.0:1746143759.476343:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594062464 00000100:00100000:1.0:1746143759.476354:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13126 00000100:00100000:1.0:1746143759.476358:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594062336:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.476370:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.476381:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3c00/0xe984082ccd72f0c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71e3 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.476412:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594312704:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143759.476459:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.476512:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13127 00000100:00100000:2.0:1746143759.476518:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594062464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.476524:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.476533:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63fe800/0xe984082ccd72f0cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71ea expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.476552:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594312832:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143759.476570:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.480421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.480507:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594062208 00000100:00100000:1.0:1746143759.480515:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594062208 00002000:00100000:1.0:1746143759.480549:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1146879) req@ffff88009c3f9f80 x1830963594062208/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.480558:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9f80 with x1830963594062208 ext(1048576->1146879) 00010000:00010000:1.0:1746143759.480567:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.480579:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143759.480586:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3f9f80 00000100:00100000:1.0:1746143759.480614:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1740 00000100:00100000:1.0:1746143759.480621:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594062208:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143759.484210:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594312704:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143759.484270:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3c00/0xe984082ccd72f0c4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71e3 expref: 26 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.484288:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a95e3c00/0xe984082ccd72f0c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71e3 expref: 26 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.484311:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a95e3c00, rc 0) 00000100:00100000:1.0:1746143759.484372:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594062336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8009us (8191us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143759.484387:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13126 00000100:00100000:3.0:1746143759.485214:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594312832:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143759.485231:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a63fe800/0xe984082ccd72f0cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ea expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.485249:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63fe800/0xe984082ccd72f0cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ea expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.485277:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63fe800, rc 0) 00000100:00100000:3.0:1746143759.485299:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594062464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8781us (9084us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143759.485304:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13127 00000100:00100000:1.0:1746143759.487487:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594062208:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6862us (7174us total) trans 17179873051 rc 0/0 00000100:00100000:1.0:1746143759.487497:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1740 00002000:00100000:1.0:1746143759.487508:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1146879) req@ffff88009c3f9f80 x1830963594062208/t17179873051(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.487516:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9f80 with x1830963594062208 ext(1048576->1146879) 00010000:00010000:1.0:1746143759.487525:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.487537:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00002000:00010000:1.0:1746143759.487543:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3f9f80 00000100:00100000:0.0:1746143759.492037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.492621:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594062592 00000100:00100000:2.0:1746143759.492628:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594062592 00010000:00010000:2.0:1746143759.492660:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.492841:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6996 00000100:00100000:2.0:1746143759.492848:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594062592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.492859:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.492877:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.492887:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.492907:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd72f038 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a718f expref: 25 pid: 4581 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.492934:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.492936:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.492942:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.492949:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.492977:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.492987:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594312960:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.493064:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.497538:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594312960:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.497556:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.497641:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594062592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4791us (5609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.497650:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6996 00000100:00100000:0.0:1746143759.499736:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.499777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.499887:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594062976 00000100:00100000:2.0:1746143759.499893:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594062976 00002000:00100000:2.0:1746143759.499925:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1810432->2097151) req@ffff88009c3f9c00 x1830963594062976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.499934:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9c00 with x1830963594062976 ext(1810432->2097151) 00002000:00010000:2.0:1746143759.499938:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9c00 00000100:00100000:2.0:1746143759.499962:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594063104 00000100:00100000:2.0:1746143759.499964:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594063104 00002000:00100000:2.0:1746143759.499974:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009c3fbb80 x1830963594063104/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.499980:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963594063104 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.499983:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:2.0:1746143759.499993:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6141 00000100:00100000:2.0:1746143759.499998:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594062976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.502216:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6142 00000100:00100000:0.0:1746143759.502226:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594063104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.506435:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594062976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6429us (6696us total) trans 0 rc 286720/286720 00000100:00100000:2.0:1746143759.506445:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6141 00002000:00100000:2.0:1746143759.506456:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1810432->2097151) req@ffff88009c3f9c00 x1830963594062976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 286720/286720 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.506465:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9c00 with x1830963594062976 ext(1810432->2097151) 00002000:00010000:2.0:1746143759.506470:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9c00 00000100:00100000:2.0:1746143759.515165:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594063104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12930us (15376us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.515175:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6142 00002000:00100000:2.0:1746143759.515185:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009c3fbb80 x1830963594063104/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.515194:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963594063104 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.515199:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:0.0:1746143759.524665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.525635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.525671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.525747:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594063744 00000100:00100000:3.0:1746143759.525756:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594063744 00002000:00100000:3.0:1746143759.525798:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009cdc1880 x1830963594063744/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.525807:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1880 with x1830963594063744 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.525811:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1880 00000100:00100000:3.0:1746143759.525838:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594063872 00000100:00100000:3.0:1746143759.525841:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594063872 00002000:00100000:3.0:1746143759.525859:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc1f80 x1830963594063872/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.525865:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1f80 with x1830963594063872 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.525868:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1f80 00000100:00100000:3.0:1746143759.525887:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6143 00000100:00100000:3.0:1746143759.525895:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594063744:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.525900:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594063360 00000100:00100000:2.0:1746143759.525906:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594063360 00000100:00100000:2.0:1746143759.525937:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9118 00000100:00100000:2.0:1746143759.525941:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31164:x1830963594063360:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143759.525957:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.525973:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe800/0xe984082ccd72f0d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71f1 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.526087:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.526104:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 250 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.526110:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.526115:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.526170:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.526181:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 14 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.526192:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594313088:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.526283:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 250 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.526290:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 250 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.526298:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594313216:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.526316:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.526333:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6144 00000100:00100000:2.0:1746143759.526339:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594063872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143759.530724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.530760:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594313216:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.530778:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594064000 00000100:00100000:2.0:1746143759.530782:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594064000 00010000:00010000:2.0:1746143759.530808:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 251 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.530841:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6997 00000100:00100000:2.0:1746143759.530847:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963594064000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.530862:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.530866:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 251 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.530875:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 251 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.530893:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671200/0xe984082ccd72f023 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7181 expref: 251 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143759.531818:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.531892:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594064128 00000100:00100000:3.0:1746143759.531897:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594064128 00010000:00010000:3.0:1746143759.531915:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 15 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.532368:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6998 00000100:00100000:3.0:1746143759.532376:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594064128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143759.532385:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143759.532390:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 15 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143759.532400:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 15 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143759.532416:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.532420:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.532428:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.532433:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.532446:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143759.532479:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594064128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.532488:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6998 00010000:00010000:2.0:1746143759.532601:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.532604:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.532624:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1965:x1830963594064000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1776us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.532630:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6997 00010000:00010000:2.0:1746143759.532667:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670400/0xe984082ccd72f054 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7196 expref: 14 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.532678:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594313088:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.532701:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.532708:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.532712:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143759.532728:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143759.532853:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe800/0xe984082ccd72f0d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 251 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.532864:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 250 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.532869:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.532871:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143759.532873:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63ff800, rc 0) 00000100:00100000:2.0:1746143759.532893:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31164:x1830963594063360:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6951us (8236us total) trans 8589943420 rc 0/0 00000100:00100000:2.0:1746143759.532899:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9118 00000100:00100000:2.0:1746143759.537780:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594063872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11432us (12099us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.537789:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6144 00002000:00100000:2.0:1746143759.537798:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc1f80 x1830963594063872/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.538290:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1f80 with x1830963594063872 ext(2097152->3145727) 00002000:00010000:2.0:1746143759.538295:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1f80 00000100:00100000:3.0:1746143759.538869:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594063744:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12974us (13234us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143759.538876:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6143 00002000:00100000:3.0:1746143759.538881:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009cdc1880 x1830963594063744/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.538888:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1880 with x1830963594063744 ext(2097152->3145727) 00002000:00010000:3.0:1746143759.538891:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1880 00000100:00100000:0.0:1746143759.541542:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.541631:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594064256 00000100:00100000:3.0:1746143759.541639:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594064256 00000100:00100000:3.0:1746143759.541688:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13128 00000100:00100000:3.0:1746143759.541694:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31164:x1830963594064256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143759.541710:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.541724:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71f8 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.541749:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.541755:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.541757:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.541760:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [2093056->2097151] (req 2093056->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.541784:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.541801:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 12 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.541811:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594313344:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.541884:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143759.551011:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594313344:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.551039:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [2093056->2097151] (req 2093056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.551054:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6800, rc 0) 00000100:00100000:3.0:1746143759.551097:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31164:x1830963594064256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9401us (9560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.551104:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13128 00000100:00100000:0.0:1746143759.551578:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.551663:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594064384 00000100:00100000:2.0:1746143759.551669:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594064384 00010000:00010000:2.0:1746143759.551693:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 13 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.551797:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6999 00000100:00100000:2.0:1746143759.551803:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594064384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.551813:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.551831:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 13 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.551841:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 13 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.551861:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f81ac00/0xe984082ccd72f0bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71dc expref: 13 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.551952:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.551954:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.551960:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.551966:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.551991:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.552000:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594313472:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.553354:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.559352:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594313472:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.559374:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.559411:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594064384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7608us (7833us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.559420:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6999 00000100:00100000:0.0:1746143759.559964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.560170:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594064640 00000100:00100000:3.0:1746143759.560177:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594064640 00002000:00100000:3.0:1746143759.560207:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (2093056->2097151) req@ffff88009cdc0a80 x1830963594064640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.560216:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0a80 with x1830963594064640 ext(2093056->2097151) 00002000:00010000:3.0:1746143759.560220:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0a80 00000100:00100000:3.0:1746143759.560249:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6145 00000100:00100000:3.0:1746143759.560255:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594064640:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143759.560378:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594064640:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (414us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143759.560386:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6145 00002000:00100000:3.0:1746143759.560390:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (2093056->2097151) req@ffff88009cdc0a80 x1830963594064640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.560398:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0a80 with x1830963594064640 ext(2093056->2097151) 00002000:00010000:3.0:1746143759.560400:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0a80 00000100:00100000:0.0:1746143759.563484:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.563918:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594064768 00000100:00100000:3.0:1746143759.563926:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594064768 00000100:00100000:3.0:1746143759.564233:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13129 00000100:00100000:3.0:1746143759.564251:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31164:x1830963594064768:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143759.564266:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.564280:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a71ff expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.564303:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.564310:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.564311:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.564314:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->1126399] (req 1048576->1126399) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.564338:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.564348:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 13 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.564364:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594313600:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.564925:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143759.566698:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594313600:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.566719:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->1126399] (req 1048576->1126399) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.566733:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7c00, rc 0) 00000100:00100000:3.0:1746143759.566765:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31164:x1830963594064768:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2524us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.566772:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13129 00000100:00100000:0.0:1746143759.568012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.568071:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594064896 00000100:00100000:2.0:1746143759.568078:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594064896 00002000:00100000:2.0:1746143759.568206:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1810431) req@ffff88009cdc0380 x1830963594064896/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.568215:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0380 with x1830963594064896 ext(1048576->1810431) 00010000:00010000:2.0:1746143759.568222:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.568232:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.568238:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc0380 00000100:00100000:2.0:1746143759.568270:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1741 00000100:00100000:2.0:1746143759.568277:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594064896:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143759.579099:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594064896:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10813us (11081us total) trans 21474840375 rc 0/0 00000100:00100000:2.0:1746143759.579109:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1741 00002000:00100000:2.0:1746143759.579120:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1810431) req@ffff88009cdc0380 x1830963594064896/t21474840375(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.579135:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0380 with x1830963594064896 ext(1048576->1810431) 00010000:00010000:2.0:1746143759.579160:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 16 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.579173:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 16 pid: 2839 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.579180:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc0380 00000100:00100000:0.0:1746143759.582773:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.582878:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594065024 00000100:00100000:2.0:1746143759.582887:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594065024 00010000:00010000:2.0:1746143759.582920:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 16 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.582957:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7000 00000100:00100000:2.0:1746143759.582964:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594065024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.582975:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.582994:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 16 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.583004:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 16 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.583024:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7bca00/0xe984082ccd72f09a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71b9 expref: 16 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.583582:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.583585:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.583591:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.583598:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.583624:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.583633:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594313728:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.583707:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b25fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.585953:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0086d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594313728:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.585973:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.586065:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963594065024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3101us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.586074:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7000 00000100:00100000:0.0:1746143759.587809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.587905:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594065280 00000100:00100000:2.0:1746143759.587911:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594065280 00002000:00100000:2.0:1746143759.587942:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1122304->1126399) req@ffff88009cdc3b80 x1830963594065280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.587951:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963594065280 ext(1122304->1126399) 00002000:00010000:2.0:1746143759.587955:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:2.0:1746143759.587980:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6146 00000100:00100000:2.0:1746143759.587987:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594065280:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143759.588118:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594065280:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 131us (314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143759.588124:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6146 00002000:00100000:2.0:1746143759.588129:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1122304->1126399) req@ffff88009cdc3b80 x1830963594065280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.588135:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963594065280 ext(1122304->1126399) 00002000:00010000:2.0:1746143759.588153:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:0.0:1746143759.703545:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.703614:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594065536 00000100:00100000:2.0:1746143759.703624:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594065536 00000100:00100000:2.0:1746143759.703673:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9119 00000100:00100000:2.0:1746143759.703681:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31169:x1830963594065536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143759.703700:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.703713:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72f0f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7206 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.703809:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703822:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703831:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703840:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703845:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703849:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703931:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703938:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.703943:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143759.703950:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143759.704008:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704013:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704018:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704023:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.704025:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704030:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704037:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143759.704039:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.704042:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704046:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744200/0xe984082ccd72f0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704075:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704079:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704083:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704086:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.704087:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704091:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704095:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094924200) 00010000:00010000:2.0:1746143759.704097:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.704098:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704102:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744c00/0xe984082ccd72f103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.704127:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744600/0xe984082ccd72f0f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 17 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.704135:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.704182:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.704184:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143759.704186:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745a00, rc 0) 00000100:00100000:2.0:1746143759.704620:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31169:x1830963594065536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 938us (1080us total) trans 8589943421 rc 0/0 00000100:00100000:2.0:1746143759.704626:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9119 00000100:00100000:0.0:1746143759.713800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.714105:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594065792 00000100:00100000:2.0:1746143759.714114:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594065792 00000100:00100000:2.0:1746143759.714189:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9120 00000100:00100000:2.0:1746143759.714196:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31174:x1830963594065792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.714214:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.714228:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a720d expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.714331:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714342:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714350:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714360:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714364:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714369:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714447:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714456:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714461:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143759.714469:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143759.714536:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714541:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714546:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714550:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.714553:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714558:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714566:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143759.714568:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.714570:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.714575:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f11f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716071:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716085:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716090:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716094:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.716097:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716102:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716110:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094924400) 00010000:00010000:2.0:1746143759.716112:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.716114:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716119:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f126 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.716170:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 253 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.716180:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 252 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.716186:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.716188:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143759.716190:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745400, rc 0) 00000100:00100000:2.0:1746143759.716555:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31174:x1830963594065792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2357us (2764us total) trans 8589943422 rc 0/0 00000100:00100000:2.0:1746143759.716563:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9120 00000100:00100000:0.0:1746143759.722732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.722940:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594066048 00000100:00100000:2.0:1746143759.722947:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594066048 00000100:00100000:2.0:1746143759.722997:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3893 00000100:00100000:2.0:1746143759.723004:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31174:x1830963594066048:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143759.723810:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:31174:x1830963594066048:12345-192.168.202.48@tcp:35:cat.0 Request processed in 805us (1083us total) trans 8589943423 rc 0/0 00000100:00100000:2.0:1746143759.723817:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3893 00000100:00100000:0.0:1746143759.727069:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.727264:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594066304 00000100:00100000:2.0:1746143759.727270:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594066304 00000100:00100000:2.0:1746143759.727303:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9121 00000100:00100000:2.0:1746143759.727309:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:31172:x1830963594066304:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143759.727327:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.727340:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745000/0xe984082ccd72f13b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7214 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.727429:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727440:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727449:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727459:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727464:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727469:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727549:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f150 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727556:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f150 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727562:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f150 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143759.727570:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143759.727628:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727634:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727639:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727644:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090745200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.727648:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727653:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727662:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143759.727664:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.727667:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727675:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745200/0xe984082ccd72f142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727684:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727688:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727692:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727696:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090744e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.727698:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727703:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727707:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094924400) 00010000:00010000:2.0:1746143759.727709:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.727711:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727714:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744e00/0xe984082ccd72f149 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.727741:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745000/0xe984082ccd72f13b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7214 expref: 256 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.727750:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f150 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7214 expref: 255 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.727760:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.727762:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143759.727764:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744a00, rc 0) 00000100:00100000:2.0:1746143759.727811:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31172:x1830963594066304:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 502us (748us total) trans 8589943424 rc 0/0 00000100:00100000:2.0:1746143759.727818:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9121 00000100:00100000:0.0:1746143759.731269:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.731349:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.731408:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594066688 00000100:00100000:3.0:1746143759.731416:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594066688 00000100:00100000:3.0:1746143759.731463:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 720 00000100:00100000:3.0:1746143759.731471:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1964:x1830963594066688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143759.731482:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143759.731502:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090744a00/0xe984082ccd72f150 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7214 expref: 255 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.731517:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.731520:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.731695:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594066560 00000100:00100000:2.0:1746143759.731699:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594066560 00000100:00100000:2.0:1746143759.731720:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3894 00000100:00100000:2.0:1746143759.731726:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31172:x1830963594066560:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143759.731791:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1964:x1830963594066688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 320us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.731797:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 720 00000100:00100000:2.0:1746143759.732002:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31172:x1830963594066560:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 275us (739us total) trans 8589943425 rc 0/0 00000100:00100000:2.0:1746143759.732009:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3894 00000100:00100000:1.0:1746143759.735421:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.735461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.735486:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.735505:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594066944 00000100:00100000:1.0:1746143759.735510:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594066944 00002000:00100000:1.0:1746143759.735543:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094763480 x1830963594066944/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.735551:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963594066944 ext(1048576->2097151) 00002000:00010000:1.0:1746143759.735555:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:1.0:1746143759.735568:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594067200 00000100:00100000:1.0:1746143759.735570:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594067200 00002000:00100000:1.0:1746143759.735579:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2093055) req@ffff88009c275880 x1830963594067200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.735585:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275880 with x1830963594067200 ext(1048576->2093055) 00002000:00010000:1.0:1746143759.735588:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c275880 00000100:00100000:1.0:1746143759.735595:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594067456 00000100:00100000:1.0:1746143759.735597:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594067456 00002000:00100000:1.0:1746143759.735607:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1126400->2097151) req@ffff88009c276d80 x1830963594067456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.735613:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276d80 with x1830963594067456 ext(1126400->2097151) 00002000:00010000:1.0:1746143759.735615:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c276d80 00000100:00100000:1.0:1746143759.735625:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6147 00000100:00100000:1.0:1746143759.735631:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594066944:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143759.736840:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6148 00000100:00100000:1.0:1746143759.736848:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594067200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143759.736912:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6149 00000100:00100000:3.0:1746143759.736920:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594067456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143759.739215:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.739301:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594067584 00000100:00100000:0.0:1746143759.739308:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594067584 00000100:00100000:0.0:1746143759.739354:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9122 00000100:00100000:0.0:1746143759.739361:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31175:x1830963594067584:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143759.739379:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.739392:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72f15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a721b expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.739442:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739453:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739462:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739472:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739478:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739484:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739564:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739574:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.739580:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143759.739605:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 254 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.739615:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 254 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143759.739625:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594313856:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143759.739683:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.747625:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594066944:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11987us (12203us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143759.747635:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6147 00002000:00100000:1.0:1746143759.747645:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094763480 x1830963594066944/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.747654:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963594066944 ext(1048576->2097151) 00002000:00010000:1.0:1746143759.747659:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:0.0:1746143759.751182:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.751272:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594067712 00000100:00100000:2.0:1746143759.751276:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594313856:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143759.751278:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594067712 00010000:00010000:2.0:1746143759.751298:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.751307:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 255 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.751460:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7001 00000100:00100000:1.0:1746143759.751467:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1963:x1830963594067712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.751477:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.751483:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 255 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.751492:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 255 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.751510:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f0d9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f1 expref: 255 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.751562:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143759.751567:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.751575:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.751581:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.752689:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143759.752762:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752769:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143759.752808:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:2.0:1746143759.752812:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143759.752826:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752836:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752844:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752848:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752852:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752856:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d3000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.752860:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752865:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752874:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143759.752876:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.752879:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.752882:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3000/0xe984082ccd72f165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143759.752998:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1963:x1830963594067712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1528us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.753005:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7001 00010000:00010000:2.0:1746143759.753926:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.753934:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.753939:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.753945:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5d3a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.753947:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.753953:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.753961:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cda00) 00010000:00010000:2.0:1746143759.753963:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.753965:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.753969:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3a00/0xe984082ccd72f16c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143759.754003:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d2800/0xe984082ccd72f15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.754013:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.754019:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.754021:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143759.754023:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d3e00, rc 0) 00000100:00100000:2.0:1746143759.754066:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31175:x1830963594067584:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 14706us (14859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.754073:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9122 00000100:00100000:2.0:1746143759.754794:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594067456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17874us (19305us total) trans 0 rc 970752/970752 00000100:00100000:2.0:1746143759.754805:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6149 00002000:00100000:2.0:1746143759.754812:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1126400->2097151) req@ffff88009c276d80 x1830963594067456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 970752/970752 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.754821:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276d80 with x1830963594067456 ext(1126400->2097151) 00002000:00010000:2.0:1746143759.754824:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c276d80 00000100:00100000:3.0:1746143759.759073:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.759464:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594067840 00000100:00100000:0.0:1746143759.759473:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594067840 00000100:00100000:0.0:1746143759.759574:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13130 00000100:00100000:0.0:1746143759.759581:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31169:x1830963594067840:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143759.759596:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143759.759609:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7222 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.759637:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.759645:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 26 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.759650:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.759652:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.759655:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1077248->1650687] (req 1077248->1650687) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.759678:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 26 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.759688:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 26 pid: 2839 timeout: 938 lvb_type: 1 00000100:00100000:0.0:1746143759.759698:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594313984:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143759.759772:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.759780:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 13 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:0.0:1746143759.759791:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594314112:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143759.759810:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.760232:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594067200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23384us (24768us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746143759.760253:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6148 00002000:00100000:1.0:1746143759.760260:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2093055) req@ffff88009c275880 x1830963594067200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.760269:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275880 with x1830963594067200 ext(1048576->2093055) 00000100:00100000:3.0:1746143759.760272:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143759.760273:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c275880 00000100:00100000:3.0:1746143759.760286:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594067968 00000100:00100000:3.0:1746143759.760289:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594067968 00000100:00100000:3.0:1746143759.760309:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13131 00000100:00100000:3.0:1746143759.760314:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594067968:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143759.760321:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.760327:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7e00/0xe984082ccd72f181 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7229 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.760339:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143759.760344:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143759.760347:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7e00/0xe984082ccd72f181 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7229 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.760356:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7e00/0xe984082ccd72f181 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7229 expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143759.760358:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594068096 00000100:00100000:2.0:1746143759.760361:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594068096 00000100:00100000:2.0:1746143759.760376:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13132 00000100:00100000:2.0:1746143759.760381:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594068096:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143759.760383:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7e00, rc 0) 00010000:00010000:2.0:1746143759.760386:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.760392:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0695400/0xe984082ccd72f188 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7230 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143759.760400:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594067968:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 86us (129us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143759.760406:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13131 00000100:00100000:2.0:1746143759.760413:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594314240:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143759.760446:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143759.760456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.760489:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594068224 00000100:00100000:0.0:1746143759.760491:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594068224 00000100:00100000:0.0:1746143759.760510:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13133 00000100:00100000:0.0:1746143759.760514:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594068224:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143759.760520:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143759.760528:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143759.760528:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090744e00/0xe984082ccd72f18f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7237 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143759.760536:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594068352 00000100:00100000:3.0:1746143759.760539:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594068352 00000100:00100000:0.0:1746143759.760546:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594314368:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143759.760553:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13134 00000100:00100000:3.0:1746143759.760558:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594068352:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143759.760564:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.760571:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a723e expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.760580:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.760582:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.760587:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143759.760699:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.760749:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.760815:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594068480 00000100:00100000:0.0:1746143759.760817:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594068480 00010000:00010000:3.0:1746143759.760822:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.760830:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7600, rc 0) 00000100:00100000:0.0:1746143759.760842:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13135 00000100:00100000:0.0:1746143759.760847:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594068480:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143759.760849:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594068352:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 291us (321us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143759.760853:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143759.760854:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13134 00010000:00010000:0.0:1746143759.760860:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7245 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.760870:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.760871:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143759.760876:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.760885:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.760895:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0f0e00, rc 0) 00000100:00100000:0.0:1746143759.760926:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594068480:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143759.760931:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13135 00010000:00010000:2.0:1746143759.763695:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143759.765792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.765821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.765892:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594314240:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143759.765892:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594314368:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143759.765916:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0695400/0xe984082ccd72f188 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7230 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.765916:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090744e00/0xe984082ccd72f18f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7237 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.765927:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0695400/0xe984082ccd72f188 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7230 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143759.765928:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090744e00/0xe984082ccd72f18f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7237 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.765940:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0695400, rc 0) 00010000:00010000:0.0:1746143759.765940:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090744e00, rc 0) 00000100:00100000:3.0:1746143759.765974:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594068096:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 5592us (5629us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143759.765981:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13132 00000100:00100000:2.0:1746143759.766006:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594313984:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.766007:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594068608 00000100:00100000:3.0:1746143759.766011:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594068608 00000100:00100000:2.0:1746143759.766016:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594314112:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.766030:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 25 pid: 2839 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.766031:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1077248->1650687] (req 1077248->1650687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.766042:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090745600, rc 0) 00000100:00100000:3.0:1746143759.766043:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594068736 00000100:00100000:3.0:1746143759.766045:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594068736 00010000:00010000:3.0:1746143759.766051:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.766061:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7002 00000100:00100000:3.0:1746143759.766065:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594068608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143759.766074:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143759.766082:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 25 pid: 2839 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.766090:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 25 pid: 2839 timeout: 938 lvb_type: 1 00010000:00010000:3.0:1746143759.766103:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f81ba00/0xe984082ccd72f0a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c7 expref: 25 pid: 2839 timeout: 938 lvb_type: 1 00000100:00100000:1.0:1746143759.766103:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7003 00010000:00010000:3.0:1746143759.766109:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.766110:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594068736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.766116:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.766125:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.766152:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.766162:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bcae200/0xe984082ccd72f0a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71c0 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.766173:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.766175:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.766179:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.766186:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.766214:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.766223:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594314496:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143759.766773:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594068224:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6256us (6314us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143759.766779:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13133 00000100:00100000:2.0:1746143759.766904:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31169:x1830963594067840:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7322us (7839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.766910:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13130 00000100:00100000:3.0:1746143759.766992:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594068608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 925us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.767000:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7002 00000100:00100000:1.0:1746143759.767036:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.771263:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.771430:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594068864 00000100:00100000:2.0:1746143759.771438:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594068864 00000100:00100000:2.0:1746143759.771481:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13136 00000100:00100000:2.0:1746143759.771487:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594068864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.771501:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.771514:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0694400/0xe984082ccd72f1a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a724c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.771631:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594314624:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143759.771706:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.776751:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594314496:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143759.776770:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.776809:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594068736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10698us (10986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.776818:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7003 00000100:00100000:2.0:1746143759.776927:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594314624:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143759.776947:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0694400/0xe984082ccd72f1a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a724c expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.776959:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0694400/0xe984082ccd72f1a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a724c expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.776984:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694400, rc 0) 00000100:00100000:2.0:1746143759.777002:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594068864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5516us (5747us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143759.777008:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13136 00000100:00100000:0.0:1746143759.778195:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.778300:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594069120 00000100:00100000:1.0:1746143759.778306:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594069120 00002000:00100000:1.0:1746143759.778338:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1077248->1081343) req@ffff8800a0879c00 x1830963594069120/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.778346:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879c00 with x1830963594069120 ext(1077248->1081343) 00002000:00010000:1.0:1746143759.778350:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879c00 00000100:00100000:1.0:1746143759.778375:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6150 00000100:00100000:1.0:1746143759.778381:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594069120:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143759.778531:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594069120:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 149us (338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143759.778537:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6150 00002000:00100000:1.0:1746143759.778542:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1077248->1081343) req@ffff8800a0879c00 x1830963594069120/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143759.778554:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879c00 with x1830963594069120 ext(1077248->1081343) 00002000:00010000:1.0:1746143759.778557:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879c00 00000100:00100000:0.0:1746143759.778626:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.778847:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594069376 00000100:00100000:3.0:1746143759.778851:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594069376 00000100:00100000:3.0:1746143759.778889:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9123 00000100:00100000:3.0:1746143759.778895:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31175:x1830963594069376:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143759.778905:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.778922:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6000/0xe984082ccd72f1ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7253 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.779003:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.779017:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.779023:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.779046:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.779055:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 12 pid: 16090 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.779065:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594314752:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.779158:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143759.780172:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594314752:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.780187:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143759.780529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.780574:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594069504 00000100:00100000:1.0:1746143759.780577:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594069504 00010000:00010000:1.0:1746143759.780595:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 13 pid: 16090 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.781576:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7004 00000100:00100000:1.0:1746143759.781584:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594069504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.781596:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.781601:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 13 pid: 16090 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.781611:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 13 pid: 16090 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.781628:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5d3e00/0xe984082ccd72f173 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a721b expref: 13 pid: 16090 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.781649:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143759.781653:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143759.781655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143759.781660:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.781665:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.781688:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.781707:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594069632 00000100:00100000:2.0:1746143759.781714:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594069632 00000100:00100000:1.0:1746143759.781728:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594069504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 145us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.781734:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7004 00000100:00100000:2.0:1746143759.781744:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13137 00000100:00100000:2.0:1746143759.781752:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594069632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.781764:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.781776:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0694600/0xe984082ccd72f1b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a725a expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.781826:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594314880:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143759.781831:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.781837:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143759.781853:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:2.0:1746143759.781881:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00010000:00010000:3.0:1746143759.782022:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6000/0xe984082ccd72f1ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7253 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.782688:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7253 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.782695:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.782698:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143759.782700:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7800, rc 0) 00000100:00100000:2.0:1746143759.782865:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594314880:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143759.782884:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0694600/0xe984082ccd72f1b9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a725a expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.782894:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0694600/0xe984082ccd72f1b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a725a expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.783480:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694600, rc 0) 00000100:00100000:2.0:1746143759.783536:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594069632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1784us (1880us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143759.783542:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13137 00000100:00100000:3.0:1746143759.783668:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31175:x1830963594069376:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4772us (5042us total) trans 8589943426 rc 0/0 00000100:00100000:3.0:1746143759.783675:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9123 00000100:00100000:0.0:1746143759.788010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.788059:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594069888 00000100:00100000:2.0:1746143759.788066:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594069888 00002000:00100000:2.0:1746143759.788104:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1646592->1650687) req@ffff88009ff6c000 x1830963594069888/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.788113:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c000 with x1830963594069888 ext(1646592->1650687) 00002000:00010000:2.0:1746143759.788117:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6c000 00000100:00100000:2.0:1746143759.788167:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6151 00000100:00100000:2.0:1746143759.788175:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594069888:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143759.788466:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594069888:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 290us (462us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143759.788472:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6151 00002000:00100000:2.0:1746143759.788477:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1646592->1650687) req@ffff88009ff6c000 x1830963594069888/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.788484:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c000 with x1830963594069888 ext(1646592->1650687) 00002000:00010000:2.0:1746143759.788486:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6c000 00000100:00100000:0.0:1746143759.790488:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.790532:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.790558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.790724:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594070144 00000100:00100000:1.0:1746143759.790731:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594070144 00000100:00100000:3.0:1746143759.790752:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594070528 00000100:00100000:3.0:1746143759.790757:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594070528 00000100:00100000:1.0:1746143759.790768:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9124 00000100:00100000:1.0:1746143759.790774:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31178:x1830963594070144:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143759.790790:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9125 00010000:00010000:1.0:1746143759.790791:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143759.790796:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31175:x1830963594070528:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143759.790805:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72f1c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7261 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.790806:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.790808:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143759.790827:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd72f1b2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7253 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.790851:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.790854:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143759.790860:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6400/0xe984082ccd72f1ce lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a726f expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.790896:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143759.790907:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143759.790915:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143759.790925:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143759.790930:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143759.790935:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.791258:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.791266:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.791272:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.791295:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.791300:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.791306:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.791311:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7f7000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143759.791314:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.791319:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143759.791320:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143759.791329:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143759.791335:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143759.791344:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:2.0:1746143759.791393:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594070272 00000100:00100000:2.0:1746143759.791396:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594070272 00000100:00100000:2.0:1746143759.791420:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13138 00000100:00100000:2.0:1746143759.791426:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594070272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.791433:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.791441:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0694800/0xe984082ccd72f1f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7268 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.791475:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594315008:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143759.791518:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143759.791521:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143759.791525:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143759.791530:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7000/0xe984082ccd72f1e3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143759.791543:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00010000:00010000:3.0:1746143759.791555:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6400/0xe984082ccd72f1ce lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a726f expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.791561:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f6400/0xe984082ccd72f1ce lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a726f expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.791567:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6400, rc 0) 00000100:00100000:3.0:1746143759.791589:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31175:x1830963594070528:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 793us (1030us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143759.791594:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9125 00010000:00010000:0.0:1746143759.791832:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791837:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791841:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791845:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a014ce00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143759.791847:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791851:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791859:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143759.791860:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143759.791863:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791866:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014ce00/0xe984082ccd72f1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791890:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791894:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791897:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791903:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a014c000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143759.791905:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791909:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791914:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74700) 00010000:00010000:0.0:1746143759.791916:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143759.791917:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791921:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c000/0xe984082ccd72f1dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143759.791949:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014c200/0xe984082ccd72f1c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 19 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.791957:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143759.791962:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143759.791963:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143759.791965:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014d600, rc 0) 00000100:00100000:0.0:1746143759.791996:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31178:x1830963594070144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1221us (1463us total) trans 8589943427 rc 0/0 00000100:00100000:0.0:1746143759.792001:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9124 00000100:00100000:0.0:1746143759.792297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.792351:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594070784 00000100:00100000:2.0:1746143759.792354:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594070784 00000100:00100000:2.0:1746143759.792412:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3895 00000100:00100000:2.0:1746143759.792418:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31169:x1830963594070784:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143759.792835:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31169:x1830963594070784:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 416us (536us total) trans 8589943428 rc 0/0 00000100:00100000:2.0:1746143759.792841:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3895 00000100:00100000:2.0:1746143759.793892:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594315008:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143759.793915:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0694800/0xe984082ccd72f1f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7268 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.793927:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0694800/0xe984082ccd72f1f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7268 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.793935:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0694800, rc 0) 00000100:00100000:2.0:1746143759.793987:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594070272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2558us (3501us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143759.793995:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13138 00000100:00100000:0.0:1746143759.794045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.794125:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594071040 00000100:00100000:2.0:1746143759.794129:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594071040 00000100:00100000:2.0:1746143759.794171:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3896 00000100:00100000:2.0:1746143759.794177:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31178:x1830963594071040:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143759.794308:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31178:x1830963594071040:12345-192.168.202.48@tcp:35:cat.0 Request processed in 130us (263us total) trans 8589943429 rc 0/0 00000100:00100000:2.0:1746143759.794313:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3896 00000100:00100000:0.0:1746143759.795958:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.796593:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.796665:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594071296 00000100:00100000:2.0:1746143759.796671:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594071296 00000100:00100000:3.0:1746143759.796693:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594071552 00000100:00100000:3.0:1746143759.796697:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594071552 00000100:00100000:2.0:1746143759.796715:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3897 00000100:00100000:2.0:1746143759.796721:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31175:x1830963594071296:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143759.796722:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3898 00000100:00100000:3.0:1746143759.796727:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31172:x1830963594071552:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143759.796976:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31175:x1830963594071296:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 254us (1021us total) trans 8589943431 rc 0/0 00000100:00100000:2.0:1746143759.796982:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3897 00000100:00100000:3.0:1746143759.797049:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31172:x1830963594071552:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 320us (455us total) trans 8589943430 rc 0/0 00000100:00100000:3.0:1746143759.797055:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3898 00000100:00100000:0.0:1746143759.797611:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.797786:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594071680 00000100:00100000:2.0:1746143759.797789:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594071680 00000100:00100000:2.0:1746143759.797810:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13139 00000100:00100000:2.0:1746143759.797815:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594071680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.797824:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.797837:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72f1ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7276 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.797876:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594315136:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143759.797934:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.798039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.798165:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594071808 00000100:00100000:1.0:1746143759.798169:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594071808 00000100:00100000:1.0:1746143759.798195:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13140 00000100:00100000:1.0:1746143759.798200:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594071808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.798207:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.798215:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a014d000/0xe984082ccd72f206 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a727d expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.798247:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594315264:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143759.798277:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.801433:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594315136:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143759.801466:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72f1ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7276 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.801478:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0695000/0xe984082ccd72f1ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7276 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143759.801490:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0695000, rc 0) 00000100:00100000:2.0:1746143759.801550:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594071680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3733us (3939us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143759.801556:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13139 00000100:00100000:1.0:1746143759.802426:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594315264:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143759.802459:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a014d000/0xe984082ccd72f206 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a727d expref: 16 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.802472:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d000/0xe984082ccd72f206 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a727d expref: 16 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.802490:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014d000, rc 0) 00000100:00100000:1.0:1746143759.802537:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594071808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4335us (4497us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143759.802550:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13140 00000100:00100000:0.0:1746143759.810196:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.810646:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594072064 00000100:00100000:2.0:1746143759.810657:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594072064 00002000:00100000:2.0:1746143759.810707:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093b07480 x1830963594072064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 504/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.810718:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07480 with x1830963594072064 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.810724:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b07480 00000100:00100000:2.0:1746143759.810746:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6152 00000100:00100000:2.0:1746143759.810752:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594072064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.816054:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594072064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5290us (5858us total) trans 0 rc 475136/475136 00000100:00100000:2.0:1746143759.816065:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6152 00002000:00100000:2.0:1746143759.816077:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093b07480 x1830963594072064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 504/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 475136/475136 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.816087:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07480 with x1830963594072064 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.816093:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b07480 00000100:00100000:0.0:1746143759.822024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.822087:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594072192 00000100:00100000:1.0:1746143759.822097:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594072192 00000100:00100000:1.0:1746143759.822194:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13141 00000100:00100000:1.0:1746143759.822202:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31178:x1830963594072192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.822223:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.822251:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7284 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.822286:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.822294:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.822295:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.822298:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.822327:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.822337:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 23 pid: 8497 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.822349:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594315392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143759.822800:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.823583:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594315392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143759.823605:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.823618:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014c600, rc 0) 00000100:00100000:1.0:1746143759.823658:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31178:x1830963594072192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1456us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.823663:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13141 00000100:00100000:0.0:1746143759.824344:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.824465:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594072320 00000100:00100000:2.0:1746143759.824471:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594072320 00002000:00100000:2.0:1746143759.824509:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1617920->2097151) req@ffff880093b05c00 x1830963594072320/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.824518:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b05c00 with x1830963594072320 ext(1617920->2097151) 00010000:00010000:2.0:1746143759.824524:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.824536:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.824542:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093b05c00 00000100:00100000:2.0:1746143759.824695:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1742 00000100:00100000:2.0:1746143759.824702:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594072320:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143759.833056:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594072320:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 8343us (8701us total) trans 17179873052 rc 0/0 00000100:00100000:2.0:1746143759.833068:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1742 00002000:00100000:2.0:1746143759.833080:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1617920->2097151) req@ffff880093b05c00 x1830963594072320/t17179873052(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.833090:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b05c00 with x1830963594072320 ext(1617920->2097151) 00010000:00010000:2.0:1746143759.833100:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 26 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.833116:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 26 pid: 8497 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.833123:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093b05c00 00000100:00100000:0.0:1746143759.836558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.836658:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594072448 00000100:00100000:1.0:1746143759.837116:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594072448 00010000:00010000:1.0:1746143759.837183:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 26 pid: 8497 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.837226:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7005 00000100:00100000:1.0:1746143759.837234:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594072448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.837259:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.837282:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 26 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.837294:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 26 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.837317:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f0e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2093056->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71f8 expref: 26 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.837345:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.837347:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.837354:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.837363:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.837397:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.837410:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594315520:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143759.837504:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.839277:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594315520:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143759.839296:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.839343:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594072448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2109us (2795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.839351:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7005 00000100:00100000:0.0:1746143759.843055:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.843416:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594072704 00000100:00100000:2.0:1746143759.843425:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594072704 00002000:00100000:2.0:1746143759.843462:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093b06a00 x1830963594072704/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.843472:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06a00 with x1830963594072704 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.843476:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b06a00 00000100:00100000:2.0:1746143759.843507:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6153 00000100:00100000:2.0:1746143759.843513:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594072704:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.852189:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594072704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8667us (9131us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.852200:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6153 00002000:00100000:2.0:1746143759.852210:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093b06a00 x1830963594072704/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.852219:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06a00 with x1830963594072704 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.852224:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b06a00 00000100:00100000:0.0:1746143759.855442:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.855506:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594072832 00000100:00100000:1.0:1746143759.855514:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594072832 00000100:00100000:1.0:1746143759.855560:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13142 00000100:00100000:1.0:1746143759.855568:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31178:x1830963594072832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.855583:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.855596:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a728b expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.855620:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.855627:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.855630:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.855632:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.856813:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.856826:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 21 pid: 8497 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.856837:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594315648:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143759.856925:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.859565:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.859638:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594072960 00000100:00100000:2.0:1746143759.859645:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594072960 00002000:00100000:2.0:1746143759.859683:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1146879) req@ffff880093b04e00 x1830963594072960/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.859692:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04e00 with x1830963594072960 ext(1048576->1146879) 00010000:00010000:2.0:1746143759.859700:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 22 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.859714:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 22 pid: 8497 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.859719:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b04e00 00000100:00100000:2.0:1746143759.859738:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1743 00000100:00100000:2.0:1746143759.859745:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594072960:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143759.860212:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594315648:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143759.860233:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.860256:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014d200, rc 0) 00000100:00100000:1.0:1746143759.860279:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31178:x1830963594072832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4712us (4842us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.860286:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13142 00000100:00100000:2.0:1746143759.863915:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594072960:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 4162us (4348us total) trans 21474840376 rc 0/0 00000100:00100000:2.0:1746143759.863925:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1743 00002000:00100000:2.0:1746143759.863935:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1146879) req@ffff880093b04e00 x1830963594072960/t21474840376(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.864211:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04e00 with x1830963594072960 ext(1048576->1146879) 00010000:00010000:2.0:1746143759.864221:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.864235:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00002000:00010000:2.0:1746143759.864253:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093b04e00 00000100:00100000:0.0:1746143759.867850:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.867998:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594073088 00000100:00100000:1.0:1746143759.868011:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594073088 00010000:00010000:1.0:1746143759.868046:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.868187:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7006 00000100:00100000:1.0:1746143759.868195:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594073088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143759.868208:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143759.868228:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.868252:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.868271:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f0ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1126399) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71ff expref: 24 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:1.0:1746143759.868437:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.868440:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.868446:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.868455:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.868483:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.868494:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594315776:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143759.869273:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.870464:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594315776:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143759.870482:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143759.870606:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594073088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2410us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.870616:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7006 00000100:00100000:2.0:1746143759.873045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.873101:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594073344 00000100:00100000:0.0:1746143759.873108:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594073344 00002000:00100000:0.0:1746143759.873171:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880094c13800 x1830963594073344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143759.873180:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13800 with x1830963594073344 ext(1048576->2097151) 00002000:00010000:0.0:1746143759.873185:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13800 00000100:00100000:0.0:1746143759.873208:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6154 00000100:00100000:0.0:1746143759.873218:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594073344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.885485:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594073344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12254us (12433us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.885496:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6154 00002000:00100000:2.0:1746143759.885509:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880094c13800 x1830963594073344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.885519:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13800 with x1830963594073344 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.885524:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13800 00000100:00100000:0.0:1746143759.926051:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.926263:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594073856 00000100:00100000:2.0:1746143759.926273:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594073856 00000100:00100000:2.0:1746143759.926483:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9126 00000100:00100000:2.0:1746143759.926491:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31188:x1830963594073856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143759.926511:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.926525:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962200/0xe984082ccd72f21b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7299 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.926613:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926623:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926634:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926644:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926648:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926652:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926735:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926743:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926747:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143759.926754:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143759.926822:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926827:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926833:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926838:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a962800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.926842:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926847:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926855:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143759.926858:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.926861:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926869:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962800/0xe984082ccd72f222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926897:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926902:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926905:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926908:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a963e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143759.926910:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926914:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926920:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094924800) 00010000:00010000:2.0:1746143759.926921:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143759.926923:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926928:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963e00/0xe984082ccd72f229 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.926957:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962200/0xe984082ccd72f21b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.926967:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 257 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.926973:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.926974:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143759.926976:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a963a00, rc 0) 00000100:00100000:2.0:1746143759.927022:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31188:x1830963594073856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 532us (977us total) trans 8589943432 rc 0/0 00000100:00100000:2.0:1746143759.927027:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9126 00000100:00100000:0.0:1746143759.927580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.927785:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594073728 00000100:00100000:2.0:1746143759.927789:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594073728 00000100:00100000:2.0:1746143759.927814:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9127 00000100:00100000:2.0:1746143759.927819:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31186:x1830963594073728:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143759.927831:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143759.927838:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962400/0xe984082ccd72f23e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7292 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.927879:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.927888:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 21 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.927895:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 256 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.927901:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.927925:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 256 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.927935:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 256 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.927944:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594315904:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.928643:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 21 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.928651:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 21 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.928659:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594316032:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.928680:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.931195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.931455:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594074112 00000100:00100000:3.0:1746143759.931463:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594074112 00000100:00100000:3.0:1746143759.931501:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3899 00000100:00100000:3.0:1746143759.931508:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31188:x1830963594074112:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143759.931698:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:31188:x1830963594074112:12345-192.168.202.48@tcp:35:cat.0 Request processed in 189us (509us total) trans 8589943433 rc 0/0 00000100:00100000:3.0:1746143759.931704:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3899 00000100:00100000:0.0:1746143759.931814:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.931899:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594315904:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143759.931908:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594316032:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143759.931928:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143759.931960:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594074240 00000100:00100000:2.0:1746143759.931963:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594074240 00010000:00010000:2.0:1746143759.931981:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 22 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.931998:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7007 00000100:00100000:2.0:1746143759.932003:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594074240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.932012:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.932017:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 22 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.932025:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 22 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.932039:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a014d600/0xe984082ccd72f1ea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7261 expref: 22 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.932053:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.932057:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.932064:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.932068:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.932084:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594074240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.932089:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7007 00000100:00100000:0.0:1746143759.934065:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.934095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.934304:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.934481:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594074368 00000100:00100000:2.0:1746143759.934488:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594074368 00010000:00010000:2.0:1746143759.934514:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 258 pid: 14763 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.934543:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7008 00000100:00100000:2.0:1746143759.934548:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1965:x1830963594074368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.934557:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.934563:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 258 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.934572:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 258 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.934587:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963a00/0xe984082ccd72f230 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7299 expref: 258 pid: 14763 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.934598:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.934602:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.934609:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.934614:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.934628:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.934653:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1965:x1830963594074368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 105us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.934659:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7008 00010000:00010000:2.0:1746143759.934674:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143759.934684:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143759.934699:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143759.934803:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962400/0xe984082ccd72f23e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 22 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.934813:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 21 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.934819:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143759.934822:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143759.934824:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a962a00, rc 0) 00000100:00100000:2.0:1746143759.934842:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31186:x1830963594073728:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7023us (7264us total) trans 8589943434 rc 0/0 00000100:00100000:2.0:1746143759.934847:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9127 00000100:00100000:1.0:1746143759.935278:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594074624 00000100:00100000:1.0:1746143759.935283:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594074624 00000100:00100000:1.0:1746143759.935315:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594074496 00000100:00100000:1.0:1746143759.935317:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594074496 00000100:00100000:1.0:1746143759.935337:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13143 00000100:00100000:1.0:1746143759.935342:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594074624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.935353:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.935364:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72a7 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.935378:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.935380:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143759.935386:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.935396:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.935403:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014c000, rc 0) 00000100:00100000:1.0:1746143759.935421:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594074624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.935425:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13143 00000100:00100000:1.0:1746143759.935438:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13144 00000100:00100000:1.0:1746143759.935442:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594074496:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.935447:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.935453:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72f25a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72a0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143759.935481:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594316160:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143759.935528:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.935608:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.935850:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594074752 00000100:00100000:3.0:1746143759.935855:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594074752 00000100:00100000:3.0:1746143759.935886:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13145 00000100:00100000:3.0:1746143759.935892:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594074752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.935899:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.935907:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72ae expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.935919:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.935920:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.935924:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.935934:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.935941:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7c00, rc 0) 00000100:00100000:3.0:1746143759.935958:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594074752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.935962:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13145 00000100:00100000:1.0:1746143759.941889:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594316160:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143759.941921:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72f25a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a0 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.941933:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014da00/0xe984082ccd72f25a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a0 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143759.941958:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014da00, rc 0) 00000100:00100000:1.0:1746143759.942014:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594074496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6568us (7707us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143759.942022:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13144 00000100:00100000:2.0:1746143759.949662:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143759.950840:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594074880 00000100:00100000:1.0:1746143759.950848:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594074880 00000100:00100000:1.0:1746143759.950902:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13146 00000100:00100000:1.0:1746143759.950909:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31188:x1830963594074880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143759.950923:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143759.950937:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72b5 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.950961:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.950972:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.950974:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143759.950977:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.951000:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.951009:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 12 pid: 8497 timeout: 938 lvb_type: 0 00000100:00100000:1.0:1746143759.951019:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594316288:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143759.951101:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143759.951361:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.951433:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594075008 00000100:00100000:3.0:1746143759.951437:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594075008 00000100:00100000:3.0:1746143759.951459:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13147 00000100:00100000:3.0:1746143759.951464:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31186:x1830963594075008:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143759.951471:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.951478:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72bc expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.951492:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 14 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.951499:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.951503:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.951504:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143759.951506:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1372160->1699839] (req 1372160->1699839) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.951520:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143759.951526:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 938 lvb_type: 1 00000100:00100000:3.0:1746143759.951534:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594316416:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.951565:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 14 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.951572:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:3.0:1746143759.951579:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594316544:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.951595:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143759.955573:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594316288:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143759.956050:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143759.956065:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014c200, rc 0) 00000100:00100000:1.0:1746143759.956109:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31188:x1830963594074880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5199us (6452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143759.956117:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13146 00000100:00100000:0.0:1746143759.956346:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.956422:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594316416:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.956430:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594316544:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143759.956445:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1372160->1699839] (req 1372160->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.956454:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6800, rc 0) 00000100:00100000:2.0:1746143759.956774:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594075136 00000100:00100000:2.0:1746143759.956779:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594075136 00010000:00010000:2.0:1746143759.956800:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 938 lvb_type: 1 00000100:00100000:2.0:1746143759.956820:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7009 00000100:00100000:2.0:1746143759.956825:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594075136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.956836:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.956854:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.956868:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.956886:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c000/0xe984082ccd72f253 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72a7 expref: 27 pid: 4582 timeout: 938 lvb_type: 1 00010000:00010000:2.0:1746143759.956901:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143759.957506:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31186:x1830963594075008:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6038us (6142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143759.957512:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13147 00000100:00100000:0.0:1746143759.957649:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143759.957681:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.957756:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594075136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 930us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.957763:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7009 00000100:00100000:2.0:1746143759.957774:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594075392 00000100:00100000:2.0:1746143759.957777:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594075392 00010000:00010000:2.0:1746143759.957788:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.957811:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7010 00000100:00100000:2.0:1746143759.957816:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594075392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.957824:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.957833:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.957841:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.957853:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c600/0xe984082ccd72f20d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7284 expref: 14 pid: 2839 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.957863:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.957864:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.957869:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.957877:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.957902:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.957912:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594316672:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143759.958174:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594075264 00000100:00100000:3.0:1746143759.958178:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594075264 00002000:00100000:3.0:1746143759.958201:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1077248->1650687) req@ffff880093ce8e00 x1830963594075264/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.958209:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8e00 with x1830963594075264 ext(1077248->1650687) 00010000:00010000:3.0:1746143759.958215:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 14 pid: 8497 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.958690:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cb840 going to sleep for 11 seconds 00010000:00010000:3.0:1746143759.959481:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 14 pid: 8497 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143759.959490:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ce8e00 00000100:00100000:3.0:1746143759.959518:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1744 00000100:00100000:3.0:1746143759.959527:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594075264:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143759.964763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.964876:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594075648 00000100:00100000:3.0:1746143759.964884:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594075648 00002000:00100000:3.0:1746143759.964917:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1372160->1376255) req@ffff880093ce9500 x1830963594075648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.964926:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9500 with x1830963594075648 ext(1372160->1376255) 00002000:00010000:3.0:1746143759.964931:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ce9500 00000100:00100000:3.0:1746143759.964949:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6155 00000100:00100000:3.0:1746143759.964956:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594075648:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143759.965101:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594075648:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 145us (347us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143759.965107:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6155 00002000:00100000:3.0:1746143759.965112:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1372160->1376255) req@ffff880093ce9500 x1830963594075648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.965119:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9500 with x1830963594075648 ext(1372160->1376255) 00002000:00010000:3.0:1746143759.965121:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ce9500 00000100:00100000:2.0:1746143759.965929:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594316672:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.965948:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.965973:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594075392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8156us (8290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.965980:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7010 00000100:00100000:0.0:1746143759.974693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.977951:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594075264:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 18417us (20292us total) trans 17179873053 rc 0/0 00000100:00100000:3.0:1746143759.977962:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1744 00002000:00100000:3.0:1746143759.977971:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1077248->1650687) req@ffff880093ce8e00 x1830963594075264/t17179873053(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/448 e 0 to 0 dl 1746143770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.977980:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8e00 with x1830963594075264 ext(1077248->1650687) 00010000:00010000:3.0:1746143759.977989:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 15 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:3.0:1746143759.978003:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 15 pid: 8497 timeout: 938 lvb_type: 0 00002000:00010000:3.0:1746143759.978010:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ce8e00 00000100:00100000:3.0:1746143759.978028:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594075904 00000100:00100000:3.0:1746143759.978033:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594075904 00002000:00100000:3.0:1746143759.978056:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1695744->1699839) req@ffff880093ceb100 x1830963594075904/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.978062:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceb100 with x1830963594075904 ext(1695744->1699839) 00002000:00010000:3.0:1746143759.978064:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ceb100 00000100:00100000:3.0:1746143759.978099:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6156 00000100:00100000:3.0:1746143759.978105:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594075904:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143759.978223:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594075904:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 118us (3538us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143759.978229:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6156 00002000:00100000:3.0:1746143759.978233:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1695744->1699839) req@ffff880093ceb100 x1830963594075904/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143759.978248:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceb100 with x1830963594075904 ext(1695744->1699839) 00002000:00010000:3.0:1746143759.978251:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ceb100 00000100:00100000:0.0:1746143759.982612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.982705:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594076032 00000100:00100000:2.0:1746143759.982712:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594076032 00010000:00010000:2.0:1746143759.982742:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 15 pid: 8497 timeout: 938 lvb_type: 0 00000100:00100000:2.0:1746143759.982767:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7011 00000100:00100000:2.0:1746143759.982773:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594076032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143759.982786:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143759.982804:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 15 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.982814:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 15 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.982831:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090745600/0xe984082ccd72f17a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1077248->1650687) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7222 expref: 15 pid: 8497 timeout: 938 lvb_type: 0 00010000:00010000:2.0:1746143759.982938:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.982940:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143759.982947:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.982954:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143759.982983:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143759.982994:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594316800:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143759.983946:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143759.986396:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594316800:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143759.986415:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143759.986802:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594076032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4027us (4196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143759.986812:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7011 00000100:00100000:0.0:1746143759.987224:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143759.987295:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594076288 00000100:00100000:2.0:1746143759.987300:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594076288 00002000:00100000:2.0:1746143759.987329:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093ce9f80 x1830963594076288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/0 e 0 to 0 dl 1746143770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.987336:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9f80 with x1830963594076288 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.987341:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ce9f80 00000100:00100000:2.0:1746143759.988788:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6157 00000100:00100000:2.0:1746143759.988798:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594076288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143759.995655:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594076288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6850us (8422us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143759.995667:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6157 00002000:00100000:2.0:1746143759.995677:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093ce9f80 x1830963594076288/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:155/0 lens 488/440 e 0 to 0 dl 1746143770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143759.995686:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9f80 with x1830963594076288 ext(1048576->2097151) 00002000:00010000:2.0:1746143759.995692:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ce9f80 00000100:00100000:0.0:1746143759.999268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143759.999331:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594076416 00000100:00100000:3.0:1746143759.999339:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594076416 00000100:00100000:3.0:1746143759.999393:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13148 00000100:00100000:3.0:1746143759.999401:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31188:x1830963594076416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143759.999416:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143759.999431:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72c3 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.999459:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.999465:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.999467:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143759.999470:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.999494:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143759.999504:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 13 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143759.999514:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594316928:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143759.999594:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.001962:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594316928:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.001987:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.001998:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81a600, rc 0) 00000100:00100000:3.0:1746143760.002038:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31188:x1830963594076416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2636us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.002044:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13148 00000100:00100000:0.0:1746143760.002814:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.002979:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594076544 00000100:00100000:2.0:1746143760.002985:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594076544 00002000:00100000:2.0:1746143760.003216:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1372160->1699839) req@ffff880093ce8000 x1830963594076544/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.003224:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8000 with x1830963594076544 ext(1372160->1699839) 00010000:00010000:2.0:1746143760.003230:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 14 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.003256:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 14 pid: 4581 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.003261:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ce8000 00000100:00080000:3.0:1746143760.003392:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143760.003480:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1745 00000100:00100000:2.0:1746143760.003487:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594076544:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143760.010827:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594076544:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 7332us (8004us total) trans 17179873054 rc 0/0 00000100:00100000:2.0:1746143760.010837:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1745 00002000:00100000:2.0:1746143760.010846:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1372160->1699839) req@ffff880093ce8000 x1830963594076544/t17179873054(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.010855:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8000 with x1830963594076544 ext(1372160->1699839) 00010000:00010000:2.0:1746143760.010863:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 16 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.010877:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 16 pid: 4581 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.010882:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ce8000 00000100:00100000:0.0:1746143760.015014:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.015223:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594076672 00000100:00100000:2.0:1746143760.015231:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594076672 00010000:00010000:2.0:1746143760.015272:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 16 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.015312:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7012 00000100:00100000:2.0:1746143760.015318:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594076672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.015330:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.015348:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 16 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.015358:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 16 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.015376:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6800/0xe984082ccd72f26f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->1699839) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72bc expref: 16 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.015518:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.015520:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.015527:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.015535:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.015563:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.015573:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594317056:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143760.015997:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800949cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.018857:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594317056:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143760.018877:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.018911:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594076672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3592us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.018920:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7012 00000100:00100000:0.0:1746143760.019490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.019915:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594076800 00000100:00100000:2.0:1746143760.019922:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594076800 00000100:00100000:2.0:1746143760.019972:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9128 00000100:00100000:2.0:1746143760.019979:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31190:x1830963594076800:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143760.019997:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.020011:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd72f27d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72ca expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.020063:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020073:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020084:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020093:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020098:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020102:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020225:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020248:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 20 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.020255:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.020279:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 20 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.020288:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 20 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.020299:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594317184:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.020364:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf000 going to sleep for 11 seconds 00000100:00080000:3.0:1746143760.020421:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143760.023779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.023820:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.023897:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594077056 00000100:00100000:3.0:1746143760.023904:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594077056 00000100:00100000:3.0:1746143760.023947:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3900 00000100:00100000:3.0:1746143760.023953:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:15421:x1830963594077056:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143760.024168:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:15421:x1830963594077056:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 214us (394us total) trans 8589943435 rc 0/0 00000100:00100000:3.0:1746143760.024174:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3900 00000100:00100000:3.0:1746143760.024230:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594077568 00000100:00100000:3.0:1746143760.024233:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594077568 00002000:00100000:3.0:1746143760.024271:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093ce8a80 x1830963594077568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.024280:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8a80 with x1830963594077568 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.024284:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ce8a80 00000100:00100000:3.0:1746143760.024297:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6158 00000100:00100000:3.0:1746143760.024302:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594077568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143760.027250:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594317184:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.027273:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00080000:0.0:1746143760.027433:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143760.027438:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143760.027523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.027585:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594077440 00000100:00100000:2.0:1746143760.027590:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594077440 00002000:00100000:2.0:1746143760.027626:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012e17f800 x1830963594077440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.027635:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f800 with x1830963594077440 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.027639:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17f800 00000100:00100000:2.0:1746143760.027655:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6159 00000100:00100000:2.0:1746143760.027661:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594077440:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:0.0:1746143760.029244:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143760.031191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.031284:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594077824 00000100:00100000:2.0:1746143760.031291:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594077824 00000100:00080000:0.0:1746143760.032513:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143760.033758:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9129 00000100:00100000:2.0:1746143760.033769:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31192:x1830963594077824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143760.033791:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.033806:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092400/0xe984082ccd72f299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72d1 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.034249:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.034262:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.034268:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.034282:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.034290:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143760.035810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.036309:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594077952 00000100:00100000:2.0:1746143760.036318:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594077952 00010000:00010000:2.0:1746143760.036345:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 22 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.036367:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7013 00000100:00100000:2.0:1746143760.036374:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594077952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.036385:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.036390:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 22 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.036400:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 22 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.036417:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f245 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7292 expref: 22 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.036833:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.036838:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036848:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036853:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036859:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.036863:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.036879:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143760.036894:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036899:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143760.036936:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:2.0:1746143760.036939:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143760.036952:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036960:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036967:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036972:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036977:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036981:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143760.036984:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036989:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.036994:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143760.036996:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143760.036998:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037002:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb800/0xe984082ccd72f284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037009:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037014:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037018:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037021:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143760.037023:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037026:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037031:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094924200) 00010000:00010000:2.0:1746143760.037032:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143760.037034:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037037:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f28b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.037060:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bac00/0xe984082ccd72f27d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ca expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.037071:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ca expref: 13 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.037077:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ca expref: 13 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.037081:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba400, rc 0) 00000100:00100000:2.0:1746143760.037113:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31190:x1830963594076800:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 17134us (17624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.037118:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9128 00000100:00100000:2.0:1746143760.038193:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594077952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1814us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.038201:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7013 00000100:00100000:3.0:1746143760.043774:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594077568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19462us (19943us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.043785:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6158 00002000:00100000:3.0:1746143760.043797:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093ce8a80 x1830963594077568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.043805:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8a80 with x1830963594077568 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.043810:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ce8a80 00000100:00100000:1.0:1746143760.044597:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.044630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.044794:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594078080 00000100:00100000:2.0:1746143760.044801:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594078080 00000100:00100000:2.0:1746143760.044830:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9130 00000100:00100000:2.0:1746143760.044836:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31190:x1830963594078080:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143760.044849:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.044863:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092c00/0xe984082ccd72f2a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72d8 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.044910:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594077440:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17248us (17388us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746143760.044915:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00000100:00100000:3.0:1746143760.044918:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6159 00002000:00100000:3.0:1746143760.044923:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012e17f800 x1830963594077440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143760.044926:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00002000:00100000:3.0:1746143760.044930:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f800 with x1830963594077440 ext(1048576->2097151) 00010000:00010000:2.0:1746143760.044931:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00002000:00010000:3.0:1746143760.044933:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17f800 00010000:00010000:2.0:1746143760.044943:0:14763:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.044950:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143760.044965:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594078208 00000100:00100000:2.0:1746143760.044968:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594078208 00010000:00010000:2.0:1746143760.044980:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ca expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.045006:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7014 00000100:00100000:2.0:1746143760.045010:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594078208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.045018:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.045021:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ca expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.045030:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ca expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.045044:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd72f292 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ca expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.045054:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.045058:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.045064:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.045070:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.045075:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.045080:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.045088:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.045109:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143760.045183:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.045190:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143760.045204:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143760.045554:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092400/0xe984082ccd72f299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d1 expref: 260 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.045583:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d1 expref: 259 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.045590:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d1 expref: 259 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.045596:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6092600, rc 0) 00000100:00100000:3.0:1746143760.045617:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31192:x1830963594077824:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11851us (14431us total) trans 8589943436 rc 0/0 00000100:00100000:3.0:1746143760.045623:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9129 00000100:00100000:2.0:1746143760.046163:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594078208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1150us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.046169:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7014 00000100:00100000:0.0:1746143760.055871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.056064:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594078336 00000100:00100000:2.0:1746143760.056072:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594078336 00010000:00010000:2.0:1746143760.056101:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d1 expref: 259 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.056122:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7015 00000100:00100000:2.0:1746143760.056127:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1963:x1830963594078336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.056160:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.056165:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d1 expref: 259 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.056174:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d1 expref: 259 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.056191:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092600/0xe984082ccd72f2a0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d1 expref: 259 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.056219:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.056223:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.056233:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.056247:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.056273:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.056304:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1963:x1830963594078336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 176us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.056308:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7015 00010000:00010000:3.0:1746143760.056783:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.056797:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143760.056837:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:3.0:1746143760.056842:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143760.056857:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.056866:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.056890:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092c00/0xe984082ccd72f2a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.056919:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.056925:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.056927:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143760.056930:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6092e00, rc 0) 00000100:00100000:3.0:1746143760.056965:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31190:x1830963594078080:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 12128us (12368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.056971:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9130 00000100:00100000:2.0:1746143760.059710:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.059743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.059756:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594078464 00000100:00100000:3.0:1746143760.059763:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594078464 00000100:00080000:0.0:1746143760.059819:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143760.060185:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.060748:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594078592 00000100:00100000:3.0:1746143760.060751:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594078592 00000100:00100000:0.0:1746143760.060778:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594078720 00000100:00100000:0.0:1746143760.060782:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594078720 00000100:00100000:1.0:1746143760.060813:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13149 00000100:00100000:1.0:1746143760.060821:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594078464:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143760.060835:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.060848:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72df expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.060865:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.060867:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.060873:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.060887:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.060897:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014de00, rc 0) 00000100:00100000:1.0:1746143760.060945:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594078464:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 125us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.060951:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13149 00000100:00100000:1.0:1746143760.060966:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13150 00000100:00100000:1.0:1746143760.060970:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594078592:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143760.060976:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.060982:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72e6 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.060992:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.060993:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.060997:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.061009:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.061015:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a014ce00, rc 0) 00000100:00100000:1.0:1746143760.061028:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594078592:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 58us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.061032:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13150 00000100:00100000:0.0:1746143760.061452:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13151 00000100:00100000:0.0:1746143760.061458:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594078720:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143760.061465:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.061476:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72ed expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.061487:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.061488:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.061493:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.061503:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.061509:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729a00, rc 0) 00000100:00100000:0.0:1746143760.061527:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594078720:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 70us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.061531:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13151 00000100:00080000:2.0:1746143760.061815:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143760.065513:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.065582:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594078976 00000100:00100000:3.0:1746143760.065590:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594078976 00000100:00100000:3.0:1746143760.065642:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9131 00000100:00100000:3.0:1746143760.065651:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31190:x1830963594078976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143760.065667:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.065682:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f2d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72f4 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.065774:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065784:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065793:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065805:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065809:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065814:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065904:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd72f2e6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065913:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd72f2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.065918:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd72f2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143760.065926:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143760.066000:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066007:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066013:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066019:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e15b000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.066023:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066029:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066038:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143760.066041:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.066044:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066048:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd72f2d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066077:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066083:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066087:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066091:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63ff800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.066093:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066101:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066107:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1f4600) 00010000:00010000:3.0:1746143760.066109:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.066111:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066116:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f2df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.066171:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f2d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72f4 expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.066183:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd72f2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72f4 expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.066189:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.066191:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143760.066194:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63fec00, rc 0) 00000100:00100000:3.0:1746143760.066251:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31190:x1830963594078976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 601us (745us total) trans 8589943437 rc 0/0 00000100:00100000:3.0:1746143760.066257:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9131 00000100:00100000:0.0:1746143760.071172:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.072198:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.072370:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594079360 00000100:00100000:2.0:1746143760.072378:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594079360 00000100:00100000:2.0:1746143760.072429:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 721 00000100:00100000:2.0:1746143760.072436:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594079360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.072447:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.072466:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd72f2e6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72f4 expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.072483:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.072487:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.072521:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594079360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.072527:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 721 00000100:00100000:3.0:1746143760.073363:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594079232 00000100:00100000:3.0:1746143760.073368:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594079232 00000100:00100000:3.0:1746143760.073401:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9132 00000100:00100000:3.0:1746143760.073407:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31190:x1830963594079232:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143760.073424:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.073435:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f2f4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a72fb expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.073504:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073515:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073524:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073535:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073540:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073546:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073551:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a963000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.073555:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073561:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073568:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.073570:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143760.073573:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.073578:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a963000/0xe984082ccd72f2fb lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.074249:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f2f4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72fb expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.074257:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a962a00/0xe984082ccd72f2f4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72fb expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.074266:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a962a00, rc 0) 00000100:00100000:3.0:1746143760.074297:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31190:x1830963594079232:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 891us (2101us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143760.074303:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9132 00000100:00100000:0.0:1746143760.077718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.078424:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594079616 00000100:00100000:3.0:1746143760.078432:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594079616 00000100:00100000:3.0:1746143760.078481:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3901 00000100:00100000:3.0:1746143760.078488:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31190:x1830963594079616:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143760.078650:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31190:x1830963594079616:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 163us (937us total) trans 8589943438 rc 0/0 00000100:00100000:3.0:1746143760.078656:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3901 00000100:00100000:0.0:1746143760.100761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.100891:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594079872 00000100:00100000:3.0:1746143760.100899:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594079872 00000100:00100000:3.0:1746143760.100948:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9133 00000100:00100000:3.0:1746143760.100960:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31196:x1830963594079872:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143760.100982:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.100998:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f302 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7302 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.101097:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.101114:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.101120:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.101172:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.101181:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 14 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.101191:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594317312:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.101288:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.106934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.107010:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080000 00000100:00100000:1.0:1746143760.107021:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080000 00000100:00100000:3.0:1746143760.107046:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594317312:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.107055:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.107065:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143760.107098:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7016 00000100:00100000:1.0:1746143760.107104:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594080000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.107120:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.107125:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.107181:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.107201:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6092e00/0xe984082ccd72f2ae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72d8 expref: 15 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.107230:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143760.107242:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143760.107257:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143760.107263:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143760.107290:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143760.107308:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.107315:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143760.107332:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:1.0:1746143760.107332:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594080000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 227us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.107338:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7016 00010000:00010000:3.0:1746143760.107449:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd72f302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 24 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.107479:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 23 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.107485:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.107488:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143760.107490:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5003000, rc 0) 00000100:00100000:3.0:1746143760.107510:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31196:x1830963594079872:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6556us (6757us total) trans 8589943439 rc 0/0 00000100:00100000:3.0:1746143760.107516:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9133 00000100:00100000:0.0:1746143760.133713:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.133758:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.133819:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.133839:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080128 00000100:00100000:0.0:1746143760.133846:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080128 00000100:00100000:0.0:1746143760.133893:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080256 00000100:00100000:0.0:1746143760.133895:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080256 00000100:00100000:0.0:1746143760.133904:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080384 00000100:00100000:0.0:1746143760.133906:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080384 00000100:00100000:0.0:1746143760.133918:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13152 00000100:00100000:0.0:1746143760.133925:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594080128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143760.133939:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.133953:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7309 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.133972:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.133974:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.133980:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 17 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.133992:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 17 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.134001:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728e00, rc 0) 00000100:00100000:2.0:1746143760.134017:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13153 00000100:00100000:2.0:1746143760.134023:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594080256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.134029:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.134035:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7310 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.134035:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594080128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.134040:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13152 00010000:00010000:2.0:1746143760.134045:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.134046:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.134051:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 17 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143760.134053:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13154 00000100:00100000:0.0:1746143760.134057:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31192:x1830963594080384:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143760.134060:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 17 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.134062:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.134066:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6093a00, rc 0) 00010000:00010000:0.0:1746143760.134069:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7317 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.134079:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594080256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (321us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143760.134082:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143760.134083:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13153 00010000:00010000:0.0:1746143760.134092:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 15 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.134098:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.134102:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.134103:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.134105:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [372736->1028095] (req 372736->1028095) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.134125:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.134134:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 25 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746143760.134168:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317440:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143760.134220:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 15 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.134231:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 15 pid: 9527 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746143760.134251:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317568:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143760.134618:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.134626:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 10 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746143760.134635:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317696:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143760.134668:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.139908:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.140094:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317440:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.140104:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317568:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.140111:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317696:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.140153:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [372736->1028095] (req 372736->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 25 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.140169:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729e00, rc 0) 00000100:00100000:3.0:1746143760.140944:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080512 00000100:00100000:3.0:1746143760.140950:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080512 00010000:00010000:3.0:1746143760.140977:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 11 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.141567:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31192:x1830963594080384:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7507us (7745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.141580:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13154 00000100:00100000:0.0:1746143760.141756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.142085:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080640 00000100:00100000:3.0:1746143760.142089:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080640 00010000:00010000:3.0:1746143760.142120:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 16 pid: 9527 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.142136:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7017 00000100:00100000:3.0:1746143760.142153:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594080512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.142163:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.142181:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 11 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.142189:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 11 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.142206:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a71e8200/0xe984082ccd72ee63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a707e expref: 11 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.142227:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143760.142262:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594080512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.142267:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7017 00000100:00100000:3.0:1746143760.142278:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7018 00000100:00100000:3.0:1746143760.142282:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594080640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.142287:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.142292:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 16 pid: 9527 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.142299:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 16 pid: 9527 timeout: 939 lvb_type: 1 00000100:00080000:2.0:1746143760.142529:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143760.142745:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.142755:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080768 00000100:00100000:0.0:1746143760.142758:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080768 00010000:00010000:0.0:1746143760.142770:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 25 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746143760.142795:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7019 00000100:00100000:0.0:1746143760.142800:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594080768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.142806:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.142814:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 25 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143760.142821:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 25 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143760.142832:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c1c400/0xe984082ccd72ef74 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70e7 expref: 25 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143760.142843:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.142845:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.142851:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.142858:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.142887:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.142896:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594317824:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143760.142940:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143760.143213:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72efb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7111 expref: 16 pid: 9527 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.143222:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143760.143248:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963594080640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 966us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.143253:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7018 00000100:00100000:0.0:1746143760.144441:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.144526:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54ea680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594317824:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143760.144536:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.144562:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594080768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1762us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.144568:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7019 00000100:00100000:2.0:1746143760.144635:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594080896 00000100:00100000:2.0:1746143760.144639:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594080896 00000100:00100000:2.0:1746143760.144662:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13155 00000100:00100000:2.0:1746143760.144666:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31199:x1830963594080896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.144678:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.144688:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a731e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.144703:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.144709:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143760.144711:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143760.144714:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.144728:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.144735:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 23 pid: 8495 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.144744:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317952:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.144778:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.150822:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.150992:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594081152 00000100:00100000:0.0:1746143760.151001:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594081152 00002000:00100000:0.0:1746143760.151039:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (372736->376831) req@ffff8800949f3b80 x1830963594081152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.151049:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3b80 with x1830963594081152 ext(372736->376831) 00010000:00010000:0.0:1746143760.151057:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.151071:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00002000:00010000:0.0:1746143760.151077:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949f3b80 00000100:00100000:0.0:1746143760.151102:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1746 00000100:00100000:0.0:1746143760.151109:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594081152:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143760.151276:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594081152:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 167us (462us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143760.151282:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1746 00002000:00100000:0.0:1746143760.151287:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (372736->376831) req@ffff8800949f3b80 x1830963594081152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.151294:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3b80 with x1830963594081152 ext(372736->376831) 00010000:00010000:0.0:1746143760.151298:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.151307:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00002000:00010000:0.0:1746143760.151312:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949f3b80 00000100:00100000:2.0:1746143760.151615:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594317952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.151637:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.151649:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6093c00, rc 0) 00000100:00100000:2.0:1746143760.151671:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31199:x1830963594080896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7004us (7232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.151676:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13155 00000100:00100000:0.0:1746143760.164655:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.164739:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594081408 00000100:00100000:3.0:1746143760.164747:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594081408 00002000:00100000:3.0:1746143760.164783:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (1024000->1028095) req@ffff8800a54ea680 x1830963594081408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.164797:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ea680 with x1830963594081408 ext(1024000->1028095) 00010000:00010000:3.0:1746143760.164804:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.164816:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.164822:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a54ea680 00000100:00100000:3.0:1746143760.164836:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1747 00000100:00100000:3.0:1746143760.164842:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594081408:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143760.165066:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594081408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 222us (417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143760.165071:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1747 00002000:00100000:3.0:1746143760.165075:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (1024000->1028095) req@ffff8800a54ea680 x1830963594081408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.165082:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ea680 with x1830963594081408 ext(1024000->1028095) 00010000:00010000:3.0:1746143760.165086:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.165093:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.165099:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a54ea680 00000100:00100000:0.0:1746143760.167104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.167337:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594081664 00000100:00100000:3.0:1746143760.167344:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594081664 00002000:00100000:3.0:1746143760.167375:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (372736->1028095) req@ffff8800a54ead80 x1830963594081664/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.167385:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ead80 with x1830963594081664 ext(372736->1028095) 00010000:00010000:3.0:1746143760.167391:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.167402:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 24 pid: 8495 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.167408:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a54ead80 00000100:00100000:3.0:1746143760.167423:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1748 00000100:00100000:3.0:1746143760.167431:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594081664:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143760.167874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.167955:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594081920 00000100:00100000:2.0:1746143760.167959:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594081920 00000100:00100000:2.0:1746143760.167982:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3902 00000100:00100000:2.0:1746143760.167986:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:31192:x1830963594081920:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143760.168184:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31192:x1830963594081920:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 197us (310us total) trans 8589943440 rc 0/0 00000100:00100000:2.0:1746143760.168191:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3902 00000100:00100000:3.0:1746143760.184533:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594081664:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 17094us (17425us total) trans 21474840377 rc 0/0 00000100:00100000:3.0:1746143760.184543:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1748 00002000:00100000:3.0:1746143760.184553:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (372736->1028095) req@ffff8800a54ead80 x1830963594081664/t21474840377(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.184563:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ead80 with x1830963594081664 ext(372736->1028095) 00010000:00010000:3.0:1746143760.184571:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 26 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.184585:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 26 pid: 8495 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.184596:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a54ead80 00000100:00100000:0.0:1746143760.188397:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.191494:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594082048 00000100:00100000:2.0:1746143760.191505:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594082048 00010000:00010000:2.0:1746143760.191553:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 26 pid: 8495 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.191595:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7020 00000100:00100000:2.0:1746143760.191604:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594082048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.191619:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143760.191639:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143758 -> 1746143759 00002000:00010000:2.0:1746143760.191641:0:23335:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143758 -> 1746143759 00010000:00010000:2.0:1746143760.191646:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 26 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.191658:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 26 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.191679:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 372736->1028095) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7317 expref: 26 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.191706:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.191708:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.191714:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.191721:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.191754:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.191767:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594318080:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143760.191853:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.194192:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594318080:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143760.194272:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.194507:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594082048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2903us (6121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.194515:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7020 00000100:00100000:0.0:1746143760.203296:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.203340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.205322:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.205809:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594082432 00000100:00100000:3.0:1746143760.205817:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594082432 00002000:00100000:3.0:1746143760.205859:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a54eb800 x1830963594082432/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.205869:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54eb800 with x1830963594082432 ext(0->1048575) 00002000:00010000:3.0:1746143760.205873:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54eb800 00000100:00100000:3.0:1746143760.205898:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594082688 00000100:00100000:3.0:1746143760.205900:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594082688 00002000:00100000:3.0:1746143760.205912:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a54ebb80 x1830963594082688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.205918:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ebb80 with x1830963594082688 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.205921:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54ebb80 00000100:00100000:3.0:1746143760.205928:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594082560 00000100:00100000:3.0:1746143760.205930:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594082560 00002000:00100000:3.0:1746143760.205937:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a54e8a80 x1830963594082560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.205942:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8a80 with x1830963594082560 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.205945:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54e8a80 00000100:00100000:3.0:1746143760.205961:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6160 00000100:00100000:3.0:1746143760.205967:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594082432:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.207154:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6161 00000100:00100000:3.0:1746143760.207164:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594082688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.208283:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6162 00000100:00100000:3.0:1746143760.208290:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594082560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.226946:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594082432:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20970us (23654us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.226957:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6160 00002000:00100000:3.0:1746143760.226967:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a54eb800 x1830963594082432/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.226977:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54eb800 with x1830963594082432 ext(0->1048575) 00002000:00010000:3.0:1746143760.226982:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54eb800 00000100:00100000:3.0:1746143760.231703:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594082688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24532us (28354us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.231715:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6161 00002000:00100000:3.0:1746143760.231724:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a54ebb80 x1830963594082688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.231732:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ebb80 with x1830963594082688 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.231738:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54ebb80 00000100:00100000:2.0:1746143760.233715:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594082560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25421us (28391us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.233723:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6162 00002000:00100000:2.0:1746143760.233730:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a54e8a80 x1830963594082560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.233738:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8a80 with x1830963594082560 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.233742:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54e8a80 00000100:00100000:0.0:1746143760.240552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.241613:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594082944 00000100:00100000:2.0:1746143760.241621:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594082944 00000100:00100000:3.0:1746143760.248469:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13156 00000100:00100000:3.0:1746143760.248489:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31196:x1830963594082944:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143760.248507:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.248522:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7325 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.248547:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.248557:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.248564:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.248569:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.248571:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.248574:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3342336->4104191] (req 3342336->4104191) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.248601:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.248611:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 18 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.248622:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318208:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.248730:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.248738:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 10 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.248746:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318336:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.248771:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.248785:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 26 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.248792:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318464:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.248810:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.251265:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318336:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.251276:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318464:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.251284:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318208:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.251307:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3342336->4104191] (req 3342336->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.251322:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0600, rc 0) 00000100:00100000:3.0:1746143760.251354:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31196:x1830963594082944:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2875us (10809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.251362:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13156 00000100:00100000:0.0:1746143760.256984:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.258100:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.258623:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594083200 00000100:00100000:2.0:1746143760.258630:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594083200 00010000:00010000:2.0:1746143760.258664:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 18 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.258686:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594083072 00000100:00100000:2.0:1746143760.258688:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594083072 00010000:00010000:2.0:1746143760.258696:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 11 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.258719:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7021 00000100:00100000:2.0:1746143760.258726:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594083200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.258737:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.258757:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 18 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.258767:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 18 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.258790:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f007 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a717a expref: 18 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.258808:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.258842:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594083200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.258847:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7021 00000100:00100000:2.0:1746143760.258858:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7022 00000100:00100000:2.0:1746143760.258862:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594083072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.258867:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.258872:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 11 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.258879:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 11 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.258887:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0e00/0xe984082ccd72f19d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7245 expref: 11 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.258893:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.258903:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594083072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.258908:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7022 00000100:00100000:0.0:1746143760.259001:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.259054:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594083328 00000100:00100000:3.0:1746143760.259058:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594083328 00010000:00010000:3.0:1746143760.259072:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 27 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.259084:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7023 00000100:00100000:3.0:1746143760.259087:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594083328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.259094:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.259100:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 27 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.259107:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 27 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.259116:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd72efeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a715e expref: 27 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.259125:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.259127:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.259133:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.259160:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.259187:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.259196:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594318592:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143760.259249:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.261985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.262054:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594083584 00000100:00100000:2.0:1746143760.262059:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594083584 00000100:00100000:3.0:1746143760.262064:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594318592:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143760.262082:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746143760.262094:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3342336->3346431) req@ffff8800a54e8e00 x1830963594083584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.262103:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8e00 with x1830963594083584 ext(3342336->3346431) 00002000:00010000:2.0:1746143760.262107:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54e8e00 00000100:00100000:3.0:1746143760.262123:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594083328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3033us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.262123:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6163 00000100:00100000:2.0:1746143760.262128:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594083584:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.262132:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7023 00000100:00100000:2.0:1746143760.262266:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594083584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 137us (287us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143760.262271:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6163 00002000:00100000:2.0:1746143760.262275:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3342336->3346431) req@ffff8800a54e8e00 x1830963594083584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.262281:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8e00 with x1830963594083584 ext(3342336->3346431) 00002000:00010000:2.0:1746143760.262284:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54e8e00 00000100:00100000:0.0:1746143760.270134:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.270906:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594083840 00000100:00100000:2.0:1746143760.270913:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594083840 00002000:00100000:2.0:1746143760.270952:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (4100096->4104191) req@ffff8800a0086680 x1830963594083840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.270961:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086680 with x1830963594083840 ext(4100096->4104191) 00002000:00010000:2.0:1746143760.270965:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086680 00000100:00100000:2.0:1746143760.270995:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6164 00000100:00100000:2.0:1746143760.271001:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594083840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143760.271545:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594083840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 542us (1417us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143760.271552:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6164 00002000:00100000:2.0:1746143760.271559:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (4100096->4104191) req@ffff8800a0086680 x1830963594083840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.271565:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086680 with x1830963594083840 ext(4100096->4104191) 00002000:00010000:2.0:1746143760.271567:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0086680 00000100:00100000:0.0:1746143760.294262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.294914:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594083968 00000100:00100000:3.0:1746143760.294921:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594083968 00000100:00100000:3.0:1746143760.294971:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13157 00000100:00100000:3.0:1746143760.294977:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594083968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.294991:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.295004:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a732c expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.295023:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.295024:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.295031:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.295044:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.295052:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0a00, rc 0) 00000100:00100000:3.0:1746143760.295086:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594083968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 110us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.295091:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13157 00000100:00100000:0.0:1746143760.297562:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.297636:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594084096 00000100:00100000:2.0:1746143760.297642:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594084096 00000100:00100000:2.0:1746143760.297684:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13158 00000100:00100000:2.0:1746143760.297690:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594084096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.297703:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.297714:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009089fe00/0xe984082ccd72f341 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7333 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.297755:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594318720:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143760.297821:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf480 going to sleep for 11 seconds 00002000:00010000:2.0:1746143760.298793:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143758 -> 1746143760 00002000:00010000:2.0:1746143760.298797:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143758 -> 1746143760 00002000:00010000:2.0:1746143760.298799:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143758 -> 1746143760 00000100:00100000:2.0:1746143760.298815:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594318720:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143760.298835:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009089fe00/0xe984082ccd72f341 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7333 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.298845:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009089fe00/0xe984082ccd72f341 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7333 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.299895:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089fe00, rc 0) 00000100:00100000:2.0:1746143760.299939:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594084096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2247us (2381us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143760.299946:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13158 00000100:00100000:0.0:1746143760.302119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.302184:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594084224 00000100:00100000:3.0:1746143760.302191:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594084224 00000100:00100000:3.0:1746143760.302226:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9134 00000100:00100000:3.0:1746143760.302243:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31206:x1830963594084224:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143760.302262:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.302276:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1000/0xe984082ccd72f348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a733a expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.302323:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302333:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302342:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302354:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302359:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302364:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302456:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302465:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 22 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.302471:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.302494:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 22 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.302504:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 22 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.302514:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594318848:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143760.303985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.304055:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594084480 00000100:00100000:1.0:1746143760.304060:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594084480 00000100:00100000:1.0:1746143760.304729:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3903 00000100:00100000:3.0:1746143760.304735:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.304737:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:7695:x1830963594084480:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143760.304759:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594318848:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.304775:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143760.306547:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:7695:x1830963594084480:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 1803us (2558us total) trans 8589943441 rc 0/0 00000100:00100000:1.0:1746143760.306556:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3903 00000100:00100000:0.0:1746143760.306830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.306895:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594084736 00000100:00100000:2.0:1746143760.306901:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594084736 00002000:00100000:2.0:1746143760.306935:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093501180 x1830963594084736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.306944:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501180 with x1830963594084736 ext(0->1048575) 00002000:00010000:2.0:1746143760.306949:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093501180 00000100:00100000:2.0:1746143760.306980:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6165 00000100:00100000:2.0:1746143760.306986:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594084736:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.308050:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.308131:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594084864 00000100:00100000:3.0:1746143760.308135:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594084864 00010000:00010000:3.0:1746143760.308171:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 24 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.309038:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7024 00000100:00100000:3.0:1746143760.309046:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594084864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.309060:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.309066:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 24 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.309076:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 24 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.309093:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5003000/0xe984082ccd72f309 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7302 expref: 24 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.310246:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.310252:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310266:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310272:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310303:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143760.310332:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.310338:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:3.0:1746143760.310353:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594084864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1308us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.310360:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7024 00000004:00200000:0.0:1746143760.310376:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:0.0:1746143760.310380:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143760.310412:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310422:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310430:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310435:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310441:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310445:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03f1200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.310448:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310453:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310462:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143760.310465:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.310467:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310471:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f34f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310482:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310487:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310491:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310495:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03f0c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.310497:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310501:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310507:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800933c0e00) 00010000:00010000:3.0:1746143760.310509:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.310512:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310516:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f356 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.310548:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1000/0xe984082ccd72f348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.310562:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.310567:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.310569:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143760.310570:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0e00, rc 0) 00000100:00100000:3.0:1746143760.310608:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31206:x1830963594084224:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 8374us (8492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.310614:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9134 00000100:00100000:0.0:1746143760.315647:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594084736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8654us (8809us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143760.315657:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6165 00002000:00100000:0.0:1746143760.315667:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093501180 x1830963594084736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.315675:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501180 with x1830963594084736 ext(0->1048575) 00002000:00010000:0.0:1746143760.315680:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093501180 00000100:00100000:0.0:1746143760.316962:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.318178:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.319077:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594084992 00000100:00100000:2.0:1746143760.319086:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594084992 00000100:00100000:3.0:1746143760.319381:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594085120 00000100:00100000:3.0:1746143760.319386:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594085120 00000100:00100000:2.0:1746143760.319394:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13159 00000100:00100000:2.0:1746143760.319402:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594084992:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143760.319420:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13160 00000100:00100000:3.0:1746143760.319425:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594085120:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143760.319438:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.319452:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f364 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7348 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.319496:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318976:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143760.319537:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143760.319573:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143760.319940:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7341 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.319953:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.319955:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.319962:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.319975:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.319983:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089fa00, rc 0) 00000100:00100000:2.0:1746143760.320007:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594084992:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 607us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.320012:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13159 00000100:00100000:3.0:1746143760.322389:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594318976:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143760.322413:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f364 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7348 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.322424:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f364 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7348 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.322440:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1400, rc 0) 00000100:00100000:3.0:1746143760.322885:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594085120:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 3457us (4706us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143760.322892:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13160 00000100:00100000:0.0:1746143760.332016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.332110:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594085376 00000100:00100000:3.0:1746143760.332119:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594085376 00000100:00100000:3.0:1746143760.332300:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9135 00000100:00100000:3.0:1746143760.332308:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31206:x1830963594085376:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143760.332324:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.332340:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a734f expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.332424:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.332443:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.332449:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143760.332804:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.333018:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594085504 00000100:00100000:2.0:1746143760.333022:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594085504 00000100:00100000:2.0:1746143760.333045:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13161 00000100:00100000:2.0:1746143760.333051:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31205:x1830963594085504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.333058:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.333068:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7356 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.333085:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.333092:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143760.333093:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143760.333096:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.333110:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.333120:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 16 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.333130:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594319232:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.333201:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bacf480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143760.333342:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.333352:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 16 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.333366:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594319104:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.333393:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.336137:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594319232:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.336190:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.336204:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089f800, rc 0) 00000100:00100000:2.0:1746143760.336255:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31205:x1830963594085504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3203us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.336263:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13161 00000100:00100000:0.0:1746143760.336474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.336608:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594319104:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.336622:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143760.336762:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594085760 00000100:00100000:2.0:1746143760.336767:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594085760 00010000:00010000:2.0:1746143760.336789:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 17 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.336807:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7025 00000100:00100000:2.0:1746143760.336813:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:1965:x1830963594085760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.336823:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.336828:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 17 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.336836:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 17 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.336853:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0e00/0xe984082ccd72f35d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a733a expref: 17 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.337045:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.337050:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.337059:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.337065:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.337299:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143760.337307:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.337313:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143760.337320:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963594085760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 507us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.337325:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7025 00000004:00200000:3.0:1746143760.337329:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143760.337448:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a734f expref: 17 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.337462:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a734f expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.337468:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.337470:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143760.337472:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1800, rc 0) 00000100:00100000:3.0:1746143760.337546:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31206:x1830963594085376:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 5238us (5539us total) trans 8589943442 rc 0/0 00000100:00100000:3.0:1746143760.337552:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9135 00000100:00100000:0.0:1746143760.337705:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.337768:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594085632 00000100:00100000:2.0:1746143760.337772:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594085632 00002000:00100000:2.0:1746143760.337794:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3342336->4104191) req@ffff880093cea680 x1830963594085632/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.337808:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cea680 with x1830963594085632 ext(3342336->4104191) 00010000:00010000:2.0:1746143760.337814:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 17 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.337825:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 17 pid: 4581 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.337831:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cea680 00000100:00100000:2.0:1746143760.337854:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1749 00000100:00100000:2.0:1746143760.337859:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594085632:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143760.340454:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.340553:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086016 00000100:00100000:3.0:1746143760.340561:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086016 00000100:00100000:3.0:1746143760.340611:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9136 00000100:00100000:3.0:1746143760.340617:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31206:x1830963594086016:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143760.340634:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.340637:0:14763:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143760.340656:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1800/0xe984082ccd72f379 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a734f expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.340669:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.340673:0:14763:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143760.340681:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f38e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a735d expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.340752:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.340761:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.340768:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143760.340776:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143760.340897:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f38e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 18 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.340908:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 17 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.340914:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.340916:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143760.340918:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1c00, rc 0) 00000100:00100000:3.0:1746143760.340962:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:31206:x1830963594086016:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 342us (512us total) trans 8589943443 rc 0/0 00000100:00100000:3.0:1746143760.340969:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9136 00000100:00100000:2.0:1746143760.344058:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.344590:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.344607:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.344630:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.344920:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086272 00000100:00100000:1.0:1746143760.344928:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086272 00000100:00100000:2.0:1746143760.344934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.344948:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086144 00000100:00100000:2.0:1746143760.344950:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086144 00000100:00100000:1.0:1746143760.344958:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086528 00000100:00100000:1.0:1746143760.344960:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086528 00000100:00100000:2.0:1746143760.344969:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086784 00000100:00100000:2.0:1746143760.344970:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086784 00000100:00100000:1.0:1746143760.344973:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086400 00000100:00100000:1.0:1746143760.344974:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086400 00000100:00100000:2.0:1746143760.344983:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13162 00000100:00100000:1.0:1746143760.344987:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13163 00000100:00100000:2.0:1746143760.344989:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594086272:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143760.344991:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594086144:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143760.345021:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.345021:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345035:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.345035:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.345041:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.345042:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.345048:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345049:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.345053:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.345054:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.345055:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.345055:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.345058:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.345058:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345081:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345081:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345090:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 25 pid: 4581 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.345091:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 12 pid: 2839 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.345101:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594319360:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.345101:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594319488:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.345164:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13164 00000100:00100000:1.0:1746143760.345168:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594086784:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143760.345172:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.345179:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 18 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.345183:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.345186:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594319616:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.345194:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143760.345197:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.345202:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143760.345204:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345208:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345214:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 26 pid: 4582 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.345219:0:12618:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.345220:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594319744:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.345228:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.345249:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.345263:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13165 00010000:00010000:1.0:1746143760.345263:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143760.345267:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594086400:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143760.345269:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 12 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.345277:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594320000:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.345281:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345289:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345299:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345299:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345306:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345306:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 15 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.345312:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.345313:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.345315:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.345317:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594320128:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.345326:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143760.345328:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00010000:00010000:2.0:1746143760.345332:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 12 pid: 2839 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.345339:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594320256:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.345350:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13166 00000100:00100000:1.0:1746143760.345354:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594086528:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143760.345359:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.345365:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 18 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.345367:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.345372:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594320384:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.345375:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.345381:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345387:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345392:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.345393:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.345395:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345402:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345409:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.345411:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143760.345415:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594320512:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.345418:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 25 pid: 8497 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.345425:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.345426:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594320640:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.345442:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.345448:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 12 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.345454:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.345455:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594320768:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.345467:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086656 00000100:00100000:2.0:1746143760.345469:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086656 00010000:00010000:1.0:1746143760.345471:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.345478:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.345484:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13167 00000100:00100000:1.0:1746143760.345484:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594320896:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.345488:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594086656:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143760.345495:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f53c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143760.345500:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345508:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345515:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.345521:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345526:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.345527:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.345529:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345543:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345549:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 25 pid: 9527 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.345557:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594321024:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.345577:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.345583:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 13 pid: 9527 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.345589:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594321152:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.345606:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.345613:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 15 pid: 9527 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.345619:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594321280:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.345628:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.350163:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594319360:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.350231:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594319744:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.350242:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594319488:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.350247:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594319616:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.350250:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594320000:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.350257:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594320128:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.350271:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.350273:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.350400:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594321024:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.350408:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594321152:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143760.350408:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.350414:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594321280:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.350425:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.350456:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594320640:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.350463:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594320768:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.350468:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594320896:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.350479:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.350842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.350916:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594086912 00000100:00100000:1.0:1746143760.350921:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594086912 00010000:00010000:1.0:1746143760.350946:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 13 pid: 2839 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.350973:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087040 00000100:00100000:1.0:1746143760.350976:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087040 00010000:00010000:1.0:1746143760.350985:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 14 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.350995:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7026 00000100:00100000:1.0:1746143760.350998:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7027 00000100:00100000:3.0:1746143760.351002:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1962:x1830963594086912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143760.351002:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1963:x1830963594087040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.351012:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.351012:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.351028:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 13 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.351028:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 14 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.351037:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 13 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.351037:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 14 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.351055:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014de00/0xe984082ccd72f2bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72df expref: 13 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.351055:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009089fa00/0xe984082ccd72f36b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7341 expref: 14 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.351066:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143760.351076:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.351095:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963594087040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.351102:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7027 00000100:00100000:2.0:1746143760.351799:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594320256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.351810:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594320384:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.351817:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594320512:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.351835:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.352258:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594085632:12345-192.168.202.48@tcp:4:cat.0 Request processed in 14397us (14552us total) trans 17179873055 rc 0/0 00000100:00100000:3.0:1746143760.352259:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594086912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1257us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.352265:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1749 00000100:00100000:3.0:1746143760.352266:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7026 00002000:00100000:2.0:1746143760.352273:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3342336->4104191) req@ffff880093cea680 x1830963594085632/t17179873055(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.352281:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cea680 with x1830963594085632 ext(3342336->4104191) 00010000:00010000:2.0:1746143760.352288:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 19 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.352298:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 19 pid: 4581 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.352304:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cea680 00000100:00100000:0.0:1746143760.353981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.354040:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087552 00000100:00100000:3.0:1746143760.354046:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087552 00010000:00010000:3.0:1746143760.354075:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 19 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.354110:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7028 00000100:00100000:3.0:1746143760.354116:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594087552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.354129:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.354169:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 19 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.354178:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 19 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.354195:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f317 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7309 expref: 19 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:3.0:1746143760.354206:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143760.354261:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594087552:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 145us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.354267:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7028 00000100:00100000:0.0:1746143760.357438:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.357642:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594088192 00000100:00100000:2.0:1746143760.357648:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594088192 00010000:00010000:2.0:1746143760.357674:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 13 pid: 9527 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.357823:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7029 00000100:00100000:2.0:1746143760.357831:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1962:x1830963594088192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.357841:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.357862:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 13 pid: 9527 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.357872:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 13 pid: 9527 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.357891:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72f196 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a723e expref: 13 pid: 9527 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.358417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.358431:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087296 00000100:00100000:3.0:1746143760.358434:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087296 00010000:00010000:3.0:1746143760.358448:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 16 pid: 8495 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.358463:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7030 00000100:00100000:3.0:1746143760.358467:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594087296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.358474:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.358483:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 16 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.358491:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 16 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.358501:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6093c00/0xe984082ccd72f32c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a731e expref: 16 pid: 8495 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.358512:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143760.358554:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594087296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.358560:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7030 00010000:00010000:2.0:1746143760.358681:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.358700:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594088192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 870us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.358706:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7029 00000100:00100000:0.0:1746143760.358863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.358968:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.358982:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.358994:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.359023:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.359035:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.359045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.359054:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.359076:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.359084:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087680 00000100:00100000:2.0:1746143760.359088:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087680 00010000:00010000:2.0:1746143760.359101:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 18 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.359112:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087936 00000100:00100000:2.0:1746143760.359113:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087936 00010000:00010000:2.0:1746143760.359121:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 26 pid: 8497 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.359129:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087168 00000100:00100000:2.0:1746143760.359130:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087168 00010000:00010000:2.0:1746143760.359151:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 27 pid: 4582 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.359161:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087424 00000100:00100000:2.0:1746143760.359163:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087424 00010000:00010000:2.0:1746143760.359170:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 12 pid: 2839 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.359177:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594087808 00000100:00100000:2.0:1746143760.359183:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594087808 00010000:00010000:2.0:1746143760.359190:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 12 pid: 8495 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.359197:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594088064 00000100:00100000:2.0:1746143760.359199:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594088064 00000100:00100000:1.0:1746143760.359205:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594088320 00010000:00010000:2.0:1746143760.359206:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.359210:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594088320 00000100:00100000:2.0:1746143760.359213:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594088448 00000100:00100000:2.0:1746143760.359215:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594088448 00010000:00010000:2.0:1746143760.359223:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 28 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.359224:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 27 pid: 4581 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.359230:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594088576 00000100:00100000:2.0:1746143760.359241:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594088576 00000100:00100000:1.0:1746143760.359245:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7031 00010000:00010000:2.0:1746143760.359248:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 19 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.359250:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594087680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.359258:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143760.359259:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7032 00000100:00100000:2.0:1746143760.359263:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594087936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.359271:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 19 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.359272:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.359279:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 19 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.359283:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 27 pid: 8497 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.359290:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 27 pid: 8497 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359292:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6093a00/0xe984082ccd72f31e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7310 expref: 19 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.359301:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd72f261 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ae expref: 27 pid: 8497 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359302:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143760.359309:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.359323:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594087680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.359328:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594087936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.359329:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7031 00000100:00100000:2.0:1746143760.359334:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7032 00000100:00100000:1.0:1746143760.359341:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7033 00000100:00100000:1.0:1746143760.359346:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594087168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.359352:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.359361:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 28 pid: 4582 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.359364:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7034 00000100:00100000:2.0:1746143760.359368:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594087424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.359368:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 28 pid: 4582 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.359373:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.359380:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014c200/0xe984082ccd72f268 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72b5 expref: 28 pid: 4582 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.359384:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 12 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359388:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.359390:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.359392:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 12 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359394:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359401:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359402:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a014ce00/0xe984082ccd72f2c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72e6 expref: 12 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.359414:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143760.359420:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.359426:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594087424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.359431:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7034 00010000:00010000:1.0:1746143760.359432:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359439:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7035 00010000:00010000:1.0:1746143760.359439:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359444:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594087808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.359448:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.359454:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 12 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359456:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359461:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 12 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359463:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359469:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359471:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729a00/0xe984082ccd72f2ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72ed expref: 12 pid: 8495 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359474:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009089f000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143760.359477:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359479:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143760.359483:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359491:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359494:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594087808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (470us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143760.359496:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009089f000/0xe984082ccd72f3aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359499:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7035 00000100:00100000:2.0:1746143760.359506:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7036 00000100:00100000:2.0:1746143760.359510:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594088064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.359514:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.359520:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.359527:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.359530:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594086272:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 14541us (15479us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143760.359536:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014d200/0xe984082ccd72f214 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a728b expref: 15 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.359537:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13162 00010000:00010000:2.0:1746143760.359544:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.359546:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.359548:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359554:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.359563:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594087168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 217us (579us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143760.359567:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.359568:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7033 00000100:00100000:1.0:1746143760.359577:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7037 00000100:00100000:2.0:1746143760.359579:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594088064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.359582:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594088448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143760.359584:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7036 00010000:00010000:1.0:1746143760.359588:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143760.359593:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7038 00010000:00010000:1.0:1746143760.359595:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.359597:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594088320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.359603:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.359606:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.359613:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 25 pid: 4581 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359614:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f81a600/0xe984082ccd72f276 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a72c3 expref: 26 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.359620:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 25 pid: 4581 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359621:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.359622:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.359625:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359629:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f33a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a732c expref: 25 pid: 4581 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.359630:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359636:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.359637:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.359640:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359644:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143760.359646:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359654:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359657:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143760.359661:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359668:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594088320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.359672:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7038 00010000:00010000:1.0:1746143760.359677:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359680:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7039 00010000:00010000:1.0:1746143760.359682:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359684:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594088576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.359687:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359689:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.359691:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009089e200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143760.359694:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359696:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 17 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.359699:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359703:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 17 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.359707:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359711:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f333 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3342336->4104191) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7325 expref: 17 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.359711:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009089e200/0xe984082ccd72f3b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359722:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.359723:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.359728:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359734:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.359738:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594086400:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 14470us (14803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.359743:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13165 00010000:00010000:2.0:1746143760.359753:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359760:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.359762:0:7149:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.359766:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359772:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594321408:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143760.359777:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359783:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359788:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359792:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a014da00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143760.359795:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359800:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.359801:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e910c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143760.359808:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359813:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a014da00/0xe984082ccd72f3a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.359841:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594086144:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 14850us (15252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.359847:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13163 00010000:00010000:1.0:1746143760.359863:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359869:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359880:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359885:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359890:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359895:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b51ad400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143760.359897:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359902:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359909:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.359914:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f3bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.359935:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594086528:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 14580us (15327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.359940:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13166 00000100:00100000:1.0:1746143760.359957:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594088448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 375us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.359961:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7037 00000100:00100000:0.0:1746143760.362247:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.362879:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.363068:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594088704 00000100:00100000:3.0:1746143760.363075:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594088704 00010000:00010000:3.0:1746143760.363104:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 24 pid: 9527 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.363166:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594088832 00000100:00100000:3.0:1746143760.363170:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594088832 00010000:00010000:3.0:1746143760.363181:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.363198:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7040 00000100:00100000:3.0:1746143760.363203:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594088704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.363213:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.363241:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 24 pid: 9527 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.363251:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 24 pid: 9527 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.363269:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13200/0xe984082ccd72f000 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7173 expref: 24 pid: 9527 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.363281:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143760.363315:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594088704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 111us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.363320:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7040 00000100:00100000:3.0:1746143760.363333:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7041 00000100:00100000:3.0:1746143760.363337:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594088832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.363343:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.363351:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.363359:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.363370:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a2211800/0xe984082ccd72eff2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7165 expref: 14 pid: 9527 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.363378:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.363379:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.363382:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363389:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363406:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143760.363421:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594088832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.363427:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7041 00010000:00010000:3.0:1746143760.363445:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363452:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363470:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363477:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363484:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363489:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f192800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143760.363492:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363498:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363508:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.363513:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f192800/0xe984082ccd72f3c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.363547:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594086656:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 18058us (18092us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.363554:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13167 00000100:00100000:0.0:1746143760.365174:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.365269:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594089088 00000100:00100000:3.0:1746143760.365273:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594089088 00002000:00100000:3.0:1746143760.365302:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a0a97b80 x1830963594089088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143760.365513:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594321408:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143760.365527:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.365563:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594088576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5877us (6485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.365570:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7039 00002000:00100000:3.0:1746143760.365644:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97b80 with x1830963594089088 ext(2097152->3145727) 00010000:00010000:3.0:1746143760.365651:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.365667:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.365674:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0a97b80 00000100:00100000:3.0:1746143760.365701:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1750 00000100:00100000:3.0:1746143760.365707:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594089088:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.377555:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594089088:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11840us (12375us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.377564:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1750 00002000:00100000:3.0:1746143760.377575:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a0a97b80 x1830963594089088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.377584:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97b80 with x1830963594089088 ext(2097152->3145727) 00010000:00010000:3.0:1746143760.377593:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.377861:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.377869:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0a97b80 00000100:00100000:0.0:1746143760.383294:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.383390:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.383486:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594089216 00000100:00100000:3.0:1746143760.383494:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594089216 00000100:00100000:3.0:1746143760.383541:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13168 00000100:00100000:3.0:1746143760.383547:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31205:x1830963594089216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.383563:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.383579:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7364 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143760.383598:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4755392, mtime: 0x68140a0e, atime: 0x68140a0e, ctime: 0x68140a0e, blocks: 0x1487 00010000:00010000:3.0:1746143760.383615:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.383617:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143760.383621:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594089344 00010000:00010000:3.0:1746143760.383624:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.383626:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594089344 00010000:00010000:3.0:1746143760.383635:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.383643:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1e00, rc 0) 00010000:00010000:2.0:1746143760.383646:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.383678:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31205:x1830963594089216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.383683:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13168 00000100:00100000:2.0:1746143760.385052:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7042 00000100:00100000:2.0:1746143760.385060:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594089344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.385070:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.385084:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.385094:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.385111:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009089f800/0xe984082ccd72f380 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7356 expref: 25 pid: 4581 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.385137:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.385152:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.385155:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.385162:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.387545:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.387603:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594089344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2539us (4208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.387612:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7042 00010000:00010000:1.0:1746143760.387673:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387682:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387708:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387715:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387721:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387726:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009513be00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143760.387729:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387736:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387749:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.387755:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009513be00/0xe984082ccd72f3b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.387821:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594086784:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 42651us (43189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.387837:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13164 00000100:00100000:0.0:1746143760.390459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.390496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.390521:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.390536:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.390546:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594089472 00000100:00100000:0.0:1746143760.390549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.390553:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594089472 00000100:00100000:0.0:1746143760.390560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.390574:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594089728 00000100:00100000:0.0:1746143760.390577:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594089728 00000100:00100000:3.0:1746143760.390596:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594089856 00000100:00100000:3.0:1746143760.390598:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594089856 00000100:00100000:0.0:1746143760.390694:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594089984 00000100:00100000:3.0:1746143760.390698:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594090112 00000100:00100000:0.0:1746143760.390698:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594089984 00000100:00100000:3.0:1746143760.390700:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594090112 00000100:00100000:0.0:1746143760.390712:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594090240 00000100:00100000:0.0:1746143760.390713:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594090240 00000100:00100000:3.0:1746143760.390719:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13169 00000100:00100000:3.0:1746143760.390725:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594089472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.390749:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.390765:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a736b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.390768:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13170 00000100:00100000:0.0:1746143760.390774:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594089728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143760.390782:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746143760.390785:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a0f, atime: 0x68140a0e, ctime: 0x68140a0f, blocks: 0x7a7 00010000:00010000:0.0:1746143760.390792:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7372 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.390802:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.390804:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746143760.390806:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a0f, atime: 0x68140a0f, ctime: 0x68140a0f, blocks: 0x81d 00010000:00010000:3.0:1746143760.390812:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 16 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.390814:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.390815:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.390819:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 19 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.390824:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 16 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.390828:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 19 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.390834:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1600, rc 0) 00010000:00010000:0.0:1746143760.390834:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f192600, rc 0) 00000100:00100000:0.0:1746143760.390865:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594089728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 91us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.390866:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594089472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 140us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.390871:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13170 00000100:00100000:3.0:1746143760.390875:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13169 00000100:00100000:0.0:1746143760.390887:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13171 00000100:00100000:3.0:1746143760.390895:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13172 00000100:00100000:0.0:1746143760.390896:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594089856:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143760.390900:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594089984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143760.390902:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.390905:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.390908:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7379 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.390911:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7380 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143760.390918:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a0f, atime: 0x68140a0f, ctime: 0x68140a0f, blocks: 0x821 00002000:00010000:3.0:1746143760.390920:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a0f, atime: 0x68140a0f, ctime: 0x68140a0f, blocks: 0x81f 00010000:00010000:0.0:1746143760.390924:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.390925:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.390927:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.390928:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.390929:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 19 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.390932:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 16 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.390936:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 19 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.390940:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 16 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.390941:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f192400, rc 0) 00010000:00010000:3.0:1746143760.390946:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0400, rc 0) 00000100:00100000:0.0:1746143760.390956:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594089856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 60us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.390961:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594089984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 61us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.390961:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13171 00000100:00100000:3.0:1746143760.390965:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13172 00000100:00100000:0.0:1746143760.390972:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13173 00000100:00100000:3.0:1746143760.390976:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13174 00000100:00100000:0.0:1746143760.390977:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594090112:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143760.390981:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594090240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143760.390982:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.390986:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.390988:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7387 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.390992:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a738e expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.390997:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.390999:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143760.391002:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a10, atime: 0x68140a0e, ctime: 0x68140a10, blocks: 0x1029 00010000:00010000:0.0:1746143760.391003:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.391009:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.391010:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.391010:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.391014:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143760.391016:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f193200, rc 0) 00010000:00010000:3.0:1746143760.391022:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.391028:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0e00, rc 0) 00000100:00100000:0.0:1746143760.391032:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594090112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 55us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.391036:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13173 00000100:00100000:3.0:1746143760.391045:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594090240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.391051:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13174 00000100:00100000:0.0:1746143760.391126:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.391321:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594090368 00000100:00100000:3.0:1746143760.391325:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594090368 00002000:00100000:3.0:1746143760.391349:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093f02a00 x1830963594090368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.391357:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02a00 with x1830963594090368 ext(3145728->4194303) 00002000:00010000:3.0:1746143760.391361:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02a00 00000100:00100000:3.0:1746143760.391378:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6166 00000100:00100000:3.0:1746143760.391383:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594090368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.395585:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.395793:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594090624 00000100:00100000:3.0:1746143760.395800:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594090624 00000100:00100000:3.0:1746143760.395840:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9137 00000100:00100000:3.0:1746143760.395847:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:31206:x1830963594090624:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143760.395889:0:14763:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.395911:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1da00/0xe984082ccd72efc8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a713b expref: 17 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.395929:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.395933:0:14763:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143760.395959:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.395969:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.395976:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 22 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.395983:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.395988:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 22 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.395994:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 22 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.395999:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.396006:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 9/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.396027:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.396036:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 258 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.396066:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321536:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.396153:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 22 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.396161:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 22 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.396173:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.396195:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 22 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.396202:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 22 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.396208:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.396225:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 258 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.396242:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 258 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.396249:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321920:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.396270:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 22 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.396276:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 22 pid: 20509 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.396282:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594322048:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.396300:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 258 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.396310:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 258 pid: 21713 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.396316:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594322176:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.396329:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.398779:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.399490:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594090880 00000100:00100000:2.0:1746143760.399499:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594090880 00000100:00100000:2.0:1746143760.399546:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9138 00000100:00100000:2.0:1746143760.399553:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31212:x1830963594090880:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143760.399572:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.399586:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094603200/0xe984082ccd72f405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7395 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.406113:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.406719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.406760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.406785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.406799:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594091264 00000100:00100000:1.0:1746143760.406800:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594091392 00000100:00100000:3.0:1746143760.406806:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594091264 00000100:00100000:1.0:1746143760.406806:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594091392 00002000:00100000:1.0:1746143760.406840:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800930dd180 x1830963594091392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.406848:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd180 with x1830963594091392 ext(1048576->2097151) 00002000:00010000:1.0:1746143760.406853:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dd180 00000100:00100000:0.0:1746143760.406854:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.406867:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594091776 00000100:00100000:0.0:1746143760.406867:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.406869:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594091776 00002000:00100000:1.0:1746143760.406880:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800930dea00 x1830963594091776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143760.406881:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092032 00000100:00100000:0.0:1746143760.406884:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092032 00002000:00100000:1.0:1746143760.406885:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dea00 with x1830963594091776 ext(1048576->2097151) 00002000:00010000:1.0:1746143760.406887:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dea00 00000100:00100000:1.0:1746143760.406894:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594091648 00000100:00100000:1.0:1746143760.406896:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594091648 00010000:00010000:0.0:1746143760.406901:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 261 pid: 14763 timeout: 939 lvb_type: 0 00002000:00100000:1.0:1746143760.406904:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930dd500 x1830963594091648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.406914:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd500 with x1830963594091648 ext(1048576->2097151) 00002000:00010000:1.0:1746143760.406916:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dd500 00000100:00100000:0.0:1746143760.406917:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092160 00000100:00100000:0.0:1746143760.406919:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092160 00000100:00100000:1.0:1746143760.406926:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6167 00010000:00010000:0.0:1746143760.406927:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 23 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.406932:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963594091392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.406948:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7043 00000100:00100000:0.0:1746143760.406953:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1962:x1830963594092032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.406962:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.406967:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 261 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.406976:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 261 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.406993:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.406997:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407004:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.407036:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1962:x1830963594092032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.407042:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7043 00000100:00100000:0.0:1746143760.407056:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7044 00000100:00100000:0.0:1746143760.407061:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594092160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.407066:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.407070:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 23 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407077:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 23 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407089:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.407092:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407096:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.407108:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594092160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.407113:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7044 00000100:00100000:0.0:1746143760.407155:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.407194:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.407203:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092416 00000100:00100000:0.0:1746143760.407205:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092416 00010000:00010000:0.0:1746143760.407215:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 261 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.407227:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092544 00000100:00100000:0.0:1746143760.407229:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092544 00010000:00010000:0.0:1746143760.407248:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 23 pid: 20509 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.407259:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7045 00000100:00100000:0.0:1746143760.407263:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1962:x1830963594092416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.407270:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.407273:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 261 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407280:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 261 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407289:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.407292:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407297:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.407310:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1962:x1830963594092416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.407314:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7045 00000100:00100000:0.0:1746143760.407323:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7046 00000100:00100000:0.0:1746143760.407328:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594092544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.407333:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.407337:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 23 pid: 20509 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407344:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 23 pid: 20509 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407352:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.407355:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407359:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.407371:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594092544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.407375:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7046 00000100:00100000:0.0:1746143760.407426:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.407458:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.407468:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092288 00000100:00100000:0.0:1746143760.407470:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092288 00010000:00010000:0.0:1746143760.407479:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 23 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.407487:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092672 00000100:00100000:0.0:1746143760.407489:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092672 00010000:00010000:0.0:1746143760.407494:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 261 pid: 21713 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.407501:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7047 00000100:00100000:0.0:1746143760.407505:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594092288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.407510:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.407513:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 23 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407520:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 23 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407528:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.407531:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407535:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.407548:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594092288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.407552:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7047 00000100:00100000:0.0:1746143760.407561:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7048 00000100:00100000:0.0:1746143760.407565:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1964:x1830963594092672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.407570:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.407573:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 261 pid: 21713 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407581:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 261 pid: 21713 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.407589:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.407591:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407598:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407604:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14763 initiator: MDT0 00010000:00010000:0.0:1746143760.407616:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.407628:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1964:x1830963594092672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.407633:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7048 00000100:00100000:2.0:1746143760.407705:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6168 00000100:00100000:2.0:1746143760.407713:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594091776:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143760.407986:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6169 00000100:00100000:1.0:1746143760.407991:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594091648:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:3.0:1746143760.408510:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093f02680 x1830963594091264/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.408518:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02680 with x1830963594091264 ext(0->1048575) 00002000:00010000:3.0:1746143760.408522:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02680 00000100:00100000:3.0:1746143760.408543:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6170 00000100:00100000:3.0:1746143760.408550:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594091264:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143760.408860:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594090368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17476us (17733us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.408866:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6166 00002000:00100000:2.0:1746143760.408872:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093f02a00 x1830963594090368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.408879:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02a00 with x1830963594090368 ext(3145728->4194303) 00002000:00010000:2.0:1746143760.408882:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02a00 00010000:00010000:3.0:1746143760.409538:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745400/0xe984082ccd72f12d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a720d expref: 260 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.409561:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321536:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.409572:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090745a00/0xe984082ccd72f10a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7206 expref: 22 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.409580:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.409589:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090671e00/0xe984082ccd72f07e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a71a4 expref: 21 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.409601:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.409609:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090670e00/0xe984082ccd72f069 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a719d expref: 259 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.409616:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594321920:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.409626:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c1c800/0xe984082ccd72ef66 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70d9 expref: 20 pid: 20509 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.409633:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594322048:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.409641:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a71e9a00/0xe984082ccd72eed3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a70af expref: 258 pid: 21713 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.409648:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594322176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.409669:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.409676:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.409681:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000040:00080000:3.0:1746143760.410175:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2641, 88 off222944 00000004:00080000:3.0:1746143760.410182:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420041904ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410227:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2662, 88 off224968 00000004:00080000:3.0:1746143760.410241:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420100998ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.410265:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2663, 88 off225056 00000004:00080000:3.0:1746143760.410268:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420128079ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.410274:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2642, 88 off223032 00000004:00080000:3.0:1746143760.410277:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420137193ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410282:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2643, 88 off223120 00000004:00080000:3.0:1746143760.410284:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420144784ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410290:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2664, 88 off225144 00000004:00080000:3.0:1746143760.410292:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420152003ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.410297:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2665, 88 off225232 00000004:00080000:3.0:1746143760.410299:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420159728ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.410305:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2666, 88 off225320 00000004:00080000:3.0:1746143760.410306:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420166886ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.410312:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2644, 88 off223208 00000004:00080000:3.0:1746143760.410315:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420175404ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410320:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2667, 88 off225408 00000004:00080000:3.0:1746143760.410322:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420182973ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.410327:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2645, 88 off223296 00000004:00080000:3.0:1746143760.410329:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420189948ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410335:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2668, 88 off225496 00000004:00080000:3.0:1746143760.410337:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420197224ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.410342:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2646, 88 off223384 00000004:00080000:3.0:1746143760.410344:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420204123ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410349:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2647, 88 off223472 00000004:00080000:3.0:1746143760.410351:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420211523ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410356:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2648, 88 off223560 00000004:00080000:3.0:1746143760.410358:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420218663ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410363:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2649, 88 off223648 00000004:00080000:3.0:1746143760.410366:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839420226248ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.410371:0:14763:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2669, 88 off225584 00000004:00080000:3.0:1746143760.410373:0:14763:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839420233936ns, next at 833304778357ns, rc = 0 00000100:00100000:0.0:1746143760.426198:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.427000:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594091392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20065us (20278us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143760.427009:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6167 00002000:00100000:1.0:1746143760.427020:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800930dd180 x1830963594091392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.427028:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd180 with x1830963594091392 ext(1048576->2097151) 00002000:00010000:1.0:1746143760.427032:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dd180 00000100:00100000:2.0:1746143760.427105:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092800 00000100:00100000:2.0:1746143760.427110:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092800 00000100:00100000:2.0:1746143760.427164:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13175 00000100:00100000:2.0:1746143760.427171:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31205:x1830963594092800:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.427184:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.427197:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a739c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.427217:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.427218:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.427224:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.427247:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.427255:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094603c00, rc 0) 00000100:00100000:2.0:1746143760.427272:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31205:x1830963594092800:12345-192.168.202.48@tcp:101:cat.0 Request processed in 102us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.427278:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13175 00000100:00100000:1.0:1746143760.433242:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594091776:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25513us (26463us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143760.433253:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6168 00002000:00100000:1.0:1746143760.433264:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800930dea00 x1830963594091776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.433273:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dea00 with x1830963594091776 ext(1048576->2097151) 00002000:00010000:1.0:1746143760.433278:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dea00 00000100:00100000:0.0:1746143760.437648:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594091648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29647us (30852us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143760.437658:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6169 00002000:00100000:0.0:1746143760.437667:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930dd500 x1830963594091648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.437675:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd500 with x1830963594091648 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.437681:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dd500 00000100:00100000:1.0:1746143760.440526:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.440550:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594092928 00000100:00100000:1.0:1746143760.440557:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594092928 00000100:00100000:1.0:1746143760.440592:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9139 00000100:00100000:1.0:1746143760.440599:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:31205:x1830963594092928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.440613:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.440627:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73a3 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.440674:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143760.440682:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 259 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.440695:0:20509:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143760.440706:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 259 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.440716:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143760.440719:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143760.440722:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 259 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.440728:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf81000, rc 0) 00000100:00100000:1.0:1746143760.440763:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31205:x1830963594092928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 164us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.440768:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9139 00000100:00100000:3.0:1746143760.441165:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594091264:12345-192.168.202.48@tcp:3:cat.0 Request processed in 32615us (35058us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.441172:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6170 00002000:00100000:3.0:1746143760.441180:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093f02680 x1830963594091264/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.441189:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02680 with x1830963594091264 ext(0->1048575) 00002000:00010000:3.0:1746143760.441193:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02680 00000100:00100000:0.0:1746143760.446512:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.446709:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594093056 00000100:00100000:1.0:1746143760.446716:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594093056 00000100:00100000:1.0:1746143760.446808:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9140 00000100:00100000:1.0:1746143760.446815:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31211:x1830963594093056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.446831:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.446844:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73aa expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.446889:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73aa expref: 21 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.446898:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73aa expref: 21 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.446908:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143760.446911:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143760.446914:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 258 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.446920:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf81800, rc 0) 00000100:00100000:1.0:1746143760.446954:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31211:x1830963594093056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 140us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.446959:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9140 00000004:00010000:2.0:1746143760.448640:0:14763:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093f01180 reply state ffff8800a578e000 transno 8589943444 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000001:00080000:0.0:1746143760.448647:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943427 is committed 00000100:00100000:2.0:1746143760.448649:0:14763:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746143760.448669:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943405 is committed 00000001:00080000:0.0:1746143760.448674:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943441 is committed 00000001:00080000:0.0:1746143760.448677:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943440 is committed 00000001:00080000:0.0:1746143760.448686:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943431 is committed 00000100:00100000:2.0:1746143760.448717:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31206:x1830963594090624:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 52869us (53137us total) trans 8589943444 rc 0/0 00000001:00080000:0.0:1746143760.448721:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943444 is committed 00000100:00100000:2.0:1746143760.448723:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9137 00000004:00080000:0.0:1746143760.448724:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2005 committed 00010000:00010000:3.0:1746143760.448784:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00000004:00080000:0.0:1746143760.448798:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1985 committed 00010000:00010000:3.0:1746143760.448799:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.448805:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x12 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00000004:00080000:0.0:1746143760.448810:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1984 committed 00000004:00080000:0.0:1746143760.448811:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1983 committed 00000004:00080000:0.0:1746143760.448812:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1982 committed 00000004:00080000:0.0:1746143760.448813:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2004 committed 00000004:00080000:0.0:1746143760.448815:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1981 committed 00000004:00080000:0.0:1746143760.448816:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2003 committed 00000004:00080000:0.0:1746143760.448817:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1980 committed 00000004:00080000:0.0:1746143760.448818:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2002 committed 00000004:00080000:0.0:1746143760.448820:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2001 committed 00000004:00080000:0.0:1746143760.448821:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2000 committed 00000004:00080000:0.0:1746143760.448822:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1979 committed 00000004:00080000:0.0:1746143760.448823:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1978 committed 00000004:00080000:0.0:1746143760.448825:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1999 committed 00000004:00080000:0.0:1746143760.448826:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1998 committed 00000004:00080000:0.0:1746143760.448827:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1977 committed 00010000:00010000:3.0:1746143760.448829:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.448839:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 10 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.448848:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594322304:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.448897:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.448953:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594322432:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143760.448971:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.448977:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143760.448981:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143760.448983:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.448987:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03f0c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.448990:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143760.448995:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594322944:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143760.448996:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.449006:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00000100:00100000:2.0:1746143760.449007:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143760.449009:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143760.449013:0:3278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.449017:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:3.0:1746143760.449020:0:3278:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.449021:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594322816:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143760.449026:0:3278:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.449032:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143760.449034:0:3278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73aa expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.449039:0:3278:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73aa expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.449423:0:3278:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73aa expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.449441:0:3278:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73aa expref: 6 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.449449:0:3278:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594324480:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143760.449483:0:3278:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.449491:0:3278:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594324608:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143760.449507:0:3278:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.449517:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594322688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.449522:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594323328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143760.449532:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.449537:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594323840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143760.449551:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594323200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.449557:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143760.449568:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322432 00000100:00100000:2.0:1746143760.449569:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594324352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143760.449572:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322432 00000100:00100000:2.0:1746143760.449590:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143760.449599:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322944 00000100:00100000:3.0:1746143760.449601:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322944 00000100:00100000:2.0:1746143760.449602:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143760.449606:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594323456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143760.449609:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322816 00000100:00100000:3.0:1746143760.449610:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322816 00000100:00100000:3.0:1746143760.449618:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322688 00000100:00100000:3.0:1746143760.449620:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322688 00000100:00100000:2.0:1746143760.449620:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143760.449628:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323840 00000100:00100000:2.0:1746143760.449629:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594323968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143760.449630:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323840 00000100:00100000:3.0:1746143760.449641:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324352 00000100:00100000:3.0:1746143760.449642:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324352 00000100:00100000:3.0:1746143760.449649:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323456 00000100:00100000:3.0:1746143760.449650:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323456 00000100:00100000:2.0:1746143760.449650:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143760.449655:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323968 00000100:00100000:3.0:1746143760.449657:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323968 00000100:00100000:2.0:1746143760.449663:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594322560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143760.449669:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13176 00000100:00100000:3.0:1746143760.449675:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3293:x1830963594322432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.449677:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.449683:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594323072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.449694:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.449699:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594323584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143760.449710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.449716:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594324096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143760.449727:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.449744:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322560 00000100:00100000:2.0:1746143760.449747:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322560 00000100:00100000:2.0:1746143760.449758:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323072 00000100:00100000:2.0:1746143760.449759:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323072 00000100:00100000:2.0:1746143760.449765:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323584 00000100:00100000:2.0:1746143760.449766:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323584 00000100:00100000:2.0:1746143760.449772:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324096 00000100:00100000:2.0:1746143760.449773:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324096 00000100:00100000:2.0:1746143760.449781:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13177 00000100:00100000:2.0:1746143760.449785:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963594322944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143760.449939:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13178 00000100:00100000:1.0:1746143760.449946:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963594322816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143760.450075:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3293:x1830963594322816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (1041us total) trans 21474840378 rc 0/0 00000100:00100000:1.0:1746143760.450081:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13178 00000100:00100000:1.0:1746143760.450092:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13179 00000100:00100000:1.0:1746143760.450096:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594322688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143760.450184:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:1.0:1746143760.450187:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:1.0:1746143760.450188:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:1.0:1746143760.450190:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:1.0:1746143760.450192:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5255 00000100:00100000:1.0:1746143760.450210:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3295:x1830963594322688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (678us total) trans 21474840379 rc 0/0 00000100:00100000:1.0:1746143760.450215:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13179 00000100:00100000:1.0:1746143760.450224:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13180 00000100:00100000:1.0:1746143760.450228:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963594323840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143760.450316:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143760.450319:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143760.450320:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143760.450322:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143760.450323:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143760.450345:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963594323840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (787us total) trans 17179873056 rc 0/0 00000100:00100000:1.0:1746143760.450349:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13180 00000100:00100000:1.0:1746143760.450358:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13181 00000100:00100000:1.0:1746143760.450362:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963594324352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143760.450431:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963594324352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (850us total) trans 17179873057 rc 0/0 00000100:00100000:1.0:1746143760.450436:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13181 00000100:00100000:1.0:1746143760.450444:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13182 00000100:00100000:1.0:1746143760.450448:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963594323456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143760.450512:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143760.450515:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450516:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450518:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450520:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746143760.450537:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963594323456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (916us total) trans 17179873058 rc 0/0 00000100:00100000:1.0:1746143760.450542:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13182 00000100:00100000:1.0:1746143760.450551:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13183 00000100:00100000:1.0:1746143760.450555:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963594323968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143760.450626:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963594323968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (974us total) trans 17179873059 rc 0/0 00000100:00100000:1.0:1746143760.450630:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13183 00000100:00100000:1.0:1746143760.450643:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13184 00000100:00100000:1.0:1746143760.450647:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963594322560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143760.450708:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143760.450711:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450713:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450714:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450716:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143760.450736:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3294:x1830963594322560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (1058us total) trans 21474840380 rc 0/0 00000100:00100000:1.0:1746143760.450741:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13184 00000100:00100000:1.0:1746143760.450751:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13185 00000100:00100000:1.0:1746143760.450754:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963594323072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143760.450820:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3294:x1830963594323072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1125us total) trans 21474840381 rc 0/0 00000100:00100000:1.0:1746143760.450825:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13185 00000100:00100000:1.0:1746143760.450833:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13186 00000100:00100000:1.0:1746143760.450837:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963594323584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143760.450897:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143760.450899:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450900:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450902:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:1.0:1746143760.450904:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143760.450920:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594323584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (1208us total) trans 17179873060 rc 0/0 00000100:00100000:1.0:1746143760.450924:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13186 00000100:00100000:1.0:1746143760.450932:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13187 00000100:00100000:1.0:1746143760.450936:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963594324096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143760.451001:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594324096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1272us total) trans 17179873061 rc 0/0 00000100:00100000:1.0:1746143760.451005:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13187 00000100:00100000:2.0:1746143760.451024:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3293:x1830963594322944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1239us (2017us total) trans 21474840382 rc 0/0 00000100:00100000:2.0:1746143760.451029:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13177 00000004:00080000:2.0:1746143760.451064:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0700/2, rc 0, transno 21474840380 00000100:00100000:2.0:1746143760.451071:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594322560:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143760.451284:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143760.451287:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:3.0:1746143760.451289:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:3.0:1746143760.451290:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:3.0:1746143760.451292:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 1959 -> 1959 00000100:00100000:3.0:1746143760.451810:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3293:x1830963594322432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2135us (2828us total) trans 21474840383 rc 0/0 00000100:00100000:3.0:1746143760.451815:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13176 00000100:00100000:3.0:1746143760.451908:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:3.0:1746143760.451926:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143760.451930:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143760.451953:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143760.451985:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594323712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.451989:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323200 00000100:00100000:0.0:1746143760.451994:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323200 00000100:00100000:3.0:1746143760.452006:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.452011:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323712 00000100:00100000:0.0:1746143760.452013:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323712 00000100:00100000:3.0:1746143760.452017:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594324224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.452022:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13188 00000100:00100000:0.0:1746143760.452026:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3295:x1830963594323200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143760.452029:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143760.452047:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0000/2, rc 0, transno 21474840379 00000100:00100000:3.0:1746143760.452050:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594322688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143760.452063:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324224 00000100:00100000:3.0:1746143760.452065:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324224 00000100:00100000:3.0:1746143760.452077:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13189 00000100:00100000:3.0:1746143760.452081:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594323712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.452113:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3295:x1830963594323200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (159us total) trans 21474840384 rc 0/0 00000100:00100000:0.0:1746143760.452118:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13188 00000100:00100000:0.0:1746143760.452127:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13190 00000100:00100000:0.0:1746143760.452130:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594324224:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.452164:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2d80/2, rc 0, transno 21474840384 00002000:00010000:3.0:1746143760.452166:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746143760.452168:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594323200:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143760.452169:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:3.0:1746143760.452170:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:3.0:1746143760.452172:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143760 -> 1746143760 00002000:00010000:3.0:1746143760.452174:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143760.452193:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963594323712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (186us total) trans 17179873062 rc 0/0 00000100:00100000:3.0:1746143760.452198:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13189 00000100:00100000:3.0:1746143760.452220:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594322304:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.452248:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x12 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143760.452253:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963594324224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (223us total) trans 17179873063 rc 0/0 00000100:00100000:0.0:1746143760.452258:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13190 00000004:00080000:0.0:1746143760.452275:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e17c700/2, rc 0, transno 17179873062 00000100:00100000:0.0:1746143760.452279:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594323712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.452285:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e17d500/2, rc 0, transno 17179873063 00000100:00100000:0.0:1746143760.452287:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594324224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143760.452491:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d3100/2, rc 0, transno 21474840381 00000100:00100000:2.0:1746143760.452495:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594323072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.452504:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cdc3100/2, rc 0, transno 17179873060 00000100:00100000:2.0:1746143760.452506:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594323584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143760.452512:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e17e300/2, rc 0, transno 17179873061 00000100:00100000:2.0:1746143760.452514:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594324096:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143760.452586:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cdc2d80/2, rc 0, transno 17179873058 00000100:00100000:2.0:1746143760.452590:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594323456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143760.452595:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e17df80/2, rc 0, transno 17179873059 00000100:00100000:2.0:1746143760.452597:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594323968:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143760.452603:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e17ca80/2, rc 0, transno 17179873056 00000100:00100000:2.0:1746143760.452605:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594323840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143760.452611:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878700/2, rc 0, transno 17179873057 00000100:00100000:2.0:1746143760.452613:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594324352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143760.452669:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594093184 00000100:00100000:2.0:1746143760.452672:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594093184 00000100:00100000:0.0:1746143760.452797:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143760.452804:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594324736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143760.452825:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.452926:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9141 00000100:00100000:2.0:1746143760.452932:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31206:x1830963594093184:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143760.452945:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.452955:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73b1 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.452993:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.453004:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.453017:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.453019:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143760.453022:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba27400, rc 0) 00000100:00100000:2.0:1746143760.453057:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31206:x1830963594093184:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 124us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.453062:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9141 00000100:00100000:2.0:1746143760.455183:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143760.455219:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe3b80/2, rc 0, transno 21474840383 00000100:00100000:2.0:1746143760.455224:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594322432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.455245:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe1180/2, rc 0, transno 21474840382 00000100:00100000:2.0:1746143760.455248:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594322944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.455258:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0a80/2, rc 0, transno 21474840378 00000100:00100000:2.0:1746143760.455261:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594322816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143760.455485:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324736 00000100:00100000:1.0:1746143760.455491:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324736 00000100:00100000:1.0:1746143760.455519:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323328 00000100:00100000:1.0:1746143760.455521:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323328 00000100:00100000:1.0:1746143760.455536:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13191 00000100:00100000:1.0:1746143760.455541:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594324736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143760.455729:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3292:x1830963594324736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (2903us total) trans 21474840385 rc 0/0 00000100:00100000:1.0:1746143760.455735:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13191 00000100:00100000:1.0:1746143760.455746:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13192 00000100:00100000:1.0:1746143760.455750:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3293:x1830963594323328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143760.455819:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3293:x1830963594323328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (639us total) trans 21474840386 rc 0/0 00000100:00100000:1.0:1746143760.455824:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13192 00000004:00080000:2.0:1746143760.455961:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d0000/2, rc 0, transno 21474840386 00000100:00100000:2.0:1746143760.455965:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594323328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143760.456101:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c12680/2, rc 0, transno 21474840385 00000100:00100000:0.0:1746143760.456105:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594324736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143760.456113:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.456130:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594093312 00000100:00100000:0.0:1746143760.456133:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594093312 00000100:00100000:3.0:1746143760.456157:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143760.456166:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.456184:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7049 00000100:00100000:0.0:1746143760.456189:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594093312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.456195:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.456200:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.456209:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.456224:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f395 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a735d expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.456228:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143760.456246:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.456250:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x12 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143760.456257:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143760.456262:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143760.456289:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143760.456316:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594093312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 126us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.456321:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7049 00000100:00100000:2.0:1746143760.456386:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594093440 00000100:00100000:2.0:1746143760.456389:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594093440 00000100:00100000:2.0:1746143760.456407:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594093568 00000100:00100000:2.0:1746143760.456409:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594093568 00000100:00100000:2.0:1746143760.456423:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3904 00000100:00100000:2.0:1746143760.456427:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31211:x1830963594093440:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143760.456484:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31211:x1830963594093440:12345-192.168.202.48@tcp:49:cat.0 Request processed in 56us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.456489:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3904 00000100:00100000:2.0:1746143760.456499:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3905 00000100:00100000:2.0:1746143760.456503:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31205:x1830963594093568:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143760.456533:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31205:x1830963594093568:12345-192.168.202.48@tcp:49:cat.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.456538:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3905 00010000:00010000:3.0:1746143760.456555:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.456561:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143760.456574:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:2.0:1746143760.456584:0:3278:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594324480:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143760.456592:0:3278:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594324608:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143760.456605:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143760.456609:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f0c00/0xe984082ccd72f3fe lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143760.456694:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094603200/0xe984082ccd72f405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 244 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.456707:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.456716:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.456718:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 17 00010000:00010000:3.0:1746143760.456720:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3a00, rc 0) 00000100:00100000:3.0:1746143760.456736:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31212:x1830963594090880:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 57185us (57965us total) trans 8589943445 rc 0/0 00000100:00100000:3.0:1746143760.456741:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9138 00000100:00100000:0.0:1746143760.458520:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.458612:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594093824 00000100:00100000:1.0:1746143760.458616:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594093824 00000100:00100000:1.0:1746143760.458652:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3906 00000100:00100000:1.0:1746143760.459249:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31206:x1830963594093824:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143760.459408:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31206:x1830963594093824:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 164us (892us total) trans 8589943446 rc 0/0 00000100:00100000:1.0:1746143760.459560:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3906 00000100:00100000:0.0:1746143760.461794:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.461878:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594094080 00000100:00100000:1.0:1746143760.461885:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594094080 00000100:00100000:1.0:1746143760.461916:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3907 00000100:00100000:1.0:1746143760.461921:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31206:x1830963594094080:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143760.462085:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31206:x1830963594094080:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 162us (296us total) trans 8589943447 rc 0/0 00000100:00100000:1.0:1746143760.462091:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3907 00000100:00100000:0.0:1746143760.467491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.467562:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594094336 00000100:00100000:3.0:1746143760.467570:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594094336 00002000:00100000:3.0:1746143760.467607:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136b9e680 x1830963594094336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.467615:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9e680 with x1830963594094336 ext(3145728->4194303) 00002000:00010000:3.0:1746143760.467620:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9e680 00000100:00100000:3.0:1746143760.467652:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6171 00000100:00100000:3.0:1746143760.467660:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594094336:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143760.476078:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.476444:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594094336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8782us (8958us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.476453:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6171 00002000:00100000:3.0:1746143760.476463:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136b9e680 x1830963594094336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.476471:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9e680 with x1830963594094336 ext(3145728->4194303) 00000100:00100000:0.0:1746143760.476474:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594094592 00002000:00010000:3.0:1746143760.476477:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9e680 00000100:00100000:0.0:1746143760.476481:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594094592 00002000:00100000:0.0:1746143760.476511:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094c11880 x1830963594094592/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.476518:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963594094592 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.476521:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11880 00000100:00100000:0.0:1746143760.476535:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6172 00000100:00100000:0.0:1746143760.476540:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594094592:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.480811:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.481670:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594094720 00000100:00100000:1.0:1746143760.481676:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594094720 00000100:00100000:1.0:1746143760.481723:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13193 00000100:00100000:1.0:1746143760.481729:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594094720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.481743:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.481756:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73b8 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.481774:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.481775:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.481782:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.481794:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.481804:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf80000, rc 0) 00000100:00100000:1.0:1746143760.481830:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594094720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 100us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.481834:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13193 00000100:00100000:1.0:1746143760.481861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.481869:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594094848 00000100:00100000:1.0:1746143760.481872:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594094848 00000100:00100000:1.0:1746143760.481884:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13194 00000100:00100000:1.0:1746143760.481887:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594094848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.481893:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.481900:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73bf expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.481909:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.481910:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.481913:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.481921:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.481926:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf80400, rc 0) 00000100:00100000:1.0:1746143760.481936:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594094848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 48us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.481940:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13194 00000100:00100000:1.0:1746143760.481968:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.481975:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594095104 00000100:00100000:1.0:1746143760.481977:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594095104 00000100:00100000:1.0:1746143760.481986:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13195 00000100:00100000:1.0:1746143760.481989:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594095104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.481994:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.482000:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73cd expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.482008:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.482009:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.482012:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.482019:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.482029:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094603200, rc 0) 00000100:00100000:1.0:1746143760.482038:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594095104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 49us (70us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.482042:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13195 00000100:00100000:1.0:1746143760.482071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.482079:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594094976 00000100:00100000:1.0:1746143760.482081:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594094976 00000100:00100000:1.0:1746143760.482092:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13196 00000100:00100000:1.0:1746143760.482095:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594094976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.482100:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.482105:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73c6 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.482113:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.482114:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.482117:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 27 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.482124:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 27 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.482130:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094602a00, rc 0) 00000100:00100000:1.0:1746143760.482154:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594094976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.482158:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13196 00000100:00100000:1.0:1746143760.493507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.494399:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594094592:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17851us (18321us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.494408:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6172 00002000:00100000:2.0:1746143760.494419:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094c11880 x1830963594094592/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.494429:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963594094592 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.494433:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11880 00000100:00100000:2.0:1746143760.494457:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594095360 00000100:00100000:2.0:1746143760.494462:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594095360 00002000:00100000:2.0:1746143760.494487:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff8800a087a680 x1830963594095360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.494493:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a680 with x1830963594095360 ext(4194304->4755455) 00002000:00010000:2.0:1746143760.494496:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087a680 00000100:00100000:2.0:1746143760.494510:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6173 00000100:00100000:2.0:1746143760.494516:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594095360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143760.502023:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594095360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7498us (8516us total) trans 0 rc 561152/561152 00000100:00100000:2.0:1746143760.502032:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6173 00002000:00100000:2.0:1746143760.502041:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff8800a087a680 x1830963594095360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.502051:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a680 with x1830963594095360 ext(4194304->4755455) 00002000:00010000:2.0:1746143760.502722:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087a680 00000100:00100000:0.0:1746143760.505893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.506030:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.506443:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594095616 00000100:00100000:3.0:1746143760.506451:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594095616 00002000:00100000:3.0:1746143760.506491:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136b9ea00 x1830963594095616/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.506500:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ea00 with x1830963594095616 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.506505:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ea00 00000100:00100000:3.0:1746143760.506523:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6174 00000100:00100000:3.0:1746143760.506529:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594095616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.508428:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594095872 00000100:00100000:3.0:1746143760.508435:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594095872 00000100:00100000:3.0:1746143760.508478:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9142 00000100:00100000:3.0:1746143760.508484:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31215:x1830963594095872:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143760.508497:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.508510:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73d4 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.508596:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508607:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508616:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508627:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508632:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508637:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508730:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e200/0xe984082ccd72f467 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508737:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e200/0xe984082ccd72f467 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508742:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e200/0xe984082ccd72f467 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143760.508750:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143760.508821:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508826:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508831:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508836:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009089e000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.508839:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508845:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508853:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143760.508856:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.508859:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508864:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e000/0xe984082ccd72f459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508889:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508894:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508898:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508902:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009089f400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.508904:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508908:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508913:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1ff900) 00010000:00010000:3.0:1746143760.508915:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.508917:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.508983:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f400/0xe984082ccd72f460 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.509011:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73d4 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.509019:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e200/0xe984082ccd72f467 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73d4 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.509025:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.509027:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143760.509029:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089e200, rc 0) 00000100:00100000:3.0:1746143760.509077:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31215:x1830963594095872:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 593us (3046us total) trans 8589943448 rc 0/0 00000100:00100000:3.0:1746143760.509082:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9142 00000100:00100000:0.0:1746143760.513009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.513177:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594096128 00000100:00100000:1.0:1746143760.513184:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594096128 00000100:00100000:1.0:1746143760.513218:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3908 00000100:00100000:1.0:1746143760.513225:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31205:x1830963594096128:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143760.513459:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31205:x1830963594096128:12345-192.168.202.48@tcp:35:cat.0 Request processed in 233us (455us total) trans 8589943449 rc 0/0 00000100:00100000:1.0:1746143760.513466:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3908 00000100:00100000:3.0:1746143760.516631:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594095616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10092us (10801us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.516642:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6174 00002000:00100000:3.0:1746143760.516651:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136b9ea00 x1830963594095616/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.516661:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ea00 with x1830963594095616 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.516666:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ea00 00000100:00100000:0.0:1746143760.520911:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.521098:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594096384 00000100:00100000:3.0:1746143760.521106:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594096384 00000100:00100000:3.0:1746143760.521178:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9143 00000100:00100000:3.0:1746143760.521184:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31215:x1830963594096384:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143760.521202:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.521205:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746143760.521228:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089e200/0xe984082ccd72f467 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73d4 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521259:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81800/0xe984082ccd72f41a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73aa expref: 8 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521268:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.521271:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143760.521281:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f000/0xe984082ccd72f475 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73db expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521321:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.521330:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521335:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521340:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521345:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 6/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.521368:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521377:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 243 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.521387:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594324864:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.521986:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 8 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.521995:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 8 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.522007:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594324992:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.522034:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.522041:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 243 pid: 20509 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.522047:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594325120:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.522062:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.524374:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594324864:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.524387:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594324992:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.524396:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594325120:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.524418:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143760.525036:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.525063:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.525087:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.525490:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594096640 00000100:00100000:0.0:1746143760.525494:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.525496:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594096640 00000100:00100000:1.0:1746143760.525549:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594096512 00000100:00100000:1.0:1746143760.525552:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594096512 00010000:00010000:1.0:1746143760.525612:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 244 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.525627:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.525800:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594096768 00000100:00100000:3.0:1746143760.525803:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594096768 00000100:00100000:0.0:1746143760.525842:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594096896 00000100:00100000:0.0:1746143760.525844:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594096896 00000100:00100000:0.0:1746143760.525869:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9144 00000100:00100000:0.0:1746143760.525875:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31211:x1830963594096896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143760.525888:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.525900:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73e2 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.525934:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 245 pid: 20509 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.525948:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7050 00000100:00100000:3.0:1746143760.525952:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:1963:x1830963594096768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143760.525961:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143760.525965:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 245 pid: 20509 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.525974:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 245 pid: 20509 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.525988:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf81000/0xe984082ccd72f413 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73a3 expref: 245 pid: 20509 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.526000:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.526004:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.526009:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.526187:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143760.526218:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1963:x1830963594096768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 265us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.526224:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7050 00000100:00100000:2.0:1746143760.526315:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7051 00000100:00100000:2.0:1746143760.526322:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594096640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.526329:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.526333:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.526642:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143760.526650:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.526668:0:21713:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143760.526678:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 10 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.526681:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7052 00000100:00100000:1.0:1746143760.526687:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1963:x1830963594096512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.526687:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143760.526689:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143760.526691:0:21713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143760.526695:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.526696:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084fa00, rc 0) 00010000:00010000:1.0:1746143760.526703:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 243 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.526712:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 243 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.526714:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31211:x1830963594096896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 839us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143760.526719:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9144 00010000:00010000:1.0:1746143760.526723:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd72f421 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x17/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7395 expref: 243 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.526736:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143760.526739:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143760.526745:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143760.526749:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.526766:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1963:x1830963594096512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.526771:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7052 00010000:00010000:2.0:1746143760.526813:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.526824:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba27400/0xe984082ccd72f428 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b1 expref: 9 pid: 14763 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.526848:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.526851:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.526857:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.526862:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.526868:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 9 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.526879:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.526897:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594096640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 576us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.526902:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7051 00010000:00010000:3.0:1746143760.526911:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.526918:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00000040:00080000:3.0:1746143760.527903:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2650, 88 off223736 00000004:00080000:3.0:1746143760.527909:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839537769052ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.527957:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2670, 88 off225672 00000004:00080000:3.0:1746143760.527961:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839537821310ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.527983:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2671, 88 off225760 00000004:00080000:3.0:1746143760.527986:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839537846757ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.528106:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2651, 88 off223824 00000004:00080000:3.0:1746143760.528110:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839537970297ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528195:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2652, 88 off223912 00000004:00080000:3.0:1746143760.528198:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839538058173ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528205:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2672, 88 off225848 00000004:00080000:3.0:1746143760.528207:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839538067130ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.528223:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2673, 88 off225936 00000004:00080000:3.0:1746143760.528225:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839538085366ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.528314:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2674, 88 off226024 00000004:00080000:3.0:1746143760.528318:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839538178515ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.528336:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2653, 88 off224000 00000004:00080000:3.0:1746143760.528338:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839538198836ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528346:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2675, 88 off226112 00000004:00080000:3.0:1746143760.528348:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839538208165ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.528355:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2654, 88 off224088 00000004:00080000:3.0:1746143760.528358:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839538218073ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528364:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2676, 88 off226200 00000004:00080000:3.0:1746143760.528366:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839538226786ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143760.528373:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2655, 88 off224176 00000004:00080000:3.0:1746143760.528376:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839538235953ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528381:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2656, 88 off224264 00000004:00080000:3.0:1746143760.528384:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839538244216ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528391:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2657, 88 off224352 00000004:00080000:3.0:1746143760.528393:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839538253553ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528400:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2658, 88 off224440 00000004:00080000:3.0:1746143760.528402:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839538262490ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143760.528409:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2677, 88 off226288 00000004:00080000:3.0:1746143760.528412:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 839538271973ns, next at 833304778357ns, rc = 0 00010000:00010000:3.0:1746143760.556389:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.556401:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.556404:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143760.556408:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.556417:0:16090:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.556422:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.556451:0:16090:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 11 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.556462:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594325248:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143760.556531:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000001:00080000:0.0:1746143760.556825:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943449 is committed 00000001:00080000:0.0:1746143760.556834:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943447 is committed 00000001:00080000:0.0:1746143760.556842:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943450 is committed 00000004:00080000:0.0:1746143760.556846:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2013 committed 00000004:00080000:0.0:1746143760.556851:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1994 committed 00000004:00080000:0.0:1746143760.556856:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1993 committed 00000004:00080000:0.0:1746143760.556857:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1992 committed 00000004:00080000:0.0:1746143760.556858:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1991 committed 00000004:00080000:0.0:1746143760.556859:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746143760.556861:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1990 committed 00000004:00080000:0.0:1746143760.556862:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746143760.556863:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1989 committed 00000004:00080000:0.0:1746143760.556865:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746143760.556867:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2009 committed 00000004:00080000:0.0:1746143760.556869:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2008 committed 00000004:00080000:0.0:1746143760.556870:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1988 committed 00000004:00080000:0.0:1746143760.556871:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1987 committed 00000004:00080000:0.0:1746143760.556872:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2007 committed 00000004:00080000:0.0:1746143760.556873:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2006 committed 00000004:00080000:0.0:1746143760.556875:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1986 committed 00000100:00100000:2.0:1746143760.557025:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594325376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557061:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557077:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594325888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557090:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557105:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143760.557109:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594325504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557120:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557130:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594326016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557158:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557173:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594325760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557187:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557196:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594326272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557207:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557216:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746143760.557220:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594325632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557248:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557257:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594326144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557269:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.557286:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325376 00000100:00100000:2.0:1746143760.557292:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325376 00000100:00100000:2.0:1746143760.557317:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325888 00000100:00100000:2.0:1746143760.557318:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325888 00000100:00100000:2.0:1746143760.557327:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325504 00000100:00100000:2.0:1746143760.557328:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325504 00000100:00100000:2.0:1746143760.557335:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326016 00000100:00100000:2.0:1746143760.557336:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326016 00000100:00100000:2.0:1746143760.557344:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325760 00000100:00100000:2.0:1746143760.557346:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325760 00000100:00100000:2.0:1746143760.557352:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326272 00000100:00100000:2.0:1746143760.557353:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326272 00000100:00100000:2.0:1746143760.557358:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325632 00000100:00100000:2.0:1746143760.557359:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325632 00000100:00100000:2.0:1746143760.557364:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326144 00000100:00100000:2.0:1746143760.557366:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326144 00000100:00100000:2.0:1746143760.557374:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13197 00000100:00100000:2.0:1746143760.557379:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594325376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143760.557522:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143760.557524:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143760.557526:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143760.557528:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143760.557529:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 1959 -> 1959 00000100:00100000:2.0:1746143760.557553:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594325376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (491us total) trans 21474840387 rc 0/0 00000100:00100000:2.0:1746143760.557558:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13197 00000100:00100000:2.0:1746143760.557570:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13198 00000100:00100000:2.0:1746143760.557574:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594325888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557644:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594325888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (553us total) trans 21474840388 rc 0/0 00000100:00100000:2.0:1746143760.557649:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13198 00000100:00100000:2.0:1746143760.557657:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13199 00000100:00100000:2.0:1746143760.557661:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594325504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143760.557721:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143760.557723:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143760.557724:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143760.557726:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143760.557728:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143760.557745:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594325504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (623us total) trans 21474840389 rc 0/0 00000100:00100000:2.0:1746143760.557750:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13199 00000100:00100000:2.0:1746143760.557758:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13200 00000100:00100000:2.0:1746143760.557762:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594326016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557826:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594326016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (667us total) trans 21474840390 rc 0/0 00000100:00100000:2.0:1746143760.557831:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13200 00000100:00100000:2.0:1746143760.557839:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13201 00000100:00100000:2.0:1746143760.557843:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3293:x1830963594325760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557911:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3293:x1830963594325760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (722us total) trans 21474840391 rc 0/0 00000100:00100000:2.0:1746143760.557916:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13201 00000100:00100000:2.0:1746143760.557924:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13202 00000100:00100000:2.0:1746143760.557928:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3293:x1830963594326272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.557992:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3293:x1830963594326272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (784us total) trans 21474840392 rc 0/0 00000100:00100000:2.0:1746143760.557997:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13202 00000100:00100000:2.0:1746143760.558005:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13203 00000100:00100000:2.0:1746143760.558009:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3293:x1830963594325632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143760.558067:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4755392 -> 4755392 00002000:00010000:2.0:1746143760.558069:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143760.558071:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143760.558073:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143758 -> 1746143758 00002000:00010000:2.0:1746143760.558075:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5255 00000100:00100000:2.0:1746143760.558091:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3293:x1830963594325632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (843us total) trans 21474840393 rc 0/0 00000100:00100000:2.0:1746143760.558097:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13203 00000100:00100000:2.0:1746143760.558105:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13204 00000100:00100000:2.0:1746143760.558109:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3293:x1830963594326144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.558196:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3293:x1830963594326144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (925us total) trans 21474840394 rc 0/0 00000100:00100000:2.0:1746143760.558201:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13204 00000004:00080000:2.0:1746143760.558251:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0d880/2, rc 0, transno 21474840393 00000100:00100000:2.0:1746143760.558258:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594325632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.558265:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cd500/2, rc 0, transno 21474840394 00000100:00100000:2.0:1746143760.558267:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594326144:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.558273:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0c700/2, rc 0, transno 21474840391 00000100:00100000:2.0:1746143760.558275:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594325760:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.558280:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cdf80/2, rc 0, transno 21474840392 00000100:00100000:2.0:1746143760.558283:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594326272:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.558295:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f186300/2, rc 0, transno 21474840389 00000100:00100000:2.0:1746143760.558298:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594325504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.558302:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cea00/2, rc 0, transno 21474840390 00000100:00100000:2.0:1746143760.558305:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594326016:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.558310:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c10a80/2, rc 0, transno 21474840387 00000100:00100000:2.0:1746143760.558312:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594325376:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143760.558317:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c0f480/2, rc 0, transno 21474840388 00000100:00100000:2.0:1746143760.558320:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594325888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.558344:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594326400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.558359:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143760.558374:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326400 00000100:00100000:2.0:1746143760.558377:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326400 00000100:00100000:2.0:1746143760.558389:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13205 00000100:00100000:2.0:1746143760.558393:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594326400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143760.558469:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3294:x1830963594326400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (109us total) trans 21474840395 rc 0/0 00000100:00100000:2.0:1746143760.558474:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13205 00000004:00080000:2.0:1746143760.558491:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090767100/2, rc 0, transno 21474840395 00000100:00100000:2.0:1746143760.558494:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594326400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143760.558765:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594326528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558786:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558806:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594327040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558816:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558824:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143760.558827:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594326912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558837:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558851:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594327424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558861:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558874:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594326656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558886:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558892:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594327168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558902:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558908:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143760.558911:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594326784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558920:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558927:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594327296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.558935:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143760.558947:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326528 00000100:00100000:0.0:1746143760.558950:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326528 00000100:00100000:0.0:1746143760.558962:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327040 00000100:00100000:0.0:1746143760.558963:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327040 00000100:00100000:0.0:1746143760.558969:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326912 00000100:00100000:0.0:1746143760.558970:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326912 00000100:00100000:0.0:1746143760.558976:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327424 00000100:00100000:0.0:1746143760.558977:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327424 00000100:00100000:0.0:1746143760.558981:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326656 00000100:00100000:0.0:1746143760.558982:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326656 00000100:00100000:0.0:1746143760.558986:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327168 00000100:00100000:0.0:1746143760.558987:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327168 00000100:00100000:0.0:1746143760.558991:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326784 00000100:00100000:0.0:1746143760.558992:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326784 00000100:00100000:0.0:1746143760.558996:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327296 00000100:00100000:0.0:1746143760.558997:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327296 00000100:00100000:0.0:1746143760.559003:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13206 00000100:00100000:0.0:1746143760.559006:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830963594326528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143760.559090:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143760.559092:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143760.559094:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143760.559096:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143760.559097:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746143760.559114:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594326528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (327us total) trans 17179873064 rc 0/0 00000100:00100000:0.0:1746143760.559119:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13206 00000100:00100000:0.0:1746143760.559127:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13207 00000100:00100000:0.0:1746143760.559130:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830963594327040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.559213:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594327040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (396us total) trans 17179873065 rc 0/0 00000100:00100000:0.0:1746143760.559220:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13207 00000100:00100000:0.0:1746143760.559227:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13208 00000100:00100000:0.0:1746143760.559242:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830963594326912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143760.559288:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143760.559290:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143760.559291:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143760.559293:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143760.559294:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143760.559307:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594326912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (469us total) trans 17179873066 rc 0/0 00000100:00100000:0.0:1746143760.559311:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13208 00000100:00100000:0.0:1746143760.559317:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13209 00000100:00100000:0.0:1746143760.559321:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830963594327424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.559371:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594327424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (508us total) trans 17179873067 rc 0/0 00000100:00100000:0.0:1746143760.559375:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13209 00000100:00100000:0.0:1746143760.559381:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13210 00000100:00100000:0.0:1746143760.559384:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3292:x1830963594326656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143760.559431:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143760.559433:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143760.559434:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143760.559436:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:0.0:1746143760.559438:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143760.559452:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3292:x1830963594326656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (564us total) trans 17179873068 rc 0/0 00000100:00100000:0.0:1746143760.559456:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13210 00000100:00100000:0.0:1746143760.559464:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13211 00000100:00100000:0.0:1746143760.559468:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3292:x1830963594327168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.559523:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3292:x1830963594327168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (620us total) trans 17179873069 rc 0/0 00000100:00100000:0.0:1746143760.559527:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13211 00000100:00100000:0.0:1746143760.559534:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13212 00000100:00100000:0.0:1746143760.559537:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3292:x1830963594326784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143760.559583:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143760.559585:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.559587:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143760.559588:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143760.559590:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143760.559602:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3292:x1830963594326784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (680us total) trans 17179873070 rc 0/0 00000100:00100000:0.0:1746143760.559605:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13212 00000100:00100000:0.0:1746143760.559611:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13213 00000100:00100000:0.0:1746143760.559614:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3292:x1830963594327296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143760.559663:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3292:x1830963594327296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (726us total) trans 17179873071 rc 0/0 00000100:00100000:0.0:1746143760.559667:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13213 00000004:00080000:0.0:1746143760.559689:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085c00/2, rc 0, transno 17179873070 00000100:00100000:0.0:1746143760.559692:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594326784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.559696:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e17d180/2, rc 0, transno 17179873071 00000100:00100000:0.0:1746143760.559699:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594327296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.559703:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878380/2, rc 0, transno 17179873068 00000100:00100000:0.0:1746143760.559706:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594326656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.559710:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ce9180/2, rc 0, transno 17179873069 00000100:00100000:0.0:1746143760.559712:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ce9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594327168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.559722:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0085f80/2, rc 0, transno 17179873066 00000100:00100000:0.0:1746143760.559724:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594326912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.559728:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f533480/2, rc 0, transno 17179873067 00000100:00100000:0.0:1746143760.559730:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594327424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.559734:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878a80/2, rc 0, transno 17179873064 00000100:00100000:0.0:1746143760.559737:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594326528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143760.559741:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cea300/2, rc 0, transno 17179873065 00000100:00100000:0.0:1746143760.559743:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594327040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143760.559955:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594325248:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143760.559981:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089f000/0xe984082ccd72f475 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 9 pid: 16090 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143760.559995:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.560015:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089fc00, rc 0) 00000100:00100000:3.0:1746143760.560041:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31215:x1830963594096384:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 38858us (39139us total) trans 8589943450 rc 0/0 00000100:00100000:3.0:1746143760.560046:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9143 00000100:00100000:0.0:1746143760.563578:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.563658:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594097024 00000100:00100000:1.0:1746143760.563666:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594097024 00000100:00100000:1.0:1746143760.563700:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3909 00000100:00100000:1.0:1746143760.563707:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31211:x1830963594097024:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143760.563809:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31211:x1830963594097024:12345-192.168.202.48@tcp:49:cat.0 Request processed in 102us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.563815:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3909 00000100:00100000:0.0:1746143760.569848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.569916:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594097152 00000100:00100000:2.0:1746143760.569924:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594097152 00000100:00100000:2.0:1746143760.569970:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3910 00000100:00100000:2.0:1746143760.569977:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31215:x1830963594097152:12345-192.168.202.48@tcp:49:multiop.0 00000100:00100000:2.0:1746143760.570084:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31215:x1830963594097152:12345-192.168.202.48@tcp:49:multiop.0 Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.570091:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3910 00000100:00100000:0.0:1746143760.575514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.575566:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594097280 00000100:00100000:1.0:1746143760.575574:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594097280 00000100:00100000:1.0:1746143760.575622:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13214 00000100:00100000:1.0:1746143760.575629:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31215:x1830963594097280:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143760.575644:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.575659:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73e9 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.575681:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 17 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.575688:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.575695:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.575696:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.575699:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [806912->1007615] (req 806912->1007615) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.575722:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.575732:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 25 pid: 15784 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.575741:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594327552:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.575823:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 17 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.575830:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 17 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.575838:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594327680:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.575859:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.577426:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594327552:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.577435:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594327680:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.577452:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [806912->1007615] (req 806912->1007615) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.577469:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b383e00, rc 0) 00000100:00100000:1.0:1746143760.577505:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31215:x1830963594097280:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1875us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.577512:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13214 00000100:00100000:0.0:1746143760.578496:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.578549:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594097536 00000100:00100000:2.0:1746143760.578555:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594097536 00010000:00010000:2.0:1746143760.578576:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.578607:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7053 00000100:00100000:2.0:1746143760.578613:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594097536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.578623:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.578641:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.578649:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.578664:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf80000/0xe984082ccd72f436 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73b8 expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.578674:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.578699:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594097536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.578704:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7053 00000100:00100000:0.0:1746143760.578766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.578787:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594097408 00000100:00100000:1.0:1746143760.578791:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594097408 00010000:00010000:1.0:1746143760.578801:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 17 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.578833:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7054 00000100:00100000:1.0:1746143760.578838:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594097408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.578843:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.578850:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 17 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.578858:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 17 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.578869:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1600/0xe984082ccd72f3d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a736b expref: 17 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.578877:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.578879:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.578885:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 16 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.578897:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 16 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.578918:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 16 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.578927:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0a97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594327808:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143760.578971:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.580326:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0a97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594327808:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143760.580337:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.580356:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594097408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1518us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.580361:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7054 00000100:00100000:0.0:1746143760.580436:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.580496:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594097792 00000100:00100000:3.0:1746143760.580500:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594097792 00002000:00100000:3.0:1746143760.580523:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (806912->811007) req@ffff88012fc10700 x1830963594097792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.580530:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10700 with x1830963594097792 ext(806912->811007) 00002000:00010000:3.0:1746143760.580533:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10700 00000100:00100000:3.0:1746143760.580554:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6175 00000100:00100000:3.0:1746143760.580558:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594097792:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143760.580729:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594097792:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 169us (292us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143760.580733:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6175 00002000:00100000:3.0:1746143760.580738:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (806912->811007) req@ffff88012fc10700 x1830963594097792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.580744:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10700 with x1830963594097792 ext(806912->811007) 00002000:00010000:3.0:1746143760.580747:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10700 00000100:00100000:0.0:1746143760.584997:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.585059:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594098048 00000100:00100000:3.0:1746143760.585069:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594098048 00002000:00100000:3.0:1746143760.585107:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc12d80 x1830963594098048/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.585120:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12d80 with x1830963594098048 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.585124:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc12d80 00000100:00100000:3.0:1746143760.585176:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6176 00000100:00100000:3.0:1746143760.585184:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594098048:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143760.585418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.585458:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594098304 00000100:00100000:0.0:1746143760.585461:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594098304 00002000:00100000:0.0:1746143760.585477:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (1003520->1007615) req@ffff8800a0a97800 x1830963594098304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.585489:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97800 with x1830963594098304 ext(1003520->1007615) 00002000:00010000:0.0:1746143760.585492:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a97800 00000100:00100000:0.0:1746143760.585515:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6177 00000100:00100000:0.0:1746143760.585520:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594098304:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143760.585632:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594098304:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 111us (213us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143760.585638:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6177 00002000:00100000:0.0:1746143760.585643:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (1003520->1007615) req@ffff8800a0a97800 x1830963594098304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.585650:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a97800 with x1830963594098304 ext(1003520->1007615) 00002000:00010000:0.0:1746143760.585652:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a97800 00000100:00100000:0.0:1746143760.587061:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.587129:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594098560 00000100:00100000:1.0:1746143760.587134:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594098560 00000100:00100000:1.0:1746143760.588685:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3911 00000100:00100000:1.0:1746143760.588694:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31215:x1830963594098560:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143760.588907:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31215:x1830963594098560:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 213us (1848us total) trans 8589943451 rc 0/0 00000100:00100000:1.0:1746143760.588913:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3911 00000100:00100000:3.0:1746143760.598470:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594098048:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 13279us (13473us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.598480:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6176 00002000:00100000:3.0:1746143760.598489:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc12d80 x1830963594098048/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.598498:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12d80 with x1830963594098048 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.598503:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc12d80 00000100:00100000:0.0:1746143760.613622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.616130:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594098816 00000100:00100000:3.0:1746143760.616153:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594098816 00002000:00100000:3.0:1746143760.616202:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094305c00 x1830963594098816/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.616212:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830963594098816 ext(2097152->3145727) 00002000:00010000:3.0:1746143760.616224:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:3.0:1746143760.616263:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6178 00000100:00100000:3.0:1746143760.616271:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594098816:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143760.617823:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.617840:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.617861:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.617877:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594099072 00000100:00100000:1.0:1746143760.617881:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594099072 00002000:00100000:1.0:1746143760.617899:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f532680 x1830963594099072/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.617907:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532680 with x1830963594099072 ext(3145728->4194303) 00002000:00010000:1.0:1746143760.617911:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f532680 00000100:00100000:1.0:1746143760.617921:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594099456 00000100:00100000:1.0:1746143760.617923:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594099456 00002000:00100000:1.0:1746143760.617932:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f02300 x1830963594099456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.617939:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963594099456 ext(3145728->4194303) 00002000:00010000:1.0:1746143760.617941:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f02300 00000100:00100000:1.0:1746143760.617947:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594099328 00000100:00100000:1.0:1746143760.617949:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594099328 00002000:00100000:1.0:1746143760.617956:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f03100 x1830963594099328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.617962:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03100 with x1830963594099328 ext(2097152->3145727) 00002000:00010000:1.0:1746143760.617964:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03100 00000100:00100000:1.0:1746143760.617973:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6179 00000100:00100000:1.0:1746143760.617978:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594099072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.618962:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6180 00000100:00100000:3.0:1746143760.618970:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594099456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.619246:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6181 00000100:00100000:0.0:1746143760.619253:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594099328:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143760.643361:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594098816:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27082us (29738us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.643372:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6178 00002000:00100000:3.0:1746143760.643382:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094305c00 x1830963594098816/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.643397:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830963594098816 ext(2097152->3145727) 00002000:00010000:3.0:1746143760.643402:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:3.0:1746143760.644307:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594099456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25334us (26461us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.644314:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6180 00002000:00100000:3.0:1746143760.644320:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f02300 x1830963594099456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.644327:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963594099456 ext(3145728->4194303) 00002000:00010000:3.0:1746143760.644331:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f02300 00000100:00100000:1.0:1746143760.648521:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594099072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30535us (30694us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143760.648532:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6179 00002000:00100000:1.0:1746143760.648541:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f532680 x1830963594099072/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.648555:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532680 with x1830963594099072 ext(3145728->4194303) 00002000:00010000:1.0:1746143760.648560:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f532680 00000100:00100000:2.0:1746143760.649566:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594099328:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30311us (31701us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.649573:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6181 00002000:00100000:2.0:1746143760.649579:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f03100 x1830963594099328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.649586:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03100 with x1830963594099328 ext(2097152->3145727) 00002000:00010000:2.0:1746143760.649589:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03100 00000100:00100000:0.0:1746143760.658549:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.658659:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594099712 00000100:00100000:3.0:1746143760.658668:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594099712 00000100:00100000:3.0:1746143760.658707:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9145 00000100:00100000:3.0:1746143760.658712:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31212:x1830963594099712:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143760.658732:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.658746:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73f0 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.658797:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 241 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.658809:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 241 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.658895:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.658898:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143760.658902:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba200, rc 0) 00000100:00100000:3.0:1746143760.659471:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31212:x1830963594099712:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 756us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.659477:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9145 00000100:00100000:0.0:1746143760.662514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.662876:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594099968 00000100:00100000:2.0:1746143760.662886:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594099968 00002000:00100000:2.0:1746143760.662928:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880094305f80 x1830963594099968/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.662938:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830963594099968 ext(4194304->4755455) 00002000:00010000:2.0:1746143760.662943:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305f80 00000100:00100000:2.0:1746143760.663078:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6182 00000100:00100000:2.0:1746143760.663085:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594099968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.668883:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.669452:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594100096 00000100:00100000:1.0:1746143760.669460:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594100096 00000100:00100000:1.0:1746143760.669510:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13215 00000100:00100000:1.0:1746143760.669517:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31212:x1830963594100096:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143760.669532:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.669546:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73f7 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.669571:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 17 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.669578:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.669583:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.669585:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.669588:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1056768->2064383] (req 1056768->2064383) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.669612:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.669621:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.669636:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594327936:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.669728:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 17 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.669735:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 17 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.669741:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328064:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.669759:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.670255:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594099968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7169us (7750us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143760.670263:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6182 00002000:00100000:3.0:1746143760.670271:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880094305f80 x1830963594099968/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.670279:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830963594099968 ext(4194304->4755455) 00002000:00010000:3.0:1746143760.670283:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305f80 00000100:00100000:1.0:1746143760.671856:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328064:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.672550:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594327936:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.672576:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1056768->2064383] (req 1056768->2064383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.672591:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728e00, rc 0) 00000100:00100000:1.0:1746143760.672638:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31212:x1830963594100096:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3121us (3763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.672645:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13215 00000100:00100000:0.0:1746143760.672969:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.673016:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594100224 00000100:00100000:1.0:1746143760.673021:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594100224 00010000:00010000:1.0:1746143760.673044:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.673501:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7055 00000100:00100000:1.0:1746143760.673510:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594100224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.673520:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.673537:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.673548:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.673565:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094603200/0xe984082ccd72f444 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73cd expref: 26 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.673588:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.673612:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594100224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 103us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.673617:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7055 00000100:00100000:0.0:1746143760.675275:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.675323:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594100352 00000100:00100000:2.0:1746143760.675330:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594100352 00010000:00010000:2.0:1746143760.675608:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 16 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:2.0:1746143760.675648:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7056 00000100:00100000:2.0:1746143760.675654:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594100352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.675664:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143760.675665:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143760.675681:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 16 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.675844:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 16 pid: 4582 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.675864:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f3e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7380 expref: 16 pid: 4582 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.675960:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594100480 00000100:00100000:1.0:1746143760.675964:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594100480 00010000:00010000:2.0:1746143760.675979:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.675981:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143760.675985:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13216 00010000:00010000:2.0:1746143760.675988:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.675990:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594100480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.675995:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.676002:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.676011:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72f49f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a73fe expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.676026:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.676035:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594328192:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143760.676035:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328320:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143760.676295:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.676295:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00002000:00010000:1.0:1746143760.677451:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime: 1746143759 -> 1746143760 00002000:00010000:1.0:1746143760.677455:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143759 -> 1746143760 00002000:00010000:1.0:1746143760.677457:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime: 1746143759 -> 1746143760 00000100:00100000:1.0:1746143760.677472:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328320:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143760.677494:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72f49f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73fe expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.677504:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5003000/0xe984082ccd72f49f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73fe expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.677513:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5003000, rc 0) 00000100:00100000:1.0:1746143760.677793:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594100480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1800us (2126us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143760.677800:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13216 00000100:00100000:2.0:1746143760.678048:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594328192:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143760.678058:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.678260:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594100352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2604us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.678267:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7056 00000100:00100000:0.0:1746143760.679116:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.679976:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594100736 00000100:00100000:3.0:1746143760.679983:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594100736 00002000:00100000:3.0:1746143760.680021:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1056768->1060863) req@ffff880094459f80 x1830963594100736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.680029:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963594100736 ext(1056768->1060863) 00002000:00010000:3.0:1746143760.680034:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094459f80 00000100:00100000:3.0:1746143760.680063:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6183 00000100:00100000:3.0:1746143760.680071:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594100736:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143760.680227:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.680244:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594100736:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 173us (1128us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143760.680251:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6183 00002000:00100000:3.0:1746143760.680256:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1056768->1060863) req@ffff880094459f80 x1830963594100736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.680268:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963594100736 ext(1056768->1060863) 00002000:00010000:3.0:1746143760.680270:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094459f80 00000100:00100000:1.0:1746143760.680270:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594100864 00000100:00100000:1.0:1746143760.680274:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594100864 00000100:00100000:1.0:1746143760.680292:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13217 00000100:00100000:1.0:1746143760.680297:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594100864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.680304:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.680316:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f4a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7405 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.680353:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328448:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143760.680429:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.682801:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328448:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143760.682828:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f4a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7405 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.682841:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095729e00/0xe984082ccd72f4a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7405 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.682851:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095729e00, rc 0) 00000100:00100000:1.0:1746143760.682906:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594100864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2606us (2678us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143760.682914:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13217 00000100:00100000:0.0:1746143760.688003:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.688258:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594101120 00000100:00100000:2.0:1746143760.688266:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594101120 00000100:00100000:2.0:1746143760.688317:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3912 00000100:00100000:2.0:1746143760.688325:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31211:x1830963594101120:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143760.688579:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31211:x1830963594101120:12345-192.168.202.48@tcp:35:cat.0 Request processed in 254us (585us total) trans 8589943452 rc 0/0 00000100:00100000:2.0:1746143760.688585:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3912 00000100:00100000:0.0:1746143760.689686:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.689760:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594101376 00000100:00100000:3.0:1746143760.689764:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594101376 00002000:00100000:3.0:1746143760.689794:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (2060288->2064383) req@ffff880094459500 x1830963594101376/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.689802:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459500 with x1830963594101376 ext(2060288->2064383) 00002000:00010000:3.0:1746143760.689807:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094459500 00000100:00100000:3.0:1746143760.689966:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6184 00000100:00100000:3.0:1746143760.689973:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594101376:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143760.690293:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594101376:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 319us (607us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143760.690299:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6184 00002000:00100000:3.0:1746143760.690304:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (2060288->2064383) req@ffff880094459500 x1830963594101376/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.690311:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459500 with x1830963594101376 ext(2060288->2064383) 00002000:00010000:3.0:1746143760.690314:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094459500 00000100:00100000:2.0:1746143760.693920:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.694046:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594101632 00000100:00100000:0.0:1746143760.694054:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594101632 00000100:00100000:0.0:1746143760.694104:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3913 00000100:00100000:0.0:1746143760.694111:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31212:x1830963594101632:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143760.694343:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31212:x1830963594101632:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 230us (427us total) trans 8589943453 rc 0/0 00000100:00100000:1.0:1746143760.694350:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3913 00000100:00100000:0.0:1746143760.739939:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.740126:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594101888 00000100:00100000:3.0:1746143760.740133:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594101888 00000100:00100000:3.0:1746143760.740200:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9146 00000100:00100000:3.0:1746143760.740207:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31222:x1830963594101888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.740225:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.740250:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a740c expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.740342:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740352:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740361:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740373:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740378:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740382:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740469:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740475:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740480:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143760.740488:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143760.740556:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740562:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740570:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740575:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.740578:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740583:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740592:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143760.740594:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.740597:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.740602:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742099:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742108:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742113:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742451:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009513be00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.742454:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742460:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742472:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1ff900) 00010000:00010000:3.0:1746143760.742474:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.742477:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742481:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.742529:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 245 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.742539:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 244 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.742545:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.742546:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143760.742548:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f81b200, rc 0) 00000100:00100000:3.0:1746143760.742609:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31222:x1830963594101888:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2402us (2676us total) trans 8589943454 rc 0/0 00000100:00100000:3.0:1746143760.742616:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9146 00000100:00100000:0.0:1746143760.745123:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.745724:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594102016 00000100:00100000:1.0:1746143760.745732:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594102016 00000100:00100000:1.0:1746143760.745784:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13218 00000100:00100000:1.0:1746143760.745791:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594102016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.745805:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.745818:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095728800/0xe984082ccd72f4d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7413 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.745858:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328576:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143760.745939:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00002000:00010000:1.0:1746143760.748783:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime: 1746143759 -> 1746143760 00002000:00010000:1.0:1746143760.748789:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143758 -> 1746143760 00002000:00010000:1.0:1746143760.748791:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime: 1746143759 -> 1746143760 00000100:00100000:1.0:1746143760.748810:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328576:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143760.748834:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095728800/0xe984082ccd72f4d0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7413 expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.748846:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095728800/0xe984082ccd72f4d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7413 expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143760.748858:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728800, rc 0) 00000100:00100000:1.0:1746143760.748893:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594102016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3101us (3774us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143760.748900:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13218 00000100:00100000:0.0:1746143760.750942:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.751453:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594102144 00000100:00100000:1.0:1746143760.751460:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594102144 00000100:00100000:1.0:1746143760.751719:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13219 00000100:00100000:1.0:1746143760.751726:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31222:x1830963594102144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143760.751740:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143760.751754:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a741a expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.751782:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 14 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.751789:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143760.751791:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143760.751794:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.751822:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 14 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.751832:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 14 pid: 15784 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.751841:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328704:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143760.753065:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.755474:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.755761:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594102272 00000100:00100000:3.0:1746143760.755769:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594102272 00002000:00100000:3.0:1746143760.755806:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (806912->1007615) req@ffff88008f0af100 x1830963594102272/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.755816:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af100 with x1830963594102272 ext(806912->1007615) 00010000:00010000:3.0:1746143760.755825:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 15 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.755843:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 15 pid: 15784 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.755849:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f0af100 00000100:00100000:3.0:1746143760.755879:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1751 00000100:00100000:3.0:1746143760.755886:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594102272:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143760.756289:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594328704:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143760.756311:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.756322:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728000, rc 0) 00000100:00100000:1.0:1746143760.756356:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31222:x1830963594102144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4631us (5420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.756363:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13219 00000100:00100000:3.0:1746143760.760671:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594102272:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4777us (5194us total) trans 21474840396 rc 0/0 00000100:00100000:3.0:1746143760.760680:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1751 00002000:00100000:3.0:1746143760.760690:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (806912->1007615) req@ffff88008f0af100 x1830963594102272/t21474840396(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.760697:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af100 with x1830963594102272 ext(806912->1007615) 00010000:00010000:3.0:1746143760.760705:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.760717:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.760723:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f0af100 00000100:00100000:0.0:1746143760.762526:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.762882:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594102400 00000100:00100000:2.0:1746143760.762888:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594102400 00010000:00010000:2.0:1746143760.762918:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.763510:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7057 00000100:00100000:2.0:1746143760.763519:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963594102400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.763532:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.763554:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.763565:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.763584:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b383e00/0xe984082ccd72f48a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 806912->1007615) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e9 expref: 17 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.763612:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.763614:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143760.763622:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.763629:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.763660:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.763671:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594328832:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143760.763741:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746143760.765250:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143760.769846:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594328832:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143760.769866:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.770054:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594102400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6535us (7532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.770063:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7057 00000100:00100000:0.0:1746143760.777180:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.777216:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.777247:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594102656 00000100:00100000:3.0:1746143760.777255:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594102656 00000100:00100000:0.0:1746143760.777262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143760.777290:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88008f0ac700 x1830963594102656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.777305:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac700 with x1830963594102656 ext(0->1048575) 00002000:00010000:3.0:1746143760.777309:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ac700 00000100:00100000:3.0:1746143760.777322:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594102912 00000100:00100000:3.0:1746143760.777324:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594102912 00002000:00100000:3.0:1746143760.777333:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009b852a00 x1830963594102912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143760.777338:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594103168 00002000:00100000:3.0:1746143760.777340:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852a00 with x1830963594102912 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.777342:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b852a00 00000100:00100000:2.0:1746143760.777342:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594103168 00000100:00100000:3.0:1746143760.777352:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6185 00000100:00100000:3.0:1746143760.777358:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594102656:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:2.0:1746143760.777358:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009b850e00 x1830963594103168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.777365:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963594103168 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.777369:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850e00 00000100:00100000:2.0:1746143760.777380:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6186 00000100:00100000:2.0:1746143760.777385:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594102912:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.777808:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6187 00000100:00100000:0.0:1746143760.777815:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594103168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.783956:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.784032:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594103424 00000100:00100000:1.0:1746143760.784039:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594103424 00002000:00100000:1.0:1746143760.784072:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009b852d80 x1830963594103424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 504/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.784081:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963594103424 ext(1048576->2097151) 00002000:00010000:1.0:1746143760.784085:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b852d80 00000100:00100000:1.0:1746143760.784118:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6188 00000100:00100000:1.0:1746143760.784124:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594103424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143760.790689:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594103168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12867us (13419us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.790701:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6187 00002000:00100000:2.0:1746143760.790711:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009b850e00 x1830963594103168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.790719:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963594103168 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.790723:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b850e00 00000100:00100000:3.0:1746143760.796647:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594102656:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19281us (19500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.796657:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6185 00002000:00100000:3.0:1746143760.796666:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88008f0ac700 x1830963594102656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.796674:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac700 with x1830963594102656 ext(0->1048575) 00002000:00010000:3.0:1746143760.796680:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ac700 00000100:00100000:0.0:1746143760.802150:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594102912:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24744us (24913us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143760.802160:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6186 00002000:00100000:0.0:1746143760.802169:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009b852a00 x1830963594102912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.802178:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852a00 with x1830963594102912 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.802182:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b852a00 00000100:00100000:0.0:1746143760.802585:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594103424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18461us (18636us total) trans 0 rc 40960/40960 00000100:00100000:0.0:1746143760.802592:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6188 00002000:00100000:0.0:1746143760.802597:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009b852d80 x1830963594103424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 504/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 40960/40960 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.802603:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963594103424 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.802606:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b852d80 00000100:00100000:0.0:1746143760.810778:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.811836:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594103680 00000100:00100000:3.0:1746143760.811844:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594103680 00000100:00100000:3.0:1746143760.811884:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9147 00000100:00100000:3.0:1746143760.811891:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31226:x1830963594103680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.811910:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.811924:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81a000/0xe984082ccd72f4de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7421 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.812019:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812029:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812038:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812048:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812053:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812058:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812158:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812165:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812170:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143760.812178:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143760.812258:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812264:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812273:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812278:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009513be00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.812281:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812286:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812294:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143760.812297:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.812300:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812304:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009513be00/0xe984082ccd72f4e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812951:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812957:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812961:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812965:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938bb600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143760.812968:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812972:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812983:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1ffb00) 00010000:00010000:3.0:1746143760.812986:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143760.812988:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.812991:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb600/0xe984082ccd72f4ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.813033:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81a000/0xe984082ccd72f4de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.813045:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.813050:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143760.813052:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143760.813054:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bb200, rc 0) 00000100:00100000:3.0:1746143760.813708:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31226:x1830963594103680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1815us (2936us total) trans 8589943455 rc 0/0 00000100:00100000:3.0:1746143760.813714:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9147 00000100:00100000:0.0:1746143760.815574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.815645:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.815733:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594103808 00000100:00100000:3.0:1746143760.815740:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594103808 00000100:00100000:3.0:1746143760.815772:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594103936 00000100:00100000:3.0:1746143760.815773:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594103936 00000100:00100000:3.0:1746143760.815786:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13220 00000100:00100000:3.0:1746143760.815791:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963594103808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.815805:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.815818:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7428 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.815836:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.815838:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.815844:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 18 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.815855:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 18 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.815865:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51ad400, rc 0) 00000100:00100000:3.0:1746143760.815894:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594103808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 102us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.815899:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13220 00000100:00100000:3.0:1746143760.815910:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13221 00000100:00100000:3.0:1746143760.815914:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594103936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.815919:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.815925:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938bac00/0xe984082ccd72f508 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a742f expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.815956:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594328960:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143760.816013:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143760.817300:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594328960:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143760.817320:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938bac00/0xe984082ccd72f508 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a742f expref: 18 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.817330:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938bac00/0xe984082ccd72f508 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a742f expref: 18 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.817342:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bac00, rc 0) 00000100:00100000:3.0:1746143760.817373:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594103936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1457us (1727us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143760.817379:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13221 00000100:00100000:0.0:1746143760.817681:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.817738:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594104192 00000100:00100000:3.0:1746143760.817742:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594104192 00000100:00100000:3.0:1746143760.817767:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9148 00000100:00100000:3.0:1746143760.817772:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31227:x1830963594104192:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143760.817784:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.817794:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084e000/0xe984082ccd72f50f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7436 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.817863:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.817874:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.817880:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.818039:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143760.818061:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.818071:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 13 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.818080:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594329088:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.818209:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.818217:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 243 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:3.0:1746143760.818224:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594329216:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.818254:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.820971:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.821721:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594329088:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.821731:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594329216:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.821749:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143760.821856:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594104320 00000100:00100000:2.0:1746143760.821861:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594104320 00010000:00010000:2.0:1746143760.821886:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 244 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.821918:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7058 00000100:00100000:2.0:1746143760.821924:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1962:x1830963594104320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143760.821936:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143760.821941:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 244 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.821950:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 244 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.821965:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f81b200/0xe984082ccd72f4c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a740c expref: 244 pid: 16090 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.821984:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.821988:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.821995:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.821999:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143760.822032:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1962:x1830963594104320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.822038:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7058 00000100:00100000:0.0:1746143760.822281:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.822329:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.822346:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.822357:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.822381:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.822396:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594104704 00000100:00100000:0.0:1746143760.822398:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594104704 00002000:00100000:0.0:1746143760.822424:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093805880 x1830963594104704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.822432:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805880 with x1830963594104704 ext(2097152->3145727) 00002000:00010000:0.0:1746143760.822436:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805880 00000100:00100000:0.0:1746143760.822450:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594104960 00000100:00100000:0.0:1746143760.822453:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594104960 00002000:00100000:0.0:1746143760.822462:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a5c21f80 x1830963594104960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.822468:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21f80 with x1830963594104960 ext(3145728->4194303) 00002000:00010000:0.0:1746143760.822471:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21f80 00000100:00100000:1.0:1746143760.822473:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594104448 00000100:00100000:1.0:1746143760.822476:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594104448 00000100:00100000:0.0:1746143760.822482:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594105216 00000100:00100000:0.0:1746143760.822484:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594105216 00010000:00010000:1.0:1746143760.822489:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 14 pid: 16090 timeout: 939 lvb_type: 0 00002000:00100000:0.0:1746143760.822494:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a5c20e00 x1830963594105216/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.822500:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20e00 with x1830963594105216 ext(2097152->3145727) 00002000:00010000:0.0:1746143760.822503:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c20e00 00000100:00100000:1.0:1746143760.822504:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7059 00000100:00100000:1.0:1746143760.822508:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594104448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143760.822510:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594105472 00000100:00100000:0.0:1746143760.822511:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594105472 00010000:00010000:1.0:1746143760.822514:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.822517:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 14 pid: 16090 timeout: 939 lvb_type: 0 00002000:00100000:0.0:1746143760.822519:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a5c22a00 x1830963594105472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.822524:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22a00 with x1830963594105472 ext(3145728->4194303) 00010000:00010000:1.0:1746143760.822525:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 14 pid: 16090 timeout: 939 lvb_type: 0 00002000:00010000:0.0:1746143760.822526:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c22a00 00000100:00100000:0.0:1746143760.822534:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6189 00010000:00010000:1.0:1746143760.822536:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938bb200/0xe984082ccd72f4f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7421 expref: 14 pid: 16090 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.822538:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594104704:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143760.822548:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143760.822551:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143760.822556:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143760.822561:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143760.822575:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.822592:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594104448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.822597:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7059 00010000:00010000:1.0:1746143760.822638:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143760.822643:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143760.822657:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143760.822759:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084e000/0xe984082ccd72f50f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 14 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.822769:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.822774:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143760.822776:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143760.822778:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084f400, rc 0) 00000100:00100000:1.0:1746143760.822795:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31227:x1830963594104192:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5023us (5115us total) trans 8589943456 rc 0/0 00000100:00100000:1.0:1746143760.822800:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9148 00000100:00100000:2.0:1746143760.822898:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6190 00000100:00100000:2.0:1746143760.822903:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594104960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.823799:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6191 00000100:00100000:0.0:1746143760.823805:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594105216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143760.823988:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6192 00000100:00100000:2.0:1746143760.823993:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594105472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143760.830768:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.831616:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594104704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9074us (9283us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.831631:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6189 00002000:00100000:2.0:1746143760.831642:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093805880 x1830963594104704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.831650:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805880 with x1830963594104704 ext(2097152->3145727) 00002000:00010000:2.0:1746143760.831655:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093805880 00000100:00100000:3.0:1746143760.832453:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594105600 00000100:00100000:3.0:1746143760.832463:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594105600 00000100:00100000:3.0:1746143760.832502:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13222 00000100:00100000:3.0:1746143760.832509:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31227:x1830963594105600:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143760.832522:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.832537:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a743d expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.832564:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.832576:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.832582:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.832584:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.832587:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1155072->1335295] (req 1155072->1335295) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.832616:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.832628:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 30 pid: 2839 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.832640:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594329344:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.832712:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.832720:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.832727:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594329472:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.832748:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.837220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.838073:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594105856 00000100:00100000:3.0:1746143760.838081:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594105856 00002000:00100000:3.0:1746143760.838120:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880090767480 x1830963594105856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.838130:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767480 with x1830963594105856 ext(0->1048575) 00002000:00010000:3.0:1746143760.838134:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767480 00000100:00100000:3.0:1746143760.838190:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6193 00000100:00100000:3.0:1746143760.838197:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594105856:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143760.839539:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.840939:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594106112 00000100:00100000:0.0:1746143760.840947:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594106112 00002000:00100000:0.0:1746143760.840983:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930dce00 x1830963594106112/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143760.840992:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dce00 with x1830963594106112 ext(1048576->2097151) 00002000:00010000:0.0:1746143760.840996:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dce00 00000100:00100000:0.0:1746143760.841027:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6194 00000100:00100000:0.0:1746143760.841035:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594106112:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143760.842403:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594104960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19495us (20051us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.842412:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6190 00002000:00100000:3.0:1746143760.842419:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a5c21f80 x1830963594104960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.842426:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21f80 with x1830963594104960 ext(3145728->4194303) 00002000:00010000:3.0:1746143760.842431:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21f80 00000100:00100000:0.0:1746143760.848553:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.848579:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.848599:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594106368 00000100:00100000:2.0:1746143760.848607:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594106368 00002000:00100000:2.0:1746143760.848653:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a5c20a80 x1830963594106368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.848662:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20a80 with x1830963594106368 ext(1048576->2097151) 00010000:00010000:2.0:1746143760.848669:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 23 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.848680:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 23 pid: 15784 timeout: 939 lvb_type: 1 00002000:00010000:2.0:1746143760.848686:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c20a80 00000100:00100000:2.0:1746143760.848706:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1752 00000100:00100000:2.0:1746143760.848712:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594106368:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143760.848715:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594105216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24908us (26354us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143760.848723:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6191 00002000:00100000:1.0:1746143760.848729:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a5c20e00 x1830963594105216/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143760.848742:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20e00 with x1830963594105216 ext(2097152->3145727) 00002000:00010000:1.0:1746143760.848745:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c20e00 00000100:00100000:1.0:1746143760.848768:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594106496 00000100:00100000:1.0:1746143760.848771:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594106496 00010000:00010000:1.0:1746143760.848786:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 29 pid: 2839 timeout: 939 lvb_type: 1 00000100:00100000:1.0:1746143760.848805:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7060 00000100:00100000:1.0:1746143760.848810:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594106496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.848817:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.848830:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 29 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.848838:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 29 pid: 2839 timeout: 939 lvb_type: 1 00010000:00010000:1.0:1746143760.848857:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.848871:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594106496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.848876:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7060 00010000:00010000:3.0:1746143760.848987:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094602a00/0xe984082ccd72f44b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73c6 expref: 28 pid: 2839 timeout: 939 lvb_type: 1 00000100:00100000:3.0:1746143760.849013:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594329344:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143760.849022:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594329472:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143760.849042:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1155072->1335295] (req 1155072->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.849052:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084f000, rc 0) 00000100:00100000:3.0:1746143760.849071:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31227:x1830963594105600:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 16562us (18312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143760.849080:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13222 00000100:00100000:3.0:1746143760.849469:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594105472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25475us (27086us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.849474:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6192 00002000:00100000:3.0:1746143760.849479:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a5c22a00 x1830963594105472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.849487:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c22a00 with x1830963594105472 ext(3145728->4194303) 00002000:00010000:3.0:1746143760.849490:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5c22a00 00000100:00100000:3.0:1746143760.853791:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594105856:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15585us (16570us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.853803:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6193 00002000:00100000:3.0:1746143760.853813:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880090767480 x1830963594105856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.853823:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767480 with x1830963594105856 ext(0->1048575) 00002000:00010000:3.0:1746143760.853828:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767480 00000100:00100000:2.0:1746143760.860051:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594106112:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 19007us (20507us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.860061:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6194 00002000:00100000:2.0:1746143760.860071:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930dce00 x1830963594106112/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.860080:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dce00 with x1830963594106112 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.860086:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dce00 00000100:00100000:0.0:1746143760.861912:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.861995:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594106624 00000100:00100000:3.0:1746143760.862002:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594106624 00000100:00100000:3.0:1746143760.862035:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13223 00000100:00100000:3.0:1746143760.862042:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594106624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143760.862054:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143760.862067:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a084ea00/0xe984082ccd72f52b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7444 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143760.862084:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143760.862093:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a084ea00/0xe984082ccd72f52b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7444 expref: 27 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.862102:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a084ea00/0xe984082ccd72f52b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7444 expref: 27 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143760.862115:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a084ea00, rc 0) 00000100:00100000:3.0:1746143760.862181:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594106624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 138us (274us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143760.862187:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13223 00000100:00100000:2.0:1746143760.862469:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594106368:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 13756us (13921us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.862475:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1752 00002000:00100000:2.0:1746143760.862480:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a5c20a80 x1830963594106368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.862487:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c20a80 with x1830963594106368 ext(1048576->2097151) 00010000:00010000:2.0:1746143760.862492:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:2.0:1746143760.862502:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 939 lvb_type: 1 00002000:00010000:2.0:1746143760.862507:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c20a80 00000100:00100000:2.0:1746143760.870798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.870897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.872264:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594107008 00000100:00100000:3.0:1746143760.872273:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594107008 00002000:00100000:3.0:1746143760.872315:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88009ff6e300 x1830963594107008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.872323:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963594107008 ext(4194304->4755455) 00002000:00010000:3.0:1746143760.872328:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6e300 00000100:00100000:3.0:1746143760.872348:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6195 00000100:00100000:3.0:1746143760.872354:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594107008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143760.872981:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594106752 00000100:00100000:0.0:1746143760.872986:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594106752 00010000:00010000:0.0:1746143760.873007:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 939 lvb_type: 1 00000100:00100000:0.0:1746143760.873025:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7061 00000100:00100000:0.0:1746143760.873030:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594106752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143760.873038:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143760.873054:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143760.873064:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143760.873082:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f192400/0xe984082ccd72f3e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7379 expref: 20 pid: 15784 timeout: 939 lvb_type: 1 00010000:00010000:0.0:1746143760.873096:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.873097:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143760.873103:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 19 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143760.873107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143760.873110:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 19 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143760.873129:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594107136 00000100:00100000:0.0:1746143760.873132:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594107136 00000100:00100000:0.0:1746143760.873167:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13224 00000100:00100000:0.0:1746143760.873173:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31226:x1830963594107136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143760.873180:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143760.873190:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a744b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.873203:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.873208:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143760.873209:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143760.873212:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.873246:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x50080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143760.873255:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x70080400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 21 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.873263:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594329600:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143760.873312:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143760.873331:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 21 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:0.0:1746143760.873342:0:11106:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 21 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:0.0:1746143760.873349:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594329728:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143760.873679:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.876752:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594329600:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.876776:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.876790:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728800, rc 0) 00000100:00100000:2.0:1746143760.876836:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31226:x1830963594107136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3663us (3728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.876846:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13224 00000100:00100000:3.0:1746143760.877503:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594107008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5148us (6605us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143760.877510:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6195 00002000:00100000:3.0:1746143760.877517:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88009ff6e300 x1830963594107008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.877525:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963594107008 ext(4194304->4755455) 00002000:00010000:3.0:1746143760.877529:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6e300 00000100:00100000:1.0:1746143760.877604:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594329728:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143760.877614:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.877631:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594106752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4601us (6841us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.877638:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7061 00000100:00100000:0.0:1746143760.877866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.877904:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594107392 00000100:00100000:2.0:1746143760.877909:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594107392 00002000:00100000:2.0:1746143760.877933:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1155072->1159167) req@ffff8800a5c23b80 x1830963594107392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.877939:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23b80 with x1830963594107392 ext(1155072->1159167) 00010000:00010000:2.0:1746143760.877944:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.877955:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.877960:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c23b80 00000100:00100000:2.0:1746143760.877983:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1753 00000100:00100000:2.0:1746143760.877988:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594107392:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143760.878099:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594107392:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 110us (234us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143760.878103:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1753 00002000:00100000:2.0:1746143760.878108:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1155072->1159167) req@ffff8800a5c23b80 x1830963594107392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.878113:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c23b80 with x1830963594107392 ext(1155072->1159167) 00010000:00010000:2.0:1746143760.878117:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.878128:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.878133:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c23b80 00000100:00100000:0.0:1746143760.882693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.882834:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594107776 00000100:00100000:2.0:1746143760.882842:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594107776 00002000:00100000:2.0:1746143760.882876:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1331200->1335295) req@ffff8800a5c21180 x1830963594107776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.882886:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21180 with x1830963594107776 ext(1331200->1335295) 00010000:00010000:2.0:1746143760.882893:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.882906:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.882911:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c21180 00000100:00100000:2.0:1746143760.882989:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1754 00000100:00100000:2.0:1746143760.882996:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594107776:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143760.883193:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594107776:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 196us (507us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143760.883199:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1754 00002000:00100000:2.0:1746143760.883204:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1331200->1335295) req@ffff8800a5c21180 x1830963594107776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.883210:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21180 with x1830963594107776 ext(1331200->1335295) 00010000:00010000:2.0:1746143760.883215:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.883223:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.883239:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c21180 00000100:00100000:0.0:1746143760.884504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.884937:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594107648 00000100:00100000:2.0:1746143760.884942:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594107648 00000100:00100000:2.0:1746143760.885300:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13225 00000100:00100000:2.0:1746143760.885306:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594107648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.885324:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.885337:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800951f7800/0xe984082ccd72f539 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7452 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.885380:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594329856:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143760.885444:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.885680:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.885875:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594108032 00000100:00100000:2.0:1746143760.885880:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594108032 00002000:00100000:2.0:1746143760.885900:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1155072->1335295) req@ffff8800a5c21c00 x1830963594108032/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.885908:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21c00 with x1830963594108032 ext(1155072->1335295) 00010000:00010000:2.0:1746143760.885913:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.885923:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 20 pid: 2839 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.885933:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c21c00 00000100:00100000:2.0:1746143760.886302:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1755 00000100:00100000:2.0:1746143760.886309:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594108032:12345-192.168.202.48@tcp:4:multiop.0 00002000:00010000:2.0:1746143760.888676:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143759 -> 1746143760 00002000:00010000:2.0:1746143760.888683:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143759 -> 1746143760 00002000:00010000:2.0:1746143760.888685:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143759 -> 1746143760 00000100:00100000:2.0:1746143760.888698:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594329856:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143760.888722:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800951f7800/0xe984082ccd72f539 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7452 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.888735:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800951f7800/0xe984082ccd72f539 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7452 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.888746:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951f7800, rc 0) 00000100:00100000:2.0:1746143760.888778:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594107648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3472us (4277us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143760.888785:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13225 00000100:00100000:3.0:1746143760.890113:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594108032:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3801us (4428us total) trans 17179873072 rc 0/0 00000100:00100000:3.0:1746143760.890122:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1755 00002000:00100000:3.0:1746143760.890130:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1155072->1335295) req@ffff8800a5c21c00 x1830963594108032/t17179873072(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.890154:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21c00 with x1830963594108032 ext(1155072->1335295) 00010000:00010000:3.0:1746143760.890163:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 22 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.890174:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 22 pid: 2839 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.890180:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5c21c00 00000100:00100000:0.0:1746143760.891214:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.891292:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594108160 00000100:00100000:2.0:1746143760.891298:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594108160 00000100:00100000:2.0:1746143760.891341:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13226 00000100:00100000:2.0:1746143760.891348:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594108160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.891364:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.891375:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800951f7e00/0xe984082ccd72f540 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7459 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143760.891418:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594329984:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143760.891486:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143760.891775:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.891839:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594108288 00000100:00100000:1.0:1746143760.891844:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594108288 00010000:00010000:1.0:1746143760.891861:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 22 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.891880:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7062 00000100:00100000:1.0:1746143760.891885:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594108288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.891898:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.891912:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 22 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.891922:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 22 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.891938:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.891940:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.891945:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.891951:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.891968:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.891975:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594330112:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143760.891998:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.893481:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594330112:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143760.893495:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.893521:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594108288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1635us (1746us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143760.893667:0:25369:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff88009ff6d180 x1830963594329984) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 22 pid: 2839 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.893687:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a084f000/0xe984082ccd72f524 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1155072->1335295) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a743d expref: 22 pid: 2839 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.893697:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594329984:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143760.893715:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800951f7e00/0xe984082ccd72f540 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7459 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.893725:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800951f7e00/0xe984082ccd72f540 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7459 expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143760.893731:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951f7e00, rc 0) 00000100:00100000:2.0:1746143760.893754:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594108160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2406us (2542us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143760.893761:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13226 00000100:00100000:1.0:1746143760.893804:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7062 00000100:00100000:0.0:1746143760.896848:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.897032:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594108672 00000100:00100000:3.0:1746143760.897039:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594108672 00002000:00100000:3.0:1746143760.897078:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a050c380 x1830963594108672/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.897086:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050c380 with x1830963594108672 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.897090:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050c380 00000100:00100000:3.0:1746143760.897117:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6196 00000100:00100000:3.0:1746143760.897124:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594108672:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143760.897342:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143760.897398:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594108928 00000100:00100000:0.0:1746143760.897402:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594108928 00000100:00100000:0.0:1746143760.897422:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3914 00000100:00100000:0.0:1746143760.897427:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31222:x1830963594108928:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143760.898104:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31222:x1830963594108928:12345-192.168.202.48@tcp:35:cat.0 Request processed in 674us (760us total) trans 8589943457 rc 0/0 00000100:00100000:0.0:1746143760.898111:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3914 00000100:00100000:3.0:1746143760.904491:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594108672:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7359us (7641us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143760.904501:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6196 00002000:00100000:3.0:1746143760.904512:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a050c380 x1830963594108672/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.904521:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050c380 with x1830963594108672 ext(1048576->2097151) 00002000:00010000:3.0:1746143760.904526:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050c380 00000100:00100000:1.0:1746143760.911391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.912664:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594109056 00000100:00100000:2.0:1746143760.912673:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594109056 00000100:00100000:2.0:1746143760.912825:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13227 00000100:00100000:2.0:1746143760.912833:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31226:x1830963594109056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143760.912851:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.912867:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7460 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.912891:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.912898:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143760.912900:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143760.912902:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.912927:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 25 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.912939:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 25 pid: 15784 timeout: 939 lvb_type: 0 00000100:00100000:2.0:1746143760.912950:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594330240:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143760.913376:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143760.915531:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594330240:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143760.915555:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.915568:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951f7000, rc 0) 00000100:00100000:2.0:1746143760.916029:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31226:x1830963594109056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3195us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143760.916037:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13227 00000100:00100000:0.0:1746143760.916290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.916512:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594109312 00000100:00100000:2.0:1746143760.916517:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594109312 00000100:00100000:2.0:1746143760.916546:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9149 00000100:00100000:2.0:1746143760.916551:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31232:x1830963594109312:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143760.916567:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143760.916578:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6c00/0xe984082ccd72f54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7467 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.916668:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916677:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916686:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916696:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916701:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916705:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916788:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916794:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916800:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143760.916808:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143760.916870:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916876:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916881:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916886:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800951f6600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143760.916889:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916895:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916903:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143760.916905:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143760.916908:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916913:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6600/0xe984082ccd72f555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916926:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916930:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916938:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916942:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800951f6400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143760.916944:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916948:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916953:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd200) 00010000:00010000:2.0:1746143760.916955:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143760.916957:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916961:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6400/0xe984082ccd72f55c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143760.916989:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6c00/0xe984082ccd72f54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 247 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.916997:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 246 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143760.917003:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143760.917005:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143760.917007:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800951f6200, rc 0) 00000100:00100000:2.0:1746143760.918495:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31232:x1830963594109312:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1937us (2199us total) trans 8589943458 rc 0/0 00000100:00100000:2.0:1746143760.918502:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9149 00000100:00100000:1.0:1746143760.919040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143760.919097:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594109440 00000100:00100000:3.0:1746143760.919103:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594109440 00002000:00100000:3.0:1746143760.919135:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1056768->2064383) req@ffff880094304700 x1830963594109440/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143760.919164:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963594109440 ext(1056768->2064383) 00010000:00010000:3.0:1746143760.919172:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 26 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:3.0:1746143760.919183:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 26 pid: 15784 timeout: 939 lvb_type: 0 00002000:00010000:3.0:1746143760.919189:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094304700 00000100:00100000:3.0:1746143760.919202:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1756 00000100:00100000:3.0:1746143760.919733:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594109440:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143760.934294:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594109440:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15078us (15247us total) trans 21474840397 rc 0/0 00000100:00100000:2.0:1746143760.934304:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1756 00002000:00100000:2.0:1746143760.934314:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1056768->2064383) req@ffff880094304700 x1830963594109440/t21474840397(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:156/0 lens 488/448 e 0 to 0 dl 1746143771 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.934323:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963594109440 ext(1056768->2064383) 00010000:00010000:2.0:1746143760.934331:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 28 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:2.0:1746143760.934345:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 28 pid: 15784 timeout: 939 lvb_type: 0 00002000:00010000:2.0:1746143760.934351:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094304700 00000100:00100000:0.0:1746143760.939014:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143760.939363:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594109568 00000100:00100000:1.0:1746143760.939373:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594109568 00010000:00010000:1.0:1746143760.939413:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 28 pid: 15784 timeout: 939 lvb_type: 0 00000100:00100000:1.0:1746143760.939473:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7063 00000100:00100000:1.0:1746143760.939482:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594109568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143760.939497:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143760.939521:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 28 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.939533:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 28 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.939554:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095728e00/0xe984082ccd72f498 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1056768->2064383) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f7 expref: 28 pid: 15784 timeout: 939 lvb_type: 0 00010000:00010000:1.0:1746143760.939599:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.939602:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143760.939611:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.939619:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143760.939656:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143760.939670:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594330368:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143760.939781:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143760.941272:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594330368:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143760.941290:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143760.941348:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594109568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1865us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143760.941357:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7063 00000100:00100000:0.0:1746143760.946060:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.946515:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594109824 00000100:00100000:2.0:1746143760.946522:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594109824 00002000:00100000:2.0:1746143760.946563:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a050ce00 x1830963594109824/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/0 e 0 to 0 dl 1746143771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.946572:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050ce00 with x1830963594109824 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.946577:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a050ce00 00000100:00100000:2.0:1746143760.946603:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6197 00000100:00100000:2.0:1746143760.946610:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594109824:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143760.955448:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594109824:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8830us (9388us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143760.955459:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6197 00002000:00100000:2.0:1746143760.955470:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a050ce00 x1830963594109824/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:156/0 lens 488/440 e 0 to 0 dl 1746143771 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143760.955479:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050ce00 with x1830963594109824 ext(1048576->2097151) 00002000:00010000:2.0:1746143760.955484:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a050ce00 00000100:00100000:0.0:1746143760.967131:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143760.967264:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594110080 00000100:00100000:2.0:1746143760.967272:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594110080 00000100:00100000:2.0:1746143760.967316:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3915 00000100:00100000:2.0:1746143760.967323:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31226:x1830963594110080:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143760.967508:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31226:x1830963594110080:12345-192.168.202.48@tcp:35:cat.0 Request processed in 185us (383us total) trans 8589943459 rc 0/0 00000100:00100000:2.0:1746143760.967514:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3915 00000100:00100000:0.0:1746143761.012732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.012817:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594110336 00000100:00100000:2.0:1746143761.012825:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594110336 00000100:00100000:2.0:1746143761.012864:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9150 00000100:00100000:2.0:1746143761.012871:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31235:x1830963594110336:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143761.012893:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.012907:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf0e00/0xe984082ccd72f571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a746e expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.013000:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013011:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013021:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013034:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013040:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013046:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013134:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013165:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013172:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143761.013181:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143761.013265:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013271:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013276:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013281:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bf1000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143761.013284:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013290:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013298:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143761.013301:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143761.013305:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013308:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1000/0xe984082ccd72f578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013333:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013337:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013341:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013345:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bf1200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143761.013346:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013350:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013356:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd300) 00010000:00010000:2.0:1746143761.013358:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143761.013360:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013364:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1200/0xe984082ccd72f57f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.013394:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf0e00/0xe984082ccd72f571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 17 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.013408:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 16 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.013413:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143761.013415:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143761.013417:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bf1400, rc 0) 00000100:00100000:2.0:1746143761.013468:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31235:x1830963594110336:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 597us (741us total) trans 8589943460 rc 0/0 00000100:00100000:2.0:1746143761.013474:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9150 00000100:00100000:0.0:1746143761.016926:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.019355:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594110592 00000100:00100000:2.0:1746143761.019365:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594110592 00000100:00100000:2.0:1746143761.020443:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3916 00000100:00100000:2.0:1746143761.020453:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31235:x1830963594110592:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143761.020652:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd66450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31235:x1830963594110592:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 201us (3732us total) trans 8589943461 rc 0/0 00000100:00100000:2.0:1746143761.020659:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3916 00000100:00100000:0.0:1746143761.032807:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.033119:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594110720 00000100:00100000:2.0:1746143761.033128:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594110720 00000100:00100000:2.0:1746143761.033262:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13228 00000100:00100000:2.0:1746143761.033269:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31235:x1830963594110720:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143761.033283:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.033296:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7475 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.033320:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.033329:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.033335:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.033337:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.033340:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3002368->3145727] (req 3002368->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.033365:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.033375:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 25 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.033385:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594330496:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143761.033475:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.033482:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 22 pid: 4582 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143761.033490:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594330624:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.033512:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.036857:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594330496:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143761.039362:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.039570:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594110848 00000100:00100000:1.0:1746143761.039577:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594110848 00010000:00010000:1.0:1746143761.039606:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 26 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.039906:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7064 00000100:00100000:1.0:1746143761.039913:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594110848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143761.039925:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143761.039944:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 26 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.039959:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 26 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.039978:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094603c00/0xe984082ccd72f40c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a739c expref: 26 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.040001:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143761.040036:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594110848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 123us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.040041:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7064 00000100:00100000:2.0:1746143761.041350:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594330624:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143761.041380:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3002368->3145727] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.041392:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bf1800, rc 0) 00000100:00100000:2.0:1746143761.041418:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31235:x1830963594110720:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8150us (8618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.041424:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13228 00000100:00100000:0.0:1746143761.044507:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.045123:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594110976 00000100:00100000:2.0:1746143761.045132:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594110976 00010000:00010000:2.0:1746143761.045275:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 22 pid: 4582 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143761.045505:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7065 00000100:00100000:2.0:1746143761.045512:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594110976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.045524:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.045544:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 22 pid: 4582 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.045555:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 22 pid: 4582 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.045573:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f3f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a738e expref: 22 pid: 4582 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.045650:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.045653:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.045660:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.045667:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.045696:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.045706:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594330752:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143761.045773:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.045901:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.045950:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594111104 00000100:00100000:2.0:1746143761.045953:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594111104 00000100:00100000:2.0:1746143761.045978:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13229 00000100:00100000:2.0:1746143761.045985:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31232:x1830963594111104:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143761.045999:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.046010:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a747c expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.046025:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.046029:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.046032:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.046034:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.046035:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2457600->3145727] (req 2457600->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.046047:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.046053:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 17 pid: 15784 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143761.046058:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594330880:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143761.046089:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.046096:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 28 pid: 4582 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.046103:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594331008:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.046131:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.049391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.049497:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594330752:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143761.049518:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.049552:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594110976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4040us (5049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.049561:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7065 00000100:00100000:2.0:1746143761.049590:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594111360 00000100:00100000:2.0:1746143761.049594:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594111360 00002000:00100000:2.0:1746143761.049618:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3002368->3006463) req@ffff8800a050e680 x1830963594111360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.049628:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050e680 with x1830963594111360 ext(3002368->3006463) 00002000:00010000:2.0:1746143761.049631:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050e680 00000100:00100000:2.0:1746143761.049658:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6198 00000100:00100000:2.0:1746143761.049664:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594111360:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.049787:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594111360:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (403us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.049792:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6198 00002000:00100000:2.0:1746143761.049797:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3002368->3006463) req@ffff8800a050e680 x1830963594111360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.049803:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050e680 with x1830963594111360 ext(3002368->3006463) 00002000:00010000:2.0:1746143761.049806:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050e680 00000100:00100000:3.0:1746143761.050323:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594330880:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.050333:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594331008:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.050352:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2457600->3145727] (req 2457600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.050364:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bf1c00, rc 0) 00000100:00100000:3.0:1746143761.050400:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31232:x1830963594111104:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4414us (4499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.050407:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13229 00000100:00100000:0.0:1746143761.051362:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.051815:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594111488 00000100:00100000:2.0:1746143761.051819:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594111488 00010000:00010000:2.0:1746143761.051841:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 18 pid: 15784 timeout: 940 lvb_type: 1 00000100:00100000:0.0:1746143761.052040:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.052776:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594111616 00000100:00100000:2.0:1746143761.052780:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594111616 00010000:00010000:2.0:1746143761.052795:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 28 pid: 4582 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.052812:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7066 00000100:00100000:2.0:1746143761.052818:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594111488:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.052829:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.052848:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 18 pid: 15784 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143761.052855:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7067 00010000:00010000:2.0:1746143761.052857:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 18 pid: 15784 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.052874:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f193200/0xe984082ccd72f3f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7387 expref: 18 pid: 15784 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.052890:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.053088:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594111488:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 268us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.053091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.053167:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594111744 00000100:00100000:0.0:1746143761.053170:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594111744 00000100:00100000:0.0:1746143761.053191:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13230 00000100:00100000:0.0:1746143761.053196:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31235:x1830963594111744:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143761.053208:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143761.053217:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963594111616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.053217:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7483 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.053224:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143761.053240:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 28 pid: 4582 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.053242:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.053244:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.053248:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->3309567] (req 3145728->3309567) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 19 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.053257:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 28 pid: 4582 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.053291:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7066 00010000:00010000:1.0:1746143761.053695:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f3cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7364 expref: 28 pid: 4582 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.053696:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->3309567] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.053706:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.053707:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.053725:0:25369:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.053737:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.053744:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.053745:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.053748:0:25369:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.053754:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.053781:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143761.053805:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594111616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 590us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.053814:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7067 00010000:00010000:3.0:1746143761.055362:0:25369:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 18 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.055377:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594331136:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.055449:0:25369:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.055457:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594331264:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.055474:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.058128:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594331136:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.058159:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594331264:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.058179:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089e000, rc 0) 00000100:00100000:3.0:1746143761.058514:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31235:x1830963594111744:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5310us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.058522:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13230 00000100:00100000:0.0:1746143761.058702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.058763:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594112000 00000100:00100000:1.0:1746143761.058770:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594112000 00002000:00100000:1.0:1746143761.058800:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2457600->2461695) req@ffff8800a050f100 x1830963594112000/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.058808:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050f100 with x1830963594112000 ext(2457600->2461695) 00002000:00010000:1.0:1746143761.058812:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a050f100 00000100:00100000:1.0:1746143761.058842:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6199 00000100:00100000:1.0:1746143761.058848:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594112000:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143761.058979:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594112000:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 131us (277us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143761.058985:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6199 00002000:00100000:1.0:1746143761.058989:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2457600->2461695) req@ffff8800a050f100 x1830963594112000/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.058996:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050f100 with x1830963594112000 ext(2457600->2461695) 00002000:00010000:1.0:1746143761.058999:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a050f100 00000100:00100000:2.0:1746143761.066548:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.067726:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.067827:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594112384 00000100:00100000:3.0:1746143761.067834:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594112384 00000100:00100000:3.0:1746143761.067872:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13231 00000100:00100000:3.0:1746143761.067878:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31232:x1830963594112384:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143761.067894:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.067909:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a748a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.067939:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.067946:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.067947:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.067950:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.067974:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 20 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.067985:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 20 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.068002:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594331392:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143761.068155:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594112256 00000100:00100000:0.0:1746143761.068159:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594112256 00002000:00100000:0.0:1746143761.068184:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3305472->3309567) req@ffff88012fc10e00 x1830963594112256/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.068192:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10e00 with x1830963594112256 ext(3305472->3309567) 00002000:00010000:0.0:1746143761.068196:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10e00 00000100:00100000:0.0:1746143761.068208:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6200 00000100:00100000:0.0:1746143761.068213:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594112256:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143761.068344:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594112256:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 130us (1803us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143761.068350:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6200 00002000:00100000:0.0:1746143761.068355:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3305472->3309567) req@ffff88012fc10e00 x1830963594112256/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.068367:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10e00 with x1830963594112256 ext(3305472->3309567) 00002000:00010000:0.0:1746143761.068370:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10e00 00000100:00100000:3.0:1746143761.069936:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.069961:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594331392:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.069985:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.069999:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090671e00, rc 0) 00000100:00100000:3.0:1746143761.070024:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31232:x1830963594112384:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2145us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.070031:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13231 00000100:00100000:2.0:1746143761.070554:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.070796:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594112512 00000100:00100000:1.0:1746143761.070801:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594112512 00002000:00100000:1.0:1746143761.070830:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3002368->3145727) req@ffff88009ff6ca80 x1830963594112512/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.070838:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963594112512 ext(3002368->3145727) 00010000:00010000:1.0:1746143761.070844:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 21 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.070860:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 21 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143761.070866:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6ca80 00000100:00100000:1.0:1746143761.070880:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1757 00000100:00100000:1.0:1746143761.070886:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594112512:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143761.076073:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594112512:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5180us (5513us total) trans 17179873073 rc 0/0 00000100:00100000:1.0:1746143761.076083:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1757 00002000:00100000:1.0:1746143761.076092:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3002368->3145727) req@ffff88009ff6ca80 x1830963594112512/t17179873073(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.076101:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963594112512 ext(3002368->3145727) 00010000:00010000:1.0:1746143761.076109:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 23 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.076122:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 23 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143761.076129:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6ca80 00000100:00100000:0.0:1746143761.082515:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.082617:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594112640 00000100:00100000:1.0:1746143761.082625:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594112640 00010000:00010000:1.0:1746143761.082658:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 23 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.082703:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7068 00000100:00100000:1.0:1746143761.082710:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594112640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143761.082723:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143761.082741:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 23 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.082751:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 23 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.082770:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bf1800/0xe984082ccd72f594 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3002368->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7475 expref: 23 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.082800:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.082802:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.082808:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.082816:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.082841:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143761.082852:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594331520:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143761.084666:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143761.087013:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594331520:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143761.087033:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143761.087066:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594112640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4356us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.087075:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7068 00000100:00100000:0.0:1746143761.088374:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.088466:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594112896 00000100:00100000:1.0:1746143761.088472:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594112896 00002000:00100000:1.0:1746143761.088504:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2269184->2273279) req@ffff8800a050f800 x1830963594112896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.088514:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050f800 with x1830963594112896 ext(2269184->2273279) 00002000:00010000:1.0:1746143761.088518:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050f800 00000100:00100000:1.0:1746143761.088532:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6201 00000100:00100000:1.0:1746143761.088539:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594112896:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143761.088686:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594112896:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 147us (314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143761.088692:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6201 00002000:00100000:1.0:1746143761.088697:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2269184->2273279) req@ffff8800a050f800 x1830963594112896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.088704:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050f800 with x1830963594112896 ext(2269184->2273279) 00002000:00010000:1.0:1746143761.088707:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050f800 00000100:00100000:0.0:1746143761.095611:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.095767:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594113152 00000100:00100000:1.0:1746143761.095775:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594113152 00000100:00100000:1.0:1746143761.095825:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3917 00000100:00100000:1.0:1746143761.095832:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31232:x1830963594113152:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143761.096030:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31232:x1830963594113152:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 197us (424us total) trans 8589943462 rc 0/0 00000100:00100000:1.0:1746143761.096036:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3917 00000100:00100000:0.0:1746143761.129015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.129170:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594113408 00000100:00100000:2.0:1746143761.129177:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594113408 00000100:00100000:2.0:1746143761.129733:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9151 00000100:00100000:2.0:1746143761.129745:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31240:x1830963594113408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.129766:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.129781:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f200/0xe984082ccd72f5b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7491 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.129880:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.129891:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.129901:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.129912:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.129916:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.129921:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130010:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5c5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130018:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130023:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143761.130031:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143761.130103:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130109:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130113:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130118:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac3f400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143761.130121:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130127:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130135:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143761.130158:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143761.130162:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130166:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f400/0xe984082ccd72f5b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130197:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130202:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130206:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130210:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac3f600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143761.130212:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130216:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130223:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd200) 00010000:00010000:2.0:1746143761.130233:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143761.130236:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130240:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f600/0xe984082ccd72f5be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.130274:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f200/0xe984082ccd72f5b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7491 expref: 250 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.130284:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7491 expref: 249 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.130289:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143761.130290:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143761.130292:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac3f800, rc 0) 00000100:00100000:2.0:1746143761.130351:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31240:x1830963594113408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 609us (1343us total) trans 8589943463 rc 0/0 00000100:00100000:2.0:1746143761.132859:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9151 00000100:00100000:2.0:1746143761.133154:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.134328:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594113536 00000100:00100000:1.0:1746143761.134335:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594113536 00000100:00100000:1.0:1746143761.134379:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 722 00000100:00100000:1.0:1746143761.134386:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1963:x1830963594113536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143761.134397:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143761.134416:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5c5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7491 expref: 249 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.134441:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.134445:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143761.134478:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1963:x1830963594113536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.134483:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 722 00000100:00100000:0.0:1746143761.136237:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.136272:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.136312:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.136380:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594113664 00000100:00100000:3.0:1746143761.136386:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594113920 00000100:00100000:2.0:1746143761.136387:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594113664 00000100:00100000:3.0:1746143761.136390:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594113920 00000100:00100000:3.0:1746143761.136466:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594113792 00000100:00100000:3.0:1746143761.136470:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594113792 00000100:00100000:3.0:1746143761.136488:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13232 00000100:00100000:3.0:1746143761.136493:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594113664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.136507:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.136520:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7498 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.136543:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.136545:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.136552:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.136566:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.136574:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e9a00, rc 0) 00000100:00100000:2.0:1746143761.136581:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13233 00000100:00100000:2.0:1746143761.136588:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594113920:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.136595:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.136604:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74a6 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.136606:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594113664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.136611:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13232 00000100:00100000:3.0:1746143761.136624:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13234 00000100:00100000:3.0:1746143761.136629:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594113792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.136634:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.136641:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a749f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.136641:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594331648:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143761.136650:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.136652:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.136656:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.136665:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.136671:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090670e00, rc 0) 00000100:00100000:3.0:1746143761.136686:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594113792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.136705:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.136736:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13234 00002000:00010000:2.0:1746143761.140536:0:2839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143758 -> 1746143760 00002000:00010000:2.0:1746143761.140542:0:2839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143758 -> 1746143760 00002000:00010000:2.0:1746143761.140544:0:2839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143758 -> 1746143760 00000100:00100000:2.0:1746143761.140566:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594331648:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143761.140592:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5da lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74a6 expref: 29 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.140605:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74a6 expref: 29 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.140939:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac3f000, rc 0) 00000100:00100000:2.0:1746143761.140992:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594113920:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4403us (4717us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143761.140999:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13233 00000100:00100000:0.0:1746143761.149620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.149668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.149819:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594114304 00000100:00100000:1.0:1746143761.149827:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594114304 00002000:00100000:1.0:1746143761.149866:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a050df80 x1830963594114304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.149876:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050df80 with x1830963594114304 ext(1048576->2097151) 00002000:00010000:1.0:1746143761.149880:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050df80 00000100:00100000:1.0:1746143761.149908:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594114432 00000100:00100000:1.0:1746143761.149911:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594114432 00002000:00100000:1.0:1746143761.149924:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a050ea00 x1830963594114432/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.149930:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050ea00 with x1830963594114432 ext(1048576->2097151) 00002000:00010000:1.0:1746143761.149935:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a050ea00 00000100:00100000:1.0:1746143761.149948:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6202 00000100:00100000:1.0:1746143761.149955:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594114304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143761.150021:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6203 00000100:00100000:2.0:1746143761.150028:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594114432:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143761.164287:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594114432:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14250us (14609us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143761.164297:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6203 00002000:00100000:2.0:1746143761.164307:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a050ea00 x1830963594114432/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.164315:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050ea00 with x1830963594114432 ext(1048576->2097151) 00002000:00010000:2.0:1746143761.164324:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a050ea00 00000100:00100000:1.0:1746143761.167094:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594114304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17131us (17472us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143761.167103:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6202 00002000:00100000:1.0:1746143761.167112:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a050df80 x1830963594114304/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.167120:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050df80 with x1830963594114304 ext(1048576->2097151) 00002000:00010000:1.0:1746143761.167125:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050df80 00000100:00100000:0.0:1746143761.178340:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.179555:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594114560 00000100:00100000:2.0:1746143761.179565:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594114560 00000100:00100000:2.0:1746143761.180173:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9152 00000100:00100000:2.0:1746143761.180181:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31241:x1830963594114560:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143761.180203:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.180218:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fc00/0xe984082ccd72f5e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74ad expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.180281:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.180291:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.180299:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.180309:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.180315:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.180320:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143761.180609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.180649:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.180712:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594114816 00000100:00100000:0.0:1746143761.180716:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594114816 00002000:00100000:0.0:1746143761.180739:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2457599) req@ffff880094305880 x1830963594114816/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.180747:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305880 with x1830963594114816 ext(2097152->2457599) 00002000:00010000:0.0:1746143761.180751:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305880 00000100:00100000:0.0:1746143761.180761:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594115072 00000100:00100000:0.0:1746143761.180763:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594115072 00002000:00100000:0.0:1746143761.180770:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2273280->3145727) req@ffff880094306a00 x1830963594115072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.180775:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306a00 with x1830963594115072 ext(2273280->3145727) 00002000:00010000:0.0:1746143761.180778:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306a00 00000100:00100000:0.0:1746143761.180785:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6204 00000100:00100000:0.0:1746143761.180790:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594114816:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143761.181315:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.181325:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 16 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.181332:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.181355:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 16 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.181369:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 16 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.181378:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594331776:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.181426:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.181449:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6205 00000100:00100000:2.0:1746143761.181454:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594115072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.190667:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594331776:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.190687:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143761.191842:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594114816:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11046us (11228us total) trans 0 rc 360448/360448 00000100:00100000:2.0:1746143761.191852:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6204 00002000:00100000:2.0:1746143761.191862:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2457599) req@ffff880094305880 x1830963594114816/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 360448/360448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.191869:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305880 with x1830963594114816 ext(2097152->2457599) 00002000:00010000:2.0:1746143761.191874:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305880 00000100:00100000:0.0:1746143761.193208:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.193267:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594115328 00000100:00100000:2.0:1746143761.193273:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594115328 00000100:00100000:2.0:1746143761.194004:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3918 00000100:00100000:2.0:1746143761.194013:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:7695:x1830963594115328:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143761.194235:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:7695:x1830963594115328:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 212us (1019us total) trans 8589943464 rc 0/0 00000100:00100000:2.0:1746143761.194241:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3918 00000100:00100000:2.0:1746143761.198512:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594115072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17050us (17855us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746143761.198525:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6205 00002000:00100000:2.0:1746143761.198534:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2273280->3145727) req@ffff880094306a00 x1830963594115072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.198542:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306a00 with x1830963594115072 ext(2273280->3145727) 00002000:00010000:2.0:1746143761.198547:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306a00 00000100:00100000:0.0:1746143761.212421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.212604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.212693:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594115712 00000100:00100000:1.0:1746143761.212700:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594115712 00000100:00100000:1.0:1746143761.212740:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9153 00000100:00100000:1.0:1746143761.212746:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31243:x1830963594115712:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.212767:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.212782:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835a00/0xe984082ccd72f604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74b4 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.212813:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594115456 00000100:00100000:0.0:1746143761.212813:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.212817:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594115456 00010000:00010000:3.0:1746143761.212837:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 20 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.212853:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7069 00000100:00100000:3.0:1746143761.212859:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594115456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.212866:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.212871:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 20 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.212875:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143761.212880:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 20 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.212899:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084f400/0xe984082ccd72f516 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7436 expref: 20 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.212920:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594115840 00010000:00010000:3.0:1746143761.212921:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00000100:00100000:2.0:1746143761.212924:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594115840 00010000:00010000:3.0:1746143761.212925:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.212931:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.212935:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.212951:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.212958:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13235 00000100:00100000:2.0:1746143761.212963:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31240:x1830963594115840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.212971:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.212979:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74bb expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.212990:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594115456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 130us (576us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143761.212996:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.212997:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7069 00010000:00010000:2.0:1746143761.213002:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143761.213004:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143761.213007:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.213017:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213023:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.213026:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 17 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.213035:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 17 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.213044:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594331904:192.168.202.48@tcp:104: 00000004:00200000:3.0:1746143761.213055:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:3.0:1746143761.213059:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143761.213073:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213082:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143761.213091:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746143761.213324:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143761.213333:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.213333:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143761.213340:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.213342:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143761.213345:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.213348:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143761.213349:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac3f000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143761.213353:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.213354:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143761.213359:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213366:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143761.213368:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143761.213369:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213373:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f000/0xe984082ccd72f5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213380:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213385:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213389:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213392:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac3f800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143761.213394:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213398:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213403:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd900) 00010000:00010000:3.0:1746143761.213405:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143761.213406:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213410:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3f800/0xe984082ccd72f5f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.213429:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fc00/0xe984082ccd72f5e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.213438:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 7 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.213443:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:3.0:1746143761.213444:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143761.213446:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143761.213447:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac3fe00, rc 0) 00010000:00010000:1.0:1746143761.213450:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213456:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143761.213462:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:3.0:1746143761.213468:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31241:x1830963594114560:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 33289us (35137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.213474:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9152 00010000:00010000:1.0:1746143761.213525:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213530:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213534:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213538:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0835800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.213541:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213544:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213552:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143761.213554:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.213556:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213560:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835800/0xe984082ccd72f60b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213583:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213588:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213592:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213596:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0835600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.213599:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213603:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213608:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd900) 00010000:00010000:1.0:1746143761.213610:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.213612:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213616:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835600/0xe984082ccd72f619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.213640:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835a00/0xe984082ccd72f604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 20 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.213649:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 19 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.213653:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.213655:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143761.213657:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0835400, rc 0) 00000100:00100000:1.0:1746143761.213673:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31243:x1830963594115712:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 928us (1070us total) trans 8589943465 rc 0/0 00000100:00100000:1.0:1746143761.213678:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9153 00000100:00100000:2.0:1746143761.221452:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594331904:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143761.221478:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.221493:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac3ee00, rc 0) 00000100:00100000:2.0:1746143761.223746:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31240:x1830963594115840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 10774us (10924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.223760:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13235 00000100:00100000:1.0:1746143761.224084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.224112:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116096 00000100:00100000:1.0:1746143761.224117:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116096 00000100:00100000:1.0:1746143761.224162:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9154 00000100:00100000:1.0:1746143761.224169:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31247:x1830963594116096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.224187:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.224200:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835200/0xe984082ccd72f62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74c2 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.224284:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.224296:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.224304:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143761.224479:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.224545:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116224 00000100:00100000:2.0:1746143761.224549:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116224 00002000:00100000:2.0:1746143761.224572:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3309567) req@ffff8800a050ca80 x1830963594116224/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.224579:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050ca80 with x1830963594116224 ext(3145728->3309567) 00010000:00010000:2.0:1746143761.224585:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 18 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.224594:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 18 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.224599:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a050ca80 00000100:00100000:2.0:1746143761.224612:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1758 00000100:00100000:2.0:1746143761.224616:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594116224:12345-192.168.202.48@tcp:4:multiop.0 00000004:00200000:1.0:1746143761.225566:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143761.225675:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835200/0xe984082ccd72f62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 22 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.225691:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 21 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.225697:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.225699:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143761.225702:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0835000, rc 0) 00000100:00100000:1.0:1746143761.225745:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31247:x1830963594116096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1576us (1661us total) trans 8589943466 rc 0/0 00000100:00100000:1.0:1746143761.225751:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9154 00000100:00100000:2.0:1746143761.229540:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.230175:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594117248 00000100:00100000:1.0:1746143761.230183:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594117248 00000100:00100000:1.0:1746143761.230234:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9155 00000100:00100000:1.0:1746143761.230241:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31248:x1830963594117248:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.230260:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.230274:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834c00/0xe984082ccd72f643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74f3 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.230365:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230376:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230385:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230395:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230401:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230405:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230492:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230499:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230505:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143761.230514:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143761.230581:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230587:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230592:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230597:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0834a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.230601:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230606:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230615:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143761.230618:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.230621:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230625:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834a00/0xe984082ccd72f64a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230634:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230638:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230642:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230645:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0834800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.230647:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230650:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230655:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74f00) 00010000:00010000:1.0:1746143761.230656:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.230658:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230661:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834800/0xe984082ccd72f651 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.230687:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834c00/0xe984082ccd72f643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 251 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.230700:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 250 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.230705:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.230707:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143761.230709:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0834600, rc 0) 00000100:00100000:1.0:1746143761.230750:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31248:x1830963594117248:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 510us (1216us total) trans 8589943467 rc 0/0 00000100:00100000:1.0:1746143761.230755:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9155 00000100:00100000:0.0:1746143761.231083:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.231110:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.231127:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.231171:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.231185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.231213:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.231240:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116352 00000100:00100000:0.0:1746143761.231243:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116352 00000100:00100000:0.0:1746143761.231262:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116608 00000100:00100000:0.0:1746143761.231263:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116608 00000100:00100000:0.0:1746143761.231271:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116864 00000100:00100000:0.0:1746143761.231273:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116864 00000100:00100000:0.0:1746143761.231279:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116480 00000100:00100000:0.0:1746143761.231281:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116480 00000100:00100000:0.0:1746143761.231288:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116736 00000100:00100000:0.0:1746143761.231290:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116736 00000100:00100000:0.0:1746143761.231297:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594116992 00000100:00100000:0.0:1746143761.231298:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594116992 00000100:00100000:0.0:1746143761.231308:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13236 00000100:00100000:0.0:1746143761.231313:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594116352:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143761.231321:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.231329:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74c9 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.231345:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231347:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231353:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231363:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231370:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed3d400, rc 0) 00000100:00100000:0.0:1746143761.231387:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594116352:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.231391:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13236 00000100:00100000:0.0:1746143761.231400:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13237 00000100:00100000:0.0:1746143761.231405:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594116608:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143761.231410:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.231417:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74d7 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.231427:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231428:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231431:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231440:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231451:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed3c800, rc 0) 00000100:00100000:0.0:1746143761.231464:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594116608:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.231468:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13237 00000100:00100000:0.0:1746143761.231476:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13238 00000100:00100000:0.0:1746143761.231480:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594116864:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143761.231485:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.231490:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ca00/0xe984082ccd72f674 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74e5 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.231517:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594332032:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143761.231557:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.231572:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13239 00000100:00100000:0.0:1746143761.231576:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594116480:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143761.231581:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.231586:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74d0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.231592:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231593:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231597:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231605:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231611:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed3da00, rc 0) 00000100:00100000:0.0:1746143761.231621:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594116480:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 45us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.231625:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13239 00000100:00100000:0.0:1746143761.231632:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13240 00000100:00100000:0.0:1746143761.231635:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594116736:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143761.231639:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.231643:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74de expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.231649:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231650:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.231653:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231660:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.231665:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed3ce00, rc 0) 00000100:00100000:0.0:1746143761.231673:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963594116736:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 38us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.231677:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13240 00000100:00100000:0.0:1746143761.231682:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13241 00000100:00100000:0.0:1746143761.231685:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594116992:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143761.231691:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.231695:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed3d000/0xe984082ccd72f689 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74ec expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.231709:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594332160:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143761.231723:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.233067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.233079:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594117376 00000100:00100000:0.0:1746143761.233083:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594117376 00000100:00100000:0.0:1746143761.233104:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13242 00000100:00100000:0.0:1746143761.233109:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594117376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143761.233118:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.233126:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ed3c400/0xe984082ccd72f690 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a74fa expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.233168:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594332288:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143761.233207:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.233268:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.233943:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594116224:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 9325us (9463us total) trans 21474840398 rc 0/0 00000100:00100000:2.0:1746143761.233952:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1758 00002000:00100000:2.0:1746143761.233960:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3309567) req@ffff8800a050ca80 x1830963594116224/t21474840398(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.233969:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050ca80 with x1830963594116224 ext(3145728->3309567) 00010000:00010000:2.0:1746143761.233975:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.233986:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.233992:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a050ca80 00000100:00100000:2.0:1746143761.234008:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594117504 00000100:00100000:2.0:1746143761.234011:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594117504 00000100:00100000:2.0:1746143761.234026:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13243 00000100:00100000:2.0:1746143761.234030:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594117504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.234036:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.234043:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac3ec00/0xe984082ccd72f697 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7501 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.234063:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594332416:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143761.234081:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.240899:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.240967:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594117632 00000100:00100000:3.0:1746143761.240974:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594117632 00000100:00100000:3.0:1746143761.241021:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13244 00000100:00100000:3.0:1746143761.241028:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31248:x1830963594117632:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143761.241046:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.241060:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7508 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.241082:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.241089:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.241095:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 28 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.241100:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.241102:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.241105:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1413120->1531903] (req 1413120->1531903) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.241130:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 28 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.241178:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 28 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.241190:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594332544:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.241294:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.241307:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 11 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.241316:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594332672:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.241343:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.241369:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 23 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.241706:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594332800:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.241742:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.244602:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.245294:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594117760 00000100:00100000:3.0:1746143761.245301:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594117760 00010000:00010000:3.0:1746143761.245333:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.247858:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7070 00000100:00100000:3.0:1746143761.247876:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594117760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.247893:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.247915:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.247929:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.247950:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.247952:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.247958:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 28 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.247965:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 28 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.247992:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 28 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.248003:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594332928:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.248296:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143761.250116:0:8495:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff8800a04cdc00 x1830963594332288) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143761.250165:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594332288:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143761.250189:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed3c400/0xe984082ccd72f690 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74fa expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.250202:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed3c400/0xe984082ccd72f690 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74fa expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.250215:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed3c400, rc 0) 00000100:00100000:0.0:1746143761.250262:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594117376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 17151us (17196us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143761.250269:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13242 00000100:00100000:0.0:1746143761.250900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.250917:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594118016 00000100:00100000:0.0:1746143761.250922:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594118016 00010000:00010000:0.0:1746143761.250942:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 12 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:0.0:1746143761.250960:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7071 00000100:00100000:0.0:1746143761.250965:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594118016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.250973:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.250986:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 12 pid: 4581 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143761.250993:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 12 pid: 4581 timeout: 940 lvb_type: 1 00010000:00010000:0.0:1746143761.251008:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.251027:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594118016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.251035:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7071 00002000:00010000:1.0:1746143761.251073:0:9527:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143758 -> 1746143760 00000100:00100000:1.0:1746143761.251084:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594332160:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143761.251097:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed3d000/0xe984082ccd72f689 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ec expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143761.251099:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594332544:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.251105:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed3d000/0xe984082ccd72f689 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ec expref: 11 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.251107:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed3c800/0xe984082ccd72f66d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d7 expref: 11 pid: 4581 timeout: 940 lvb_type: 1 00010000:00010000:1.0:1746143761.251116:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed3d000, rc 0) 00000100:00100000:3.0:1746143761.251117:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594332672:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.251124:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594332800:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.251131:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594116992:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 19445us (19917us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143761.251135:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13241 00010000:00010000:3.0:1746143761.251154:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1413120->1531903] (req 1413120->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.251161:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f22800, rc 0) 00000100:00100000:3.0:1746143761.251176:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31248:x1830963594117632:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10149us (10284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.251181:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13244 00000100:00100000:3.0:1746143761.251321:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594332416:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143761.251352:0:4581:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff8800a04cd180 x1830963594332032) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 20 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.251367:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009089e000/0xe984082ccd72f5a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3309567) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7483 expref: 20 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.251380:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594332032:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143761.251393:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ca00/0xe984082ccd72f674 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74e5 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.251401:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ca00/0xe984082ccd72f674 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74e5 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.251405:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac3ec00/0xe984082ccd72f697 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7501 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.251407:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed3ca00, rc 0) 00010000:00010000:3.0:1746143761.251414:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac3ec00/0xe984082ccd72f697 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7501 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.251420:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac3ec00, rc 0) 00000100:00100000:2.0:1746143761.251424:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594116864:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 19944us (20296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143761.251428:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13238 00000100:00100000:3.0:1746143761.251433:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594117504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 17402us (18165us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.251437:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13243 00000100:00100000:2.0:1746143761.251461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.251541:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.251956:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594117888 00000100:00100000:3.0:1746143761.251960:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594117888 00010000:00010000:3.0:1746143761.251973:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 28 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.251996:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594118144 00000100:00100000:3.0:1746143761.251998:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594118144 00010000:00010000:3.0:1746143761.252006:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.252018:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7072 00000100:00100000:2.0:1746143761.252024:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594117888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.252031:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.252039:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 28 pid: 4581 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.252047:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 28 pid: 4581 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.252058:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f5d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7498 expref: 28 pid: 4581 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.252068:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.252087:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7073 00000100:00100000:3.0:1746143761.252093:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594118144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.252102:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.252110:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.252118:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.252133:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095728800/0xe984082ccd72f532 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a744b expref: 22 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.252154:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.252156:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.252161:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.252168:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.252190:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.252200:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594333056:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143761.252259:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594117888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 235us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.252265:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7072 00000100:00100000:2.0:1746143761.252484:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594332928:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143761.252492:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.252992:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.253049:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594117760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5180us (8452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.253056:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7070 00000100:00100000:1.0:1746143761.254213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.254219:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.254252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.254306:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594118528 00000100:00100000:2.0:1746143761.254311:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594118528 00000100:00100000:3.0:1746143761.254365:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594118912 00000100:00100000:3.0:1746143761.254368:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594118912 00000100:00100000:3.0:1746143761.254403:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9156 00000100:00100000:3.0:1746143761.254409:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31241:x1830963594118912:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143761.254421:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.254434:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22a00/0xe984082ccd72f6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a750f expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.254511:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.254522:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.254528:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 20 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.254534:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 249 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.254540:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.254560:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 249 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.254571:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 249 pid: 21713 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.254581:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333184:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.254635:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 20 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.254643:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 20 pid: 21713 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.254654:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333312:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.254678:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.254684:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 8 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.254690:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333440:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.254704:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.254718:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594118656 00000100:00100000:3.0:1746143761.254720:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594118656 00002000:00100000:3.0:1746143761.254735:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f0afb80 x1830963594118656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.254743:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963594118656 ext(3145728->4194303) 00002000:00010000:3.0:1746143761.254746:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0afb80 00000100:00100000:3.0:1746143761.254764:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6206 00000100:00100000:3.0:1746143761.254770:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594118656:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143761.256544:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143761.257289:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ad180 x1830963594118528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.257300:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad180 with x1830963594118528 ext(3145728->4194303) 00002000:00010000:2.0:1746143761.257305:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ad180 00000100:00100000:2.0:1746143761.257325:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594119168 00000100:00100000:2.0:1746143761.257331:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594119168 00002000:00100000:2.0:1746143761.257355:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1413120->1417215) req@ffff8800a04cea00 x1830963594119168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.257362:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cea00 with x1830963594119168 ext(1413120->1417215) 00002000:00010000:2.0:1746143761.257364:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cea00 00000100:00100000:2.0:1746143761.257383:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6207 00000100:00100000:2.0:1746143761.257389:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594118528:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.258541:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6208 00000100:00100000:2.0:1746143761.258548:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594119168:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.258633:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594119168:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 86us (2097us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.258638:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6208 00002000:00100000:2.0:1746143761.258644:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1413120->1417215) req@ffff8800a04cea00 x1830963594119168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.258651:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cea00 with x1830963594119168 ext(1413120->1417215) 00002000:00010000:2.0:1746143761.258654:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cea00 00000100:00100000:3.0:1746143761.259692:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594333056:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.259710:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.259748:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594118144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7655us (8205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.259756:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7073 00000100:00100000:0.0:1746143761.262307:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.262440:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594119296 00000100:00100000:3.0:1746143761.262447:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594119296 00000100:00100000:3.0:1746143761.262489:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13245 00000100:00100000:3.0:1746143761.262496:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31247:x1830963594119296:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.262510:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.262522:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7516 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.262636:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.262643:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.262644:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.262647:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.262673:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.262682:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 28 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.262693:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594333568:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.262769:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.263312:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.263335:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.263347:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.263355:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594119424 00000100:00100000:2.0:1746143761.263359:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594119424 00010000:00010000:2.0:1746143761.263378:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 250 pid: 21713 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.263392:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594119680 00000100:00100000:2.0:1746143761.263394:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594119680 00010000:00010000:2.0:1746143761.263403:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.263413:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594119552 00000100:00100000:2.0:1746143761.263414:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594119552 00010000:00010000:2.0:1746143761.263420:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 21 pid: 21713 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.263425:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333184:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.263430:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7074 00000100:00100000:3.0:1746143761.263433:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333312:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.263435:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1962:x1830963594119424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143761.263441:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333440:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143761.263443:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.263447:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 250 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.263454:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 250 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.263464:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.263471:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0834600/0xe984082ccd72f658 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74f3 expref: 250 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.263486:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143761.263489:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.263496:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.263499:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143761.263569:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7075 00000100:00100000:0.0:1746143761.263575:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594119680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.263581:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143761.263585:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.263591:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.263601:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac3fe00/0xe984082ccd72f5fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74ad expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.263613:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143761.263616:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143761.263621:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143761.263625:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.264110:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1962:x1830963594119424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 672us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.264116:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7074 00000100:00100000:2.0:1746143761.264131:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7076 00000100:00100000:2.0:1746143761.264135:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594119552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.264329:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.264334:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 21 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.264345:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 21 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.264354:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835400/0xe984082ccd72f620 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74b4 expref: 21 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.264362:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143761.264365:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.264370:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.264375:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143761.264377:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594119680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 802us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.264382:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7075 00010000:00010000:2.0:1746143761.264388:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.264403:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594119552:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 267us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.264408:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7076 00000100:00100000:3.0:1746143761.264565:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594118656:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 9794us (10311us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.264573:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6206 00002000:00100000:3.0:1746143761.264580:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f0afb80 x1830963594118656/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.264589:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963594118656 ext(3145728->4194303) 00002000:00010000:3.0:1746143761.264593:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0afb80 00010000:00010000:3.0:1746143761.264610:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.264614:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143761.264630:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143761.264740:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22a00/0xe984082ccd72f6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.264752:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.264759:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143761.264761:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143761.264763:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f22c00, rc 0) 00000100:00100000:3.0:1746143761.264795:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31241:x1830963594118912:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10386us (10575us total) trans 8589943468 rc 0/0 00000100:00100000:3.0:1746143761.264805:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9156 00000100:00100000:3.0:1746143761.265863:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594333568:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.265879:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.265891:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f23400, rc 0) 00000100:00100000:2.0:1746143761.266450:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594118528:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 9059us (12237us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143761.266457:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6207 00002000:00100000:2.0:1746143761.266463:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ad180 x1830963594118528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.266471:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad180 with x1830963594118528 ext(3145728->4194303) 00002000:00010000:2.0:1746143761.266474:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ad180 00000100:00100000:0.0:1746143761.267113:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.267235:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.267298:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31247:x1830963594119296:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4543us (4736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.267305:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13245 00000100:00100000:3.0:1746143761.267320:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594119808 00000100:00100000:3.0:1746143761.267324:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594119808 00000100:00100000:3.0:1746143761.267351:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13246 00000100:00100000:3.0:1746143761.267356:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31243:x1830963594119808:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143761.267367:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.267379:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a751d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.267398:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.267404:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.267406:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.267409:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.267429:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.267439:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 26 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.267448:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594333696:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.267496:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.267550:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594120064 00000100:00100000:2.0:1746143761.267554:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594120064 00002000:00100000:2.0:1746143761.267573:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1527808->1531903) req@ffff8800a04cdc00 x1830963594120064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.267580:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdc00 with x1830963594120064 ext(1527808->1531903) 00010000:00010000:2.0:1746143761.267585:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.267593:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.267599:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cdc00 00000100:00100000:2.0:1746143761.267621:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1759 00000100:00100000:2.0:1746143761.267625:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594120064:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.267730:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594120064:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 104us (495us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.267735:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1759 00002000:00100000:2.0:1746143761.267738:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1527808->1531903) req@ffff8800a04cdc00 x1830963594120064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.267744:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdc00 with x1830963594120064 ext(1527808->1531903) 00010000:00010000:2.0:1746143761.267748:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.267755:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.267766:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cdc00 00000100:00100000:0.0:1746143761.270068:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.270198:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.270292:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.270298:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594120192 00000100:00100000:3.0:1746143761.270304:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594120192 00000100:00100000:1.0:1746143761.270330:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594120704 00000100:00100000:1.0:1746143761.270334:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594120704 00000100:00100000:2.0:1746143761.270359:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594120448 00000100:00100000:2.0:1746143761.270362:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594120448 00000100:00100000:1.0:1746143761.270370:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3919 00000100:00100000:1.0:1746143761.270375:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31248:x1830963594120704:12345-192.168.202.48@tcp:35:multiop.0 00002000:00100000:2.0:1746143761.270386:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1413120->1531903) req@ffff8800a04cd180 x1830963594120448/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.270393:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd180 with x1830963594120448 ext(1413120->1531903) 00010000:00010000:2.0:1746143761.270400:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.270621:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31248:x1830963594120704:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 244us (328us total) trans 8589943469 rc 0/0 00000100:00100000:1.0:1746143761.270628:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3919 00010000:00010000:2.0:1746143761.270761:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 27 pid: 6929 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.270770:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cd180 00000100:00100000:0.0:1746143761.270797:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1760 00000100:00100000:0.0:1746143761.270803:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594120448:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143761.270836:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9157 00000100:00100000:3.0:1746143761.270841:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31241:x1830963594120192:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143761.270851:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.270864:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f23a00/0xe984082ccd72f6c8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7524 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.270913:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.270926:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.270931:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.270956:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.270964:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.270977:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333824:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.271025:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.272054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.272096:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594120832 00000100:00100000:2.0:1746143761.272101:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594120832 00002000:00100000:2.0:1746143761.272121:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2273279) req@ffff8800a0a96d80 x1830963594120832/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.272129:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a96d80 with x1830963594120832 ext(2097152->2273279) 00010000:00010000:2.0:1746143761.272134:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 29 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.272162:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 29 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.272169:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0a96d80 00000100:00100000:2.0:1746143761.272754:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1761 00000100:00100000:2.0:1746143761.272761:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594120832:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143761.273018:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594333696:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.273036:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2879488->3145727] (req 2879488->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.273048:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f22e00, rc 0) 00000100:00100000:3.0:1746143761.273081:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31243:x1830963594119808:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5724us (5969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.273087:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13246 00000100:00100000:2.0:1746143761.273525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.273747:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594120960 00000100:00100000:3.0:1746143761.273751:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594120960 00000100:00100000:3.0:1746143761.273773:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13247 00000100:00100000:3.0:1746143761.273777:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31240:x1830963594120960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.273784:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.273794:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a752b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.273807:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.273809:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.273812:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 32 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.273820:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 32 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.274314:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f22200, rc 0) 00000100:00100000:3.0:1746143761.274338:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31240:x1830963594120960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 560us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.274343:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13247 00000100:00100000:0.0:1746143761.274993:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594120448:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 4190us (4793us total) trans 17179873074 rc 0/0 00000100:00100000:0.0:1746143761.275000:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1760 00002000:00100000:0.0:1746143761.275007:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1413120->1531903) req@ffff8800a04cd180 x1830963594120448/t17179873074(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.275015:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd180 with x1830963594120448 ext(1413120->1531903) 00010000:00010000:0.0:1746143761.275021:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 32 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.275029:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 32 pid: 6929 timeout: 940 lvb_type: 0 00002000:00010000:0.0:1746143761.275034:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cd180 00000100:00100000:3.0:1746143761.275493:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594333824:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.275510:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143761.275667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.275713:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594121088 00000100:00100000:2.0:1746143761.275717:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594121088 00010000:00010000:2.0:1746143761.275735:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 10 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.275759:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7077 00000100:00100000:2.0:1746143761.275764:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594121088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.275773:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.275777:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 10 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.275785:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 10 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.275802:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22c00/0xe984082ccd72f6ac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a750f expref: 10 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.275816:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143761.275820:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.275827:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.275833:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143761.275848:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.275865:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594121088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.275870:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7077 00010000:00010000:3.0:1746143761.275945:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.275950:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143761.276320:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:3.0:1746143761.276325:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143761.276339:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.276366:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f23a00/0xe984082ccd72f6c8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.276376:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.276384:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143761.276386:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143761.276388:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f22600, rc 0) 00000100:00100000:3.0:1746143761.276425:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31241:x1830963594120192:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5583us (6361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.276430:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9157 00000100:00100000:0.0:1746143761.277949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.278653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.278684:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.278710:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594121216 00000100:00100000:3.0:1746143761.278716:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594121216 00010000:00010000:3.0:1746143761.278740:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 32 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.278774:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7078 00000100:00100000:3.0:1746143761.278782:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594121216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.278792:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143761.278804:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143760 -> 1746143761 00002000:00010000:3.0:1746143761.278807:0:23335:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143760 -> 1746143761 00010000:00010000:3.0:1746143761.278812:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 32 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.278821:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 32 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.278838:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f22800/0xe984082ccd72f69e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1531903) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7508 expref: 32 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.278850:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.278851:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.278857:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.278869:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.278894:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.278906:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594333952:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.278976:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.278990:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594121344 00000100:00100000:3.0:1746143761.278992:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594121344 00000100:00100000:3.0:1746143761.279010:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594121472 00000100:00100000:0.0:1746143761.279010:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.279011:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594121472 00000100:00100000:3.0:1746143761.279025:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594121600 00000100:00100000:3.0:1746143761.279027:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594121600 00000100:00100000:0.0:1746143761.279033:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13248 00000100:00100000:0.0:1746143761.279038:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594121344:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:3.0:1746143761.279047:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13249 00010000:00010000:0.0:1746143761.279048:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143761.279051:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594121472:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143761.279056:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.279057:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7532 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.279064:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f23e00/0xe984082ccd72f6e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7539 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.279068:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.279069:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.279072:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.279077:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f23e00/0xe984082ccd72f6e4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7539 expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.279081:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.279084:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f23e00/0xe984082ccd72f6e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7539 expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.279087:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0835c00, rc 0) 00010000:00010000:3.0:1746143761.279094:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f23e00, rc 0) 00000100:00100000:3.0:1746143761.279105:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594121472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 53us (420us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143761.279105:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594121344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 67us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.279110:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13249 00000100:00100000:0.0:1746143761.279336:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13248 00000100:00100000:0.0:1746143761.279348:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13250 00000100:00100000:0.0:1746143761.279352:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594121600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143761.279358:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.279364:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0834800/0xe984082ccd72f6eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7540 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.279384:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594334080:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143761.279410:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.280009:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594120832:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 7246us (7954us total) trans 17179873075 rc 0/0 00000100:00100000:2.0:1746143761.280015:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1761 00002000:00100000:2.0:1746143761.280023:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2273279) req@ffff8800a0a96d80 x1830963594120832/t17179873075(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.280032:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a96d80 with x1830963594120832 ext(2097152->2273279) 00010000:00010000:2.0:1746143761.280037:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 32 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.280046:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 32 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.280052:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0a96d80 00000100:00100000:3.0:1746143761.280939:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594333952:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.280952:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.280987:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594121216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2206us (3039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.280994:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7078 00000100:00100000:2.0:1746143761.283330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.283359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.283374:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594121856 00000100:00100000:0.0:1746143761.283381:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594121856 00002000:00100000:0.0:1746143761.283414:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a087b480 x1830963594121856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.283422:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b480 with x1830963594121856 ext(1048576->2097151) 00002000:00010000:0.0:1746143761.283426:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b480 00000100:00100000:0.0:1746143761.283455:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6209 00000100:00100000:0.0:1746143761.283462:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594121856:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143761.283470:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594121984 00000100:00100000:3.0:1746143761.283475:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594121984 00010000:00010000:3.0:1746143761.283493:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.283520:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7079 00000100:00100000:3.0:1746143761.283525:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594121984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.283532:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143761.283543:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143760 -> 1746143761 00010000:00010000:3.0:1746143761.283548:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.283558:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.283582:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.283583:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.283589:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.283595:0:8495:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff88009e5cca80 x1830963594334080) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.283597:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.283604:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.283605:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.283607:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.283613:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.283622:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090671e00/0xe984082ccd72f5a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a748a expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.283634:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 30 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.283644:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594334208:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143761.283694:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594334080:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143761.283713:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0834800/0xe984082ccd72f6eb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7540 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.283721:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0834800/0xe984082ccd72f6eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7540 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.283727:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0834800, rc 0) 00000100:00100000:0.0:1746143761.283748:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594121600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4395us (4738us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143761.283758:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13250 00010000:00010000:3.0:1746143761.283785:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 23 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.283793:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594334336:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.283813:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.288797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.288850:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.288915:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594334208:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.288923:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594334336:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.288939:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.288980:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594121984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5454us (5619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.288988:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7079 00000100:00100000:3.0:1746143761.289018:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594122752 00000100:00100000:3.0:1746143761.289022:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594122752 00000100:00100000:3.0:1746143761.289046:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9158 00000100:00100000:3.0:1746143761.289051:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31241:x1830963594122752:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143761.289066:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.289078:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f23000/0xe984082ccd72f6f2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7547 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.289171:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289183:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289191:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289201:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289205:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289210:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289219:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f22000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143761.289230:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289236:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289245:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143761.289247:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143761.289250:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289254:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22000/0xe984082ccd72f6f9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.289275:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f23000/0xe984082ccd72f6f2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7547 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.289280:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f23000/0xe984082ccd72f6f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7547 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.289286:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f23000, rc 0) 00000100:00100000:3.0:1746143761.289301:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31241:x1830963594122752:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 250us (511us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.289305:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9158 00000100:00100000:1.0:1746143761.289356:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594122240 00000100:00100000:1.0:1746143761.289359:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594122240 00002000:00100000:1.0:1746143761.289377:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2879488->2883583) req@ffff88009e5cdf80 x1830963594122240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.289386:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cdf80 with x1830963594122240 ext(2879488->2883583) 00002000:00010000:1.0:1746143761.289389:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cdf80 00000100:00100000:1.0:1746143761.289410:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6210 00000100:00100000:1.0:1746143761.289415:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594122240:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143761.289518:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594122240:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 102us (666us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143761.289522:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6210 00002000:00100000:1.0:1746143761.289527:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2879488->2883583) req@ffff88009e5cdf80 x1830963594122240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.289532:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cdf80 with x1830963594122240 ext(2879488->2883583) 00002000:00010000:1.0:1746143761.289535:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cdf80 00000100:00100000:0.0:1746143761.291233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.291299:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594122496 00000100:00100000:2.0:1746143761.291303:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594122496 00002000:00100000:2.0:1746143761.291332:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009e5cc000 x1830963594122496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.291341:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc000 with x1830963594122496 ext(3145728->4194303) 00002000:00010000:2.0:1746143761.291345:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cc000 00000100:00100000:2.0:1746143761.291862:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6211 00000100:00100000:2.0:1746143761.291869:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594122496:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143761.292579:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.294925:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123008 00000100:00100000:1.0:1746143761.294935:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123008 00000100:00100000:1.0:1746143761.294974:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3920 00000100:00100000:1.0:1746143761.294981:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31241:x1830963594123008:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1746143761.295178:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31241:x1830963594123008:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 196us (2598us total) trans 8589943470 rc 0/0 00000100:00100000:1.0:1746143761.295184:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3920 00000100:00100000:0.0:1746143761.295467:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594121856:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12004us (12141us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143761.295474:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6209 00002000:00100000:0.0:1746143761.295481:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a087b480 x1830963594121856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.295490:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b480 with x1830963594121856 ext(1048576->2097151) 00002000:00010000:0.0:1746143761.295493:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b480 00000100:00100000:0.0:1746143761.302024:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.302099:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123136 00000100:00100000:2.0:1746143761.302108:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123136 00000100:00100000:2.0:1746143761.302539:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13251 00000100:00100000:2.0:1746143761.302547:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31243:x1830963594123136:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143761.302563:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.302577:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a754e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.302602:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 28 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.302608:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143761.302610:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143761.302613:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3375103] (req 3145728->3375103) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.302637:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 28 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.302646:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 28 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.302656:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594334464:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.302946:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.303295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.303360:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123264 00000100:00100000:1.0:1746143761.303364:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123264 00000100:00100000:1.0:1746143761.303396:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13252 00000100:00100000:1.0:1746143761.303401:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594123264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.303408:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.303415:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009089ce00/0xe984082ccd72f707 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7555 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.303415:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143761.303438:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009089ce00/0xe984082ccd72f707 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7555 expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.303447:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009089ce00/0xe984082ccd72f707 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7555 expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143761.303524:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123392 00000100:00100000:3.0:1746143761.303528:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123392 00000100:00100000:3.0:1746143761.303554:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13253 00000100:00100000:3.0:1746143761.303558:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594123392:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.303568:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.303577:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f23600/0xe984082ccd72f70e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a755c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.303589:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f23600/0xe984082ccd72f70e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a755c expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.303595:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f23600/0xe984082ccd72f70e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a755c expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.303610:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f23600, rc 0) 00000100:00100000:3.0:1746143761.303635:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594123392:12345-192.168.202.48@tcp:101:cat.0 Request processed in 76us (219us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.303639:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13253 00010000:00010000:1.0:1746143761.303861:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089ce00, rc 0) 00000100:00100000:1.0:1746143761.303892:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594123264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 490us (597us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143761.303896:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13252 00000100:00100000:3.0:1746143761.305865:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594122496:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 13990us (14640us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.305875:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6211 00002000:00100000:3.0:1746143761.305885:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009e5cc000 x1830963594122496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.305894:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc000 with x1830963594122496 ext(3145728->4194303) 00002000:00010000:3.0:1746143761.305898:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cc000 00000100:00100000:0.0:1746143761.306391:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.306471:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594334464:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143761.306496:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3375103] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.306511:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009106f200, rc 0) 00000100:00100000:2.0:1746143761.306530:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31243:x1830963594123136:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3985us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.306540:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13251 00000100:00100000:2.0:1746143761.306554:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123520 00000100:00100000:2.0:1746143761.306558:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123520 00000100:00100000:2.0:1746143761.306588:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13254 00000100:00100000:2.0:1746143761.306595:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31247:x1830963594123520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.306606:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.306618:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7563 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.306637:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.306644:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143761.306645:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143761.306651:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.306670:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.306680:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 28 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.306689:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594334592:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.306730:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.309495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.309620:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594334592:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143761.309647:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 21 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.309660:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009106f400, rc 0) 00000100:00100000:3.0:1746143761.309860:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123648 00000100:00100000:3.0:1746143761.309865:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123648 00002000:00100000:3.0:1746143761.309896:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2457600->3145727) req@ffff88012e17c380 x1830963594123648/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.309909:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c380 with x1830963594123648 ext(2457600->3145727) 00010000:00010000:3.0:1746143761.309914:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 29 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.309924:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 29 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143761.309929:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e17c380 00000100:00100000:3.0:1746143761.309951:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1762 00000100:00100000:3.0:1746143761.309957:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963594123648:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143761.310587:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31247:x1830963594123520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3992us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.310593:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13254 00000100:00100000:0.0:1746143761.310681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.310716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.310897:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.310965:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.311115:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594124032 00000100:00100000:3.0:1746143761.311118:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594124032 00000100:00100000:3.0:1746143761.311160:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123904 00000100:00100000:3.0:1746143761.311163:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123904 00000100:00100000:3.0:1746143761.311174:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594124160 00000100:00100000:3.0:1746143761.311176:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594124160 00000100:00100000:3.0:1746143761.311187:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13255 00000100:00100000:3.0:1746143761.311191:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594124032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.311199:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.311210:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f23000/0xe984082ccd72f71c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7571 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.311240:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f23000/0xe984082ccd72f71c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7571 expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.311249:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f23000/0xe984082ccd72f71c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7571 expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.311259:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f23000, rc 0) 00000100:00100000:3.0:1746143761.311279:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594124032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 87us (562us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.311283:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13255 00000100:00100000:3.0:1746143761.311293:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13256 00000100:00100000:3.0:1746143761.311297:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594123904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.311302:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.311309:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a756a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.311318:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.311320:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.311325:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.311336:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.311342:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f23800, rc 0) 00000100:00100000:3.0:1746143761.311352:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594123904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 55us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.311356:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13256 00000100:00100000:3.0:1746143761.311362:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13257 00000100:00100000:3.0:1746143761.311366:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594124160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.311372:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.311376:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f22c00/0xe984082ccd72f72a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7578 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.311385:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f22c00/0xe984082ccd72f72a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7578 expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.311391:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f22c00/0xe984082ccd72f72a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7578 expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.311397:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f22c00, rc 0) 00000100:00100000:3.0:1746143761.311405:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594124160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 40us (442us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.311409:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13257 00000100:00100000:2.0:1746143761.311492:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594123776 00000100:00100000:2.0:1746143761.311495:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594123776 00010000:00010000:2.0:1746143761.311508:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 31 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.311522:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7080 00000100:00100000:2.0:1746143761.311525:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594123776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.311533:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.311544:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 31 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.311552:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 31 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.311568:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac3ee00/0xe984082ccd72f612 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74bb expref: 31 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.311585:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.311586:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.311590:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.311597:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.311617:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.311625:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594334720:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143761.311665:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.314826:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594334720:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.314845:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.314875:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594123776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3348us (4194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.314883:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7080 00000100:00100000:2.0:1746143761.316587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.316612:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.316855:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594124416 00000100:00100000:0.0:1746143761.316862:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594124416 00000100:00100000:0.0:1746143761.316908:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13258 00000100:00100000:0.0:1746143761.316915:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:31240:x1830963594124416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143761.316936:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.316950:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a757f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.316974:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.316981:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143761.316983:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143761.316985:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4755455] (req 4194304->4755455) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.317009:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.317018:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 20 pid: 8495 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143761.317028:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594334848:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143761.317097:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.317110:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594124544 00000100:00100000:0.0:1746143761.317113:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594124544 00002000:00100000:0.0:1746143761.317133:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3371008->3375103) req@ffff8800a0879500 x1830963594124544/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.317161:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879500 with x1830963594124544 ext(3371008->3375103) 00010000:00010000:0.0:1746143761.317166:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 21 pid: 8495 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.317179:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 21 pid: 8495 timeout: 940 lvb_type: 0 00002000:00010000:0.0:1746143761.317184:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0879500 00000100:00100000:0.0:1746143761.317198:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1763 00000100:00100000:0.0:1746143761.317203:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594124544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143761.317337:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594124544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 133us (723us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143761.317343:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1763 00002000:00100000:0.0:1746143761.317348:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3371008->3375103) req@ffff8800a0879500 x1830963594124544/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.317354:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879500 with x1830963594124544 ext(3371008->3375103) 00010000:00010000:0.0:1746143761.317359:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 21 pid: 8495 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.317366:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 21 pid: 8495 timeout: 940 lvb_type: 0 00002000:00010000:0.0:1746143761.317372:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0879500 00000100:00100000:0.0:1746143761.319772:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594334848:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143761.319795:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4755455] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 31 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.319814:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be200, rc 0) 00000100:00100000:0.0:1746143761.320010:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31240:x1830963594124416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3095us (3426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143761.320016:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13258 00000100:00100000:0.0:1746143761.320736:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.320910:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.320970:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594125056 00000100:00100000:1.0:1746143761.320975:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594125056 00002000:00100000:1.0:1746143761.321005:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3375103) req@ffff8800a0084700 x1830963594125056/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.321014:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084700 with x1830963594125056 ext(3145728->3375103) 00010000:00010000:1.0:1746143761.321022:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 21 pid: 8495 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.321032:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 21 pid: 8495 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143761.321037:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0084700 00000100:00100000:1.0:1746143761.321052:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1764 00000100:00100000:1.0:1746143761.321058:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594125056:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143761.321570:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594124928 00000100:00100000:2.0:1746143761.321574:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594124928 00000100:00100000:2.0:1746143761.321609:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3921 00000100:00100000:2.0:1746143761.321615:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31243:x1830963594124928:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143761.321762:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31243:x1830963594124928:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 147us (1028us total) trans 8589943471 rc 0/0 00000100:00100000:2.0:1746143761.321768:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3921 00000100:00100000:1.0:1746143761.328218:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594125056:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7150us (7299us total) trans 21474840399 rc 0/0 00000100:00100000:1.0:1746143761.328237:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1764 00002000:00100000:1.0:1746143761.328248:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3375103) req@ffff8800a0084700 x1830963594125056/t21474840399(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.328258:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0084700 with x1830963594125056 ext(3145728->3375103) 00010000:00010000:1.0:1746143761.328267:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 23 pid: 8495 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.328277:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 23 pid: 8495 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143761.328283:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0084700 00000100:00100000:3.0:1746143761.328387:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594123648:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 18429us (18897us total) trans 21474840400 rc 0/0 00000100:00100000:3.0:1746143761.328395:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1762 00002000:00100000:3.0:1746143761.328401:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2457600->3145727) req@ffff88012e17c380 x1830963594123648/t21474840400(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.328409:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c380 with x1830963594123648 ext(2457600->3145727) 00010000:00010000:3.0:1746143761.328415:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.328424:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143761.328431:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e17c380 00000100:00100000:0.0:1746143761.333933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.334056:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594125184 00000100:00100000:3.0:1746143761.334063:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594125184 00010000:00010000:3.0:1746143761.334094:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.334116:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7081 00000100:00100000:3.0:1746143761.334121:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594125184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.334134:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143761.334166:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143760 -> 1746143761 00002000:00010000:3.0:1746143761.334169:0:23335:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143760 -> 1746143761 00002000:00010000:3.0:1746143761.334171:0:23335:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143760 -> 1746143761 00010000:00010000:3.0:1746143761.334175:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.334184:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.334202:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bf1c00/0xe984082ccd72f59b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2457600->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a747c expref: 31 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.334652:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.334654:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.334660:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.334667:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.334692:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 22 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.334701:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594334976:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.335653:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.336603:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.336866:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594125312 00000100:00100000:2.0:1746143761.336871:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594125312 00010000:00010000:2.0:1746143761.336893:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 23 pid: 8495 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.336914:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7082 00000100:00100000:2.0:1746143761.336920:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594125312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.336928:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.336944:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 23 pid: 8495 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.336952:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 23 pid: 8495 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.336967:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106f200/0xe984082ccd72f700 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a754e expref: 23 pid: 8495 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.336994:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.336996:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.337001:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.337007:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.337026:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 30 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.337038:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594335104:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143761.337100:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.337532:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594334976:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.337546:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.337569:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594125184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3447us (3642us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.337575:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7081 00000100:00100000:0.0:1746143761.339453:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.339753:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594125568 00000100:00100000:3.0:1746143761.339759:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594125568 00002000:00100000:3.0:1746143761.339794:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093cebb80 x1830963594125568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.339802:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cebb80 with x1830963594125568 ext(4194304->4755455) 00002000:00010000:3.0:1746143761.339807:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cebb80 00000100:00100000:3.0:1746143761.339901:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6212 00000100:00100000:3.0:1746143761.339909:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594125568:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143761.339915:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594335104:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143761.339931:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.340025:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594125312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3042us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.340037:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7082 00000100:00100000:0.0:1746143761.344876:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.344919:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.344938:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594125952 00000100:00100000:2.0:1746143761.344939:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594126080 00000100:00100000:2.0:1746143761.344945:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594126080 00000100:00100000:0.0:1746143761.344945:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594125952 00002000:00100000:2.0:1746143761.344978:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2879487) req@ffff880093ce9880 x1830963594126080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.344979:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093ce9c00 x1830963594125952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.344987:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9880 with x1830963594126080 ext(2097152->2879487) 00002000:00100000:0.0:1746143761.344987:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9c00 with x1830963594125952 ext(2097152->3145727) 00002000:00010000:2.0:1746143761.344991:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ce9880 00002000:00010000:0.0:1746143761.344992:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ce9c00 00000100:00100000:0.0:1746143761.345021:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6213 00000100:00100000:0.0:1746143761.345028:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594125952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143761.345062:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6214 00000100:00100000:2.0:1746143761.345068:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594126080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.347619:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594125568:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7704us (8165us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143761.347628:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6212 00002000:00100000:3.0:1746143761.347637:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093cebb80 x1830963594125568/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.347646:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cebb80 with x1830963594125568 ext(4194304->4755455) 00002000:00010000:3.0:1746143761.347649:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cebb80 00000100:00100000:2.0:1746143761.353473:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594126080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8397us (8545us total) trans 0 rc 782336/782336 00000100:00100000:2.0:1746143761.353484:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6214 00002000:00100000:2.0:1746143761.353494:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2879487) req@ffff880093ce9880 x1830963594126080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 782336/782336 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.353503:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9880 with x1830963594126080 ext(2097152->2879487) 00002000:00010000:2.0:1746143761.354261:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ce9880 00000100:00100000:0.0:1746143761.355090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.355352:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594126208 00000100:00100000:1.0:1746143761.355358:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594126208 00000100:00100000:1.0:1746143761.355567:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13259 00000100:00100000:1.0:1746143761.355575:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594126208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.355589:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.355602:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fc00/0xe984082ccd72f738 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7586 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.355626:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fc00/0xe984082ccd72f738 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7586 expref: 32 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.355635:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fc00/0xe984082ccd72f738 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7586 expref: 32 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143761.355655:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594125952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10626us (10785us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143761.355662:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6213 00002000:00100000:2.0:1746143761.355668:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093ce9c00 x1830963594125952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.355675:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce9c00 with x1830963594125952 ext(2097152->3145727) 00002000:00010000:2.0:1746143761.355679:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ce9c00 00010000:00010000:1.0:1746143761.355696:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8fc00, rc 0) 00000100:00100000:1.0:1746143761.355715:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594126208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 141us (626us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143761.355720:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13259 00000100:00100000:0.0:1746143761.359528:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.359770:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594126336 00000100:00100000:1.0:1746143761.359777:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594126336 00000100:00100000:0.0:1746143761.359798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.359830:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594126464 00000100:00100000:1.0:1746143761.359832:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594126464 00000100:00100000:1.0:1746143761.359849:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13260 00000100:00100000:3.0:1746143761.359856:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13261 00000100:00100000:1.0:1746143761.359856:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594126336:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143761.359868:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31247:x1830963594126464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.359870:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.359876:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.359883:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f800/0xe984082ccd72f73f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a758d expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.359886:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7594 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.359901:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.359902:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.359906:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f800/0xe984082ccd72f73f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a758d expref: 32 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.359908:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.359919:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f800/0xe984082ccd72f73f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a758d expref: 32 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.359921:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.359928:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f22400, rc 0) 00010000:00010000:1.0:1746143761.359928:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f800, rc 0) 00000100:00100000:3.0:1746143761.359963:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31247:x1830963594126464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 98us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.359964:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594126336:12345-192.168.202.48@tcp:101:cat.0 Request processed in 109us (442us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143761.359969:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13260 00000100:00100000:3.0:1746143761.359972:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13261 00000100:00100000:0.0:1746143761.363727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.364381:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.364467:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594126720 00000100:00100000:2.0:1746143761.364476:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594126720 00000100:00100000:2.0:1746143761.364509:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3922 00000100:00100000:2.0:1746143761.364515:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fd67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31240:x1830963594126720:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143761.364697:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fd67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31240:x1830963594126720:12345-192.168.202.48@tcp:35:cat.0 Request processed in 181us (977us total) trans 8589943472 rc 0/0 00000100:00100000:2.0:1746143761.364703:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3922 00000100:00100000:3.0:1746143761.364885:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594126976 00000100:00100000:3.0:1746143761.364889:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594126976 00002000:00100000:3.0:1746143761.364914:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009cdc2a00 x1830963594126976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.364924:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963594126976 ext(3145728->4194303) 00002000:00010000:3.0:1746143761.364929:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2a00 00000100:00100000:3.0:1746143761.364945:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6215 00000100:00100000:3.0:1746143761.364950:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594126976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.371163:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594126976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6182us (6751us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.371172:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6215 00002000:00100000:3.0:1746143761.371183:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009cdc2a00 x1830963594126976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.371191:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963594126976 ext(3145728->4194303) 00002000:00010000:3.0:1746143761.371196:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2a00 00000100:00100000:0.0:1746143761.376306:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.376359:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594127104 00000100:00100000:3.0:1746143761.376367:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594127104 00000100:00100000:3.0:1746143761.376428:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13262 00000100:00100000:3.0:1746143761.376435:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31247:x1830963594127104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.376451:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.376466:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a759b expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.376493:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.376495:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.376501:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 24 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.376513:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 24 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.376521:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c113e00, rc 0) 00000100:00100000:3.0:1746143761.376567:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31247:x1830963594127104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 133us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.376572:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13262 00000100:00100000:0.0:1746143761.383490:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.383616:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594127360 00000100:00100000:3.0:1746143761.383625:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594127360 00002000:00100000:3.0:1746143761.383665:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094c11c00 x1830963594127360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.383674:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11c00 with x1830963594127360 ext(3145728->4194303) 00002000:00010000:3.0:1746143761.383679:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11c00 00000100:00100000:3.0:1746143761.383904:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6216 00000100:00100000:3.0:1746143761.383912:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594127360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.393768:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594127360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9848us (10277us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.393778:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6216 00002000:00100000:3.0:1746143761.393787:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094c11c00 x1830963594127360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.393798:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11c00 with x1830963594127360 ext(3145728->4194303) 00002000:00010000:3.0:1746143761.393803:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11c00 00000100:00100000:0.0:1746143761.398047:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.398780:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594127488 00000100:00100000:2.0:1746143761.398788:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594127488 00000100:00100000:2.0:1746143761.398836:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13263 00000100:00100000:2.0:1746143761.398843:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594127488:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.398858:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.398871:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106fa00/0xe984082ccd72f754 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75a2 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.398897:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009106fa00/0xe984082ccd72f754 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a2 expref: 25 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.398907:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106fa00/0xe984082ccd72f754 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a2 expref: 25 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.398931:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009106fa00, rc 0) 00000100:00100000:2.0:1746143761.398970:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594127488:12345-192.168.202.48@tcp:101:cat.0 Request processed in 128us (931us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143761.398976:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13263 00000100:00100000:0.0:1746143761.400262:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.400313:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594127744 00000100:00100000:1.0:1746143761.400317:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594127744 00000100:00100000:1.0:1746143761.400561:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9159 00000100:00100000:1.0:1746143761.400567:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31254:x1830963594127744:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.400581:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.400593:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8fe00/0xe984082ccd72f75b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75a9 expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.400685:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400696:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400705:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400716:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400721:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400726:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400812:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400820:0:21713:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400826:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000004:00200000:1.0:1746143761.400840:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143761.400913:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400919:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400924:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400930:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8f600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.400933:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400938:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400946:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143761.400948:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.400952:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400960:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72f762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400986:0:21713:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400991:0:21713:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.400995:0:21713:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.401000:0:21713:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8f400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.401002:0:21713:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.401006:0:21713:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.401013:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74200) 00010000:00010000:1.0:1746143761.401015:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.401017:0:21713:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.401022:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72f769 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21713 initiator: MDT0 00010000:00010000:1.0:1746143761.401053:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8fe00/0xe984082ccd72f75b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 254 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.401063:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 253 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.401074:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.401076:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143761.401078:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f200, rc 0) 00000100:00100000:1.0:1746143761.401109:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:31254:x1830963594127744:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 542us (849us total) trans 8589943473 rc 0/0 00000100:00100000:1.0:1746143761.401120:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9159 00000100:00100000:0.0:1746143761.401943:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.402120:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128000 00000100:00100000:2.0:1746143761.402124:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128000 00002000:00100000:2.0:1746143761.402182:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093f01c00 x1830963594128000/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.402190:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963594128000 ext(4194304->4755455) 00002000:00010000:2.0:1746143761.402194:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01c00 00000100:00100000:2.0:1746143761.402248:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6217 00000100:00100000:2.0:1746143761.402255:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594128000:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143761.407377:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594128000:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5115us (5428us total) trans 0 rc 561152/561152 00000100:00100000:0.0:1746143761.407386:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6217 00002000:00100000:0.0:1746143761.407395:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093f01c00 x1830963594128000/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.407404:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963594128000 ext(4194304->4755455) 00002000:00010000:0.0:1746143761.407409:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01c00 00000100:00100000:0.0:1746143761.410792:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.412950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.412968:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128128 00000100:00100000:3.0:1746143761.412976:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128128 00000100:00100000:3.0:1746143761.413027:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13264 00000100:00100000:3.0:1746143761.413035:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31254:x1830963594128128:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143761.413051:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.413069:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75b0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.413094:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.413101:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.413109:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.413114:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.413116:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.413119:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1679360->1961983] (req 1679360->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.413581:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128256 00000100:00100000:2.0:1746143761.413585:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128256 00000100:00100000:2.0:1746143761.413615:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13265 00000100:00100000:2.0:1746143761.413620:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594128256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.413627:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.413634:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f800/0xe984082ccd72f785 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75b7 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.413650:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009106f800/0xe984082ccd72f785 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b7 expref: 25 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.413658:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f800/0xe984082ccd72f785 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b7 expref: 25 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.414380:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.414397:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 9 pid: 8495 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.414408:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594335232:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.414490:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.414498:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.414505:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594335360:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.414528:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 24 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.414534:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.414541:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594335488:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.414556:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00010000:00010000:2.0:1746143761.414649:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009106f800, rc 0) 00000100:00100000:2.0:1746143761.414673:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594128256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1052us (1728us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143761.414679:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13265 00000100:00100000:0.0:1746143761.418596:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.419132:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594335232:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.419158:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594335360:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.419165:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594335488:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.419196:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1679360->1961983] (req 1679360->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.419212:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a2211800, rc 0) 00000100:00100000:3.0:1746143761.419262:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31254:x1830963594128128:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6228us (8477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.419271:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13264 00000100:00100000:0.0:1746143761.419518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.419545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.419625:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128384 00000100:00100000:2.0:1746143761.419631:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128384 00010000:00010000:2.0:1746143761.419656:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 10 pid: 8495 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143761.419675:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128512 00000100:00100000:2.0:1746143761.419677:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128512 00010000:00010000:2.0:1746143761.419684:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143761.419706:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128640 00000100:00100000:2.0:1746143761.419708:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128640 00010000:00010000:2.0:1746143761.419716:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.419729:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7083 00000100:00100000:2.0:1746143761.419735:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594128384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.419745:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.419763:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 10 pid: 8495 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.419771:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 10 pid: 8495 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.419789:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835c00/0xe984082ccd72f6dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7532 expref: 10 pid: 8495 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.419799:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.419819:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594128384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.419824:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7083 00000100:00100000:2.0:1746143761.419836:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7084 00000100:00100000:2.0:1746143761.419840:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594128512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.419845:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.419852:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.419859:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.419869:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f23800/0xe984082ccd72f723 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a756a expref: 32 pid: 6929 timeout: 940 lvb_type: 1 00010000:00010000:2.0:1746143761.419876:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.419888:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594128512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.419893:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7084 00000100:00100000:2.0:1746143761.419900:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7085 00000100:00100000:2.0:1746143761.419905:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594128640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.419910:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.419916:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.419924:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.419934:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f23400/0xe984082ccd72f6b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7516 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.419940:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.419942:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.419947:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.419954:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.419974:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.419984:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594335616:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143761.420028:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143761.420402:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.420424:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.420924:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128896 00000100:00100000:2.0:1746143761.420929:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128896 00000100:00100000:2.0:1746143761.420961:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594128768 00000100:00100000:2.0:1746143761.420963:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594128768 00000100:00100000:2.0:1746143761.420986:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13266 00000100:00100000:2.0:1746143761.420991:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594128896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.421003:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.421012:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f200/0xe984082ccd72f78c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75c5 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.421026:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13267 00010000:00010000:2.0:1746143761.421029:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009106f200/0xe984082ccd72f78c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75c5 expref: 26 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143761.421033:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594128768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.421038:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f200/0xe984082ccd72f78c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75c5 expref: 26 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143761.421040:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143761.421047:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72f793 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75be expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.421053:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009106f200, rc 0) 00000100:00100000:0.0:1746143761.421070:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594335744:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143761.421076:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594128896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 84us (674us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143761.421081:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13266 00000100:00100000:0.0:1746143761.421107:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.422052:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594335616:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143761.422064:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.422084:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594128640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2179us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.422090:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7085 00000100:00100000:0.0:1746143761.422492:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.422530:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594129152 00000100:00100000:2.0:1746143761.422533:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594129152 00002000:00100000:2.0:1746143761.422561:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1679360->1683455) req@ffff880090766d80 x1830963594129152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.422569:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963594129152 ext(1679360->1683455) 00002000:00010000:2.0:1746143761.422573:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766d80 00000100:00100000:2.0:1746143761.422591:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6218 00000100:00100000:2.0:1746143761.422596:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594129152:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.422721:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594129152:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 124us (229us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.422726:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6218 00002000:00100000:2.0:1746143761.422731:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1679360->1683455) req@ffff880090766d80 x1830963594129152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.422737:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963594129152 ext(1679360->1683455) 00002000:00010000:2.0:1746143761.422739:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766d80 00002000:00010000:2.0:1746143761.423311:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143760 -> 1746143761 00000100:00100000:2.0:1746143761.423322:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594335744:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143761.423337:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72f793 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75be expref: 24 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.423347:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72f793 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75be expref: 24 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.423356:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be800, rc 0) 00000100:00100000:2.0:1746143761.423602:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594128768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2568us (3175us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143761.423608:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13267 00000100:00100000:0.0:1746143761.428432:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.428584:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594129408 00000100:00100000:2.0:1746143761.428591:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594129408 00002000:00100000:2.0:1746143761.428624:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1957888->1961983) req@ffff880090767b80 x1830963594129408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.428634:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767b80 with x1830963594129408 ext(1957888->1961983) 00002000:00010000:2.0:1746143761.428639:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090767b80 00000100:00100000:2.0:1746143761.428661:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6219 00000100:00100000:2.0:1746143761.428666:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594129408:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.430396:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594129408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1725us (1967us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.430403:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6219 00002000:00100000:2.0:1746143761.430409:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1957888->1961983) req@ffff880090767b80 x1830963594129408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.430417:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767b80 with x1830963594129408 ext(1957888->1961983) 00002000:00010000:2.0:1746143761.430420:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090767b80 00000100:00100000:0.0:1746143761.439953:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.445504:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594129664 00000100:00100000:2.0:1746143761.445514:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594129664 00000100:00100000:2.0:1746143761.445556:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3923 00000100:00100000:2.0:1746143761.445563:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:31254:x1830963594129664:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143761.445843:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31254:x1830963594129664:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 279us (5896us total) trans 8589943474 rc 0/0 00000100:00100000:2.0:1746143761.445849:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3923 00000100:00100000:0.0:1746143761.452112:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.452185:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594129920 00000100:00100000:3.0:1746143761.452192:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594129920 00000100:00100000:3.0:1746143761.452241:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9160 00000100:00100000:3.0:1746143761.452247:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31257:x1830963594129920:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143761.452268:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.452281:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683800/0xe984082ccd72f79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75cc expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.452362:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.452374:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.452381:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 253 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.452386:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143761.452409:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 253 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.452423:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 253 pid: 21713 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.452433:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594335872:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.452509:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.452516:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 8 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.452523:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594336000:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.452540:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.454757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.454795:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.454861:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594130048 00000100:00100000:2.0:1746143761.454866:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594130048 00010000:00010000:2.0:1746143761.454890:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 254 pid: 21713 timeout: 940 lvb_type: 0 00000100:00100000:0.0:1746143761.455293:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594335872:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143761.455301:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594336000:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143761.455322:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143761.455482:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594130176 00000100:00100000:1.0:1746143761.455486:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594130176 00010000:00010000:1.0:1746143761.455500:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.455521:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7086 00000100:00100000:1.0:1746143761.455527:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1963:x1830963594130048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143761.455537:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143761.455542:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 254 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.455550:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 254 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.455566:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72f770 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75a9 expref: 254 pid: 21713 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.455583:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.455588:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.455595:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.455600:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143761.455631:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1963:x1830963594130048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.455637:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7086 00000100:00100000:1.0:1746143761.455652:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7087 00000100:00100000:1.0:1746143761.455656:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594130176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143761.455662:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143761.455665:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.455673:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.455682:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f22600/0xe984082ccd72f6cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7524 expref: 9 pid: 16090 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.455689:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.455692:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.455697:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.455703:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.455718:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143761.455730:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594130176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.455735:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7087 00010000:00010000:1.0:1746143761.455772:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.455778:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143761.455791:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143761.455900:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683800/0xe984082ccd72f79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 24 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.455911:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 23 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.455917:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.455919:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143761.455921:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f683e00, rc 0) 00000100:00100000:1.0:1746143761.455942:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31257:x1830963594129920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3696us (3838us total) trans 8589943475 rc 0/0 00000100:00100000:1.0:1746143761.455947:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9160 00000100:00100000:0.0:1746143761.599735:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.600078:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594130432 00000100:00100000:1.0:1746143761.600087:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594130432 00000100:00100000:1.0:1746143761.600775:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9161 00000100:00100000:1.0:1746143761.600784:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:31262:x1830963594130432:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.600802:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.600817:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e200/0xe984082ccd72f7af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75d3 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.600908:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.600918:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.600926:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.600936:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.600940:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.600944:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601042:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e800/0xe984082ccd72f7c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601051:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e800/0xe984082ccd72f7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601057:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e800/0xe984082ccd72f7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143761.601064:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143761.601918:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601925:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601931:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601936:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8e400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.601938:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601943:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601952:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143761.601954:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.601957:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.601961:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e400/0xe984082ccd72f7b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602203:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602209:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602214:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602218:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8e600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.602229:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602233:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602244:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74100) 00010000:00010000:1.0:1746143761.602246:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.602248:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602251:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72f7bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.602286:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e200/0xe984082ccd72f7af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75d3 expref: 256 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.602295:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e800/0xe984082ccd72f7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75d3 expref: 255 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.602300:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.602302:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143761.602304:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8e800, rc 0) 00000100:00100000:1.0:1746143761.603406:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31262:x1830963594130432:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2621us (3676us total) trans 8589943476 rc 0/0 00000100:00100000:1.0:1746143761.603413:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9161 00000100:00100000:0.0:1746143761.610816:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.611698:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594130560 00000100:00100000:2.0:1746143761.611707:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594130560 00000100:00100000:2.0:1746143761.611755:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 723 00000100:00100000:2.0:1746143761.611761:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1962:x1830963594130560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.611772:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.611792:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e800/0xe984082ccd72f7c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75d3 expref: 255 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.612066:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143761.612070:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.612819:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1962:x1830963594130560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1056us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.612827:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 723 00000100:00100000:0.0:1746143761.614196:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.614278:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594130816 00000100:00100000:1.0:1746143761.614283:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594130816 00000100:00100000:1.0:1746143761.614371:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9162 00000100:00100000:1.0:1746143761.614378:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31263:x1830963594130816:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.614396:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.614408:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ec00/0xe984082ccd72f7d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75da expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.614503:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614514:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614523:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614534:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614540:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614545:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614627:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f7e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614634:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.614931:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143761.614940:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143761.615019:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615026:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615034:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615039:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8ee00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.615042:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615047:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615055:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143761.615057:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.615060:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615063:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ee00/0xe984082ccd72f7d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615267:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615273:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615277:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615281:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8f000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.615283:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615288:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615299:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74900) 00010000:00010000:1.0:1746143761.615301:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.615303:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615307:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f000/0xe984082ccd72f7e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.615341:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8ec00/0xe984082ccd72f7d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75da expref: 257 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.615350:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75da expref: 256 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.615355:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.615357:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143761.615359:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f800, rc 0) 00000100:00100000:1.0:1746143761.615826:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:31263:x1830963594130816:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1448us (1631us total) trans 8589943477 rc 0/0 00000100:00100000:1.0:1746143761.615833:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9162 00000100:00100000:0.0:1746143761.618252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.619023:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594130944 00000100:00100000:2.0:1746143761.619031:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594130944 00000100:00100000:2.0:1746143761.619085:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 724 00000100:00100000:2.0:1746143761.619092:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1963:x1830963594130944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.619104:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.619123:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f7e7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75da expref: 256 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.619157:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143761.619161:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.619204:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1963:x1830963594130944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.619210:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 724 00000100:00100000:3.0:1746143761.619389:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.619722:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594131072 00000100:00100000:2.0:1746143761.619725:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594131072 00000100:00100000:2.0:1746143761.619923:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13268 00000100:00100000:2.0:1746143761.619928:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594131072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143761.619940:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143761.619951:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009106f800/0xe984082ccd72f7f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75e1 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.619970:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009106f800/0xe984082ccd72f7f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e1 expref: 32 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.619978:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009106f800/0xe984082ccd72f7f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e1 expref: 32 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143761.619986:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009106f800, rc 0) 00000100:00100000:0.0:1746143761.620098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.620409:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594131200 00000100:00100000:3.0:1746143761.620413:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594131200 00000100:00100000:3.0:1746143761.620434:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13269 00000100:00100000:3.0:1746143761.620438:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31257:x1830963594131200:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143761.620445:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.620451:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75e8 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.620465:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 31 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.620472:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.620473:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.620476:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 24 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.620497:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 31 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.620506:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 31 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.620515:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594336128:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.620568:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.620606:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594131072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 88us (627us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143761.620614:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13268 00000100:00100000:0.0:1746143761.624065:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.624094:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594336128:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143761.624178:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594131328 00000100:00100000:2.0:1746143761.624184:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594131328 00010000:00010000:3.0:1746143761.624193:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 24 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.624211:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095728e00, rc 0) 00000100:00100000:3.0:1746143761.624259:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31257:x1830963594131200:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3819us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.624266:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13269 00002000:00100000:2.0:1746143761.624286:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1679360->1961983) req@ffff8800a050d880 x1830963594131328/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.624295:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050d880 with x1830963594131328 ext(1679360->1961983) 00010000:00010000:2.0:1746143761.624301:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 31 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.624312:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 31 pid: 2839 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.624328:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a050d880 00000100:00100000:2.0:1746143761.624351:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1765 00000100:00100000:2.0:1746143761.624358:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594131328:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143761.626031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.626111:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594131456 00000100:00100000:3.0:1746143761.626115:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594131456 00000100:00100000:3.0:1746143761.626710:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13270 00000100:00100000:3.0:1746143761.626718:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:31263:x1830963594131456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.626730:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.626743:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75ef expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.626765:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.626770:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.626775:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143761.626778:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.626804:0:2839:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.626813:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.626821:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e9a00, rc 0) 00000100:00100000:3.0:1746143761.626850:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31263:x1830963594131456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 133us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.626855:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13270 00000100:00100000:2.0:1746143761.629535:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963594131328:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5169us (5468us total) trans 17179873076 rc 0/0 00000100:00100000:2.0:1746143761.629545:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1765 00002000:00100000:2.0:1746143761.629555:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1679360->1961983) req@ffff8800a050d880 x1830963594131328/t17179873076(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.629564:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050d880 with x1830963594131328 ext(1679360->1961983) 00010000:00010000:2.0:1746143761.629572:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 34 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.629586:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 34 pid: 2839 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.629592:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a050d880 00000100:00100000:0.0:1746143761.630740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.630800:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594131584 00000100:00100000:1.0:1746143761.630805:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594131584 00000100:00100000:1.0:1746143761.630838:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13271 00000100:00100000:1.0:1746143761.630842:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31262:x1830963594131584:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.630852:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.630862:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75f6 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.630882:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 35 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.630888:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.630891:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143761.630892:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143761.630894:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3297280->3674111] (req 3297280->3674111) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 35 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.630912:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.630918:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 23 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.630924:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594336384:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.630990:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 35 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.630995:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 35 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.631000:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594336512:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.631010:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143761.631510:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.631575:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594131712 00000100:00100000:2.0:1746143761.631579:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594131712 00010000:00010000:2.0:1746143761.631597:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 36 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.631625:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7088 00000100:00100000:2.0:1746143761.631632:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594131712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.631643:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143761.631661:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 36 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.631671:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 36 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.631684:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a2211800/0xe984082ccd72f77e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1679360->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75b0 expref: 36 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.631695:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.631696:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.631701:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.631708:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.631727:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.631735:0:7150:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.631743:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594336640:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143761.632536:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143761.633831:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594336384:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.633837:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594336512:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.633853:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3297280->3674111] (req 3297280->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 35 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.633862:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8fa00, rc 0) 00000100:00100000:1.0:1746143761.633993:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31262:x1830963594131584:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3148us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.634000:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13271 00000100:00100000:1.0:1746143761.634574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.634664:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594336640:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.634678:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.634711:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594131712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3079us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.634718:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7088 00000100:00100000:3.0:1746143761.634735:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594131840 00000100:00100000:3.0:1746143761.634739:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594131840 00010000:00010000:3.0:1746143761.634757:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 34 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.634775:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7089 00000100:00100000:3.0:1746143761.634836:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594131840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.634848:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.634867:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 34 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.634877:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 34 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.634892:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143761.634894:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f22200/0xe984082ccd72f6d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a752b expref: 34 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.634906:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.634921:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594131840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 140us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.634926:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7089 00000100:00100000:3.0:1746143761.634935:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594132096 00000100:00100000:3.0:1746143761.634938:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594132096 00010000:00010000:3.0:1746143761.634947:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.634959:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7090 00000100:00100000:3.0:1746143761.634964:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594132096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.634970:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.634978:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.634986:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.634997:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c113e00/0xe984082ccd72f74d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a759b expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.635005:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.635006:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.635016:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.635023:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.635044:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143761.635047:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.635054:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594336768:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.635086:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.635099:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594132224 00000100:00100000:2.0:1746143761.635103:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594132224 00002000:00100000:2.0:1746143761.635123:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (2019328->2023423) req@ffff8800a0086d80 x1830963594132224/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.635136:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086d80 with x1830963594132224 ext(2019328->2023423) 00010000:00010000:2.0:1746143761.635154:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.635163:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.635170:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0086d80 00000100:00100000:2.0:1746143761.635183:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1766 00000100:00100000:2.0:1746143761.635188:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594132224:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.635309:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594132224:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 119us (260us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.635314:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1766 00002000:00100000:2.0:1746143761.635319:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (2019328->2023423) req@ffff8800a0086d80 x1830963594132224/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.635326:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0086d80 with x1830963594132224 ext(2019328->2023423) 00010000:00010000:2.0:1746143761.635330:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.635338:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 24 pid: 2839 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.635343:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0086d80 00000100:00100000:3.0:1746143761.636655:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594336768:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.636666:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.636700:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594132096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1735us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.636707:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7090 00000100:00100000:0.0:1746143761.636843:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.636865:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594132480 00000100:00100000:2.0:1746143761.636869:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594132480 00002000:00100000:2.0:1746143761.636888:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3297280->3301375) req@ffff8800a050c000 x1830963594132480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.636895:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050c000 with x1830963594132480 ext(3297280->3301375) 00002000:00010000:2.0:1746143761.636899:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050c000 00000100:00100000:2.0:1746143761.636922:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6220 00000100:00100000:2.0:1746143761.636927:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963594132480:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.637008:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963594132480:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 81us (166us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.637014:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6220 00002000:00100000:2.0:1746143761.637017:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3297280->3301375) req@ffff8800a050c000 x1830963594132480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.637024:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050c000 with x1830963594132480 ext(3297280->3301375) 00002000:00010000:2.0:1746143761.637026:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050c000 00000100:00100000:2.0:1746143761.638683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.639465:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.639511:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594132736 00000100:00100000:3.0:1746143761.639516:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594132736 00002000:00100000:3.0:1746143761.639541:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (2019328->2097151) req@ffff8800a087a300 x1830963594132736/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.639549:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a300 with x1830963594132736 ext(2019328->2097151) 00010000:00010000:3.0:1746143761.639556:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.639568:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 23 pid: 2839 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143761.639574:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a087a300 00000100:00100000:3.0:1746143761.639584:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1767 00000100:00100000:3.0:1746143761.639590:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594132736:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143761.639776:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594132864 00000100:00100000:1.0:1746143761.639780:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594132864 00000100:00100000:1.0:1746143761.639799:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13272 00000100:00100000:1.0:1746143761.639804:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31257:x1830963594132864:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.639813:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.639825:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a75fd expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.639843:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.639851:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.639858:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.639863:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.639865:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.639867:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->2019327] (req 1048576->2019327) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.639890:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 29 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.639898:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 29 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143761.639907:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ceb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594336896:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.639963:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 9 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.639971:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 9 pid: 9527 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143761.639978:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594337024:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.639998:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.640008:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143761.640011:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 24 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.640018:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594337152:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.640031:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.640085:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594133120 00000100:00100000:2.0:1746143761.640089:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594133120 00002000:00100000:2.0:1746143761.640109:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3670016->3674111) req@ffff8800a050d180 x1830963594133120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.640115:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050d180 with x1830963594133120 ext(3670016->3674111) 00002000:00010000:2.0:1746143761.640118:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050d180 00000100:00100000:2.0:1746143761.640131:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6221 00000100:00100000:2.0:1746143761.640136:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594133120:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.640256:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594133120:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 120us (248us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.640262:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6221 00002000:00100000:2.0:1746143761.640267:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3670016->3674111) req@ffff8800a050d180 x1830963594133120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.640273:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050d180 with x1830963594133120 ext(3670016->3674111) 00002000:00010000:2.0:1746143761.640276:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050d180 00000100:00100000:3.0:1746143761.642078:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594132736:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 2484us (3393us total) trans 17179873077 rc 0/0 00000100:00100000:3.0:1746143761.642085:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1767 00002000:00100000:3.0:1746143761.642089:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (2019328->2097151) req@ffff8800a087a300 x1830963594132736/t17179873077(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.642094:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a300 with x1830963594132736 ext(2019328->2097151) 00010000:00010000:3.0:1746143761.642099:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 25 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.642107:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 25 pid: 2839 timeout: 940 lvb_type: 0 00002000:00010000:3.0:1746143761.642118:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a087a300 00000100:00100000:1.0:1746143761.642334:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ceb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594336896:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.642343:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594337024:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.642350:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594337152:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143761.642351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143761.642374:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->2019327] (req 1048576->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 24 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.642386:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f800, rc 0) 00000100:00100000:1.0:1746143761.642405:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31257:x1830963594132864:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2601us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.642411:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13272 00000100:00100000:3.0:1746143761.642523:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594133248 00000100:00100000:3.0:1746143761.642526:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594133248 00010000:00010000:3.0:1746143761.642541:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 10 pid: 9527 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.642559:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7091 00000100:00100000:3.0:1746143761.642563:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594133248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.642571:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.642583:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 10 pid: 9527 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.642590:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 10 pid: 9527 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.642606:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed3ce00/0xe984082ccd72f682 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74de expref: 10 pid: 9527 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.643129:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.643169:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594133248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 604us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.643174:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7091 00000100:00100000:1.0:1746143761.643284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.643385:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594133376 00000100:00100000:3.0:1746143761.643388:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594133376 00010000:00010000:3.0:1746143761.643400:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 30 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143761.643405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.643424:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594133504 00000100:00100000:3.0:1746143761.643426:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594133504 00000100:00100000:1.0:1746143761.643428:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143761.643434:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 24 pid: 25369 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.643478:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594133760 00000100:00100000:2.0:1746143761.643481:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594133760 00000100:00100000:2.0:1746143761.643499:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3924 00000100:00100000:3.0:1746143761.643522:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7092 00000100:00100000:3.0:1746143761.643527:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594133376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.643533:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143761.643534:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7093 00010000:00010000:3.0:1746143761.643541:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 30 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:0.0:1746143761.643541:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594133504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143761.643547:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.643549:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 30 pid: 4581 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.643559:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090670e00/0xe984082ccd72f5e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a749f expref: 30 pid: 4581 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143761.643574:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31262:x1830963594133760:12345-192.168.202.48@tcp:35:multiop.0 00010000:00010000:0.0:1746143761.643677:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 24 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.643696:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 24 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.643713:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800951f7000/0xe984082ccd72f547 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7460 expref: 24 pid: 25369 timeout: 940 lvb_type: 0 00010000:00010000:0.0:1746143761.643737:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.643739:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143761.643744:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.643745:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:31262:x1830963594133760:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 170us (316us total) trans 8589943478 rc 0/0 00000100:00100000:2.0:1746143761.643751:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3924 00010000:00010000:0.0:1746143761.643751:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143761.643808:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 23 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143761.643818:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a050e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594337280:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.643819:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.643839:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594133376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 311us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.643844:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7092 00000100:00100000:0.0:1746143761.643854:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.644357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.644392:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594133888 00000100:00100000:3.0:1746143761.644395:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594133888 00010000:00010000:3.0:1746143761.644408:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 25 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.644438:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7094 00000100:00100000:3.0:1746143761.644444:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594133888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.644449:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.644460:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 25 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.644467:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 25 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.644478:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095728e00/0xe984082ccd72f7fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75e8 expref: 25 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.644486:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.644488:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.644491:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.644497:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.644513:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.644520:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594337408:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.644564:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.644801:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a050e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594337280:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143761.644810:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143761.644828:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594133504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1288us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.644834:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7093 00000100:00100000:3.0:1746143761.645833:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594337408:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.645843:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.645863:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594133888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1419us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.645869:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7094 00000100:00100000:0.0:1746143761.647373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.648097:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594134144 00000100:00100000:3.0:1746143761.648103:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594134144 00002000:00100000:3.0:1746143761.648165:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a050e300 x1830963594134144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.648173:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050e300 with x1830963594134144 ext(1048576->2097151) 00002000:00010000:3.0:1746143761.648178:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050e300 00000100:00100000:3.0:1746143761.648201:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6222 00000100:00100000:3.0:1746143761.648207:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594134144:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143761.653730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.653768:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.653801:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.653829:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594134656 00000100:00100000:0.0:1746143761.653836:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594134656 00002000:00100000:0.0:1746143761.653870:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x353:0x0] (2015232->2019327) req@ffff8800a54e8380 x1830963594134656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.653878:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8380 with x1830963594134656 ext(2015232->2019327) 00002000:00010000:0.0:1746143761.653883:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54e8380 00000100:00100000:0.0:1746143761.653906:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6223 00000100:00100000:0.0:1746143761.653913:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594134656:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143761.653921:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594134272 00000100:00100000:1.0:1746143761.653925:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594134272 00000100:00100000:1.0:1746143761.653961:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594134400 00000100:00100000:1.0:1746143761.653963:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594134400 00000100:00100000:1.0:1746143761.653974:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13273 00000100:00100000:3.0:1746143761.653979:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13274 00000100:00100000:1.0:1746143761.653979:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594134272:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143761.653987:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594134400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.653989:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.653993:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.654002:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8200/0xe984082ccd72f81f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a760b expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.654002:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7604 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.654018:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.654019:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.654027:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143761.654041:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594337536:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143761.654041:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.654049:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8e600, rc 0) 00000100:00100000:0.0:1746143761.654052:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594134656:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 139us (250us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143761.654057:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6223 00002000:00100000:0.0:1746143761.654062:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (2015232->2019327) req@ffff8800a54e8380 x1830963594134656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.654068:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8380 with x1830963594134656 ext(2015232->2019327) 00002000:00010000:0.0:1746143761.654070:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54e8380 00000100:00100000:1.0:1746143761.654073:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594134272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.654078:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13273 00000100:00100000:3.0:1746143761.654103:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.655411:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594134144:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7201us (8039us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.655417:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6222 00002000:00100000:3.0:1746143761.655423:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a050e300 x1830963594134144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.655430:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a050e300 with x1830963594134144 ext(1048576->2097151) 00002000:00010000:3.0:1746143761.655433:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a050e300 00002000:00010000:3.0:1746143761.655558:0:2839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143760 -> 1746143761 00002000:00010000:3.0:1746143761.655561:0:2839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143760 -> 1746143761 00000100:00100000:3.0:1746143761.655572:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594337536:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143761.655590:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8200/0xe984082ccd72f81f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a760b expref: 26 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.655598:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e8200/0xe984082ccd72f81f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a760b expref: 26 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.655606:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a71e8200, rc 0) 00000100:00100000:3.0:1746143761.655683:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594134400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1697us (1913us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.655688:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13274 00000100:00100000:0.0:1746143761.661612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.661807:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594134784 00000100:00100000:3.0:1746143761.661816:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594134784 00000100:00100000:3.0:1746143761.661853:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13275 00000100:00100000:3.0:1746143761.661860:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31263:x1830963594134784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.661875:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.661889:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7612 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.661914:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.661926:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.661927:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.661930:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.661952:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.661962:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 22 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.661972:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594337664:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.662041:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.665726:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.665771:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594337664:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143761.665772:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143761.665796:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.665812:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0a00, rc 0) 00000100:00100000:2.0:1746143761.665849:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594135040 00000100:00100000:3.0:1746143761.665850:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:31263:x1830963594134784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3990us (4244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143761.665855:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594135040 00000100:00100000:3.0:1746143761.665858:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13275 00002000:00100000:2.0:1746143761.665886:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a54e9180 x1830963594135040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.665894:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e9180 with x1830963594135040 ext(1048576->2097151) 00002000:00010000:2.0:1746143761.665904:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54e9180 00000100:00100000:2.0:1746143761.665914:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594135168 00000100:00100000:2.0:1746143761.665916:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594135168 00002000:00100000:2.0:1746143761.665926:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2019327) req@ffff8800a54eaa00 x1830963594135168/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.665933:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54eaa00 with x1830963594135168 ext(1048576->2019327) 00010000:00010000:2.0:1746143761.665937:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 23 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.665948:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 23 pid: 12618 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.665954:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a54eaa00 00000100:00100000:2.0:1746143761.665973:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1768 00000100:00100000:2.0:1746143761.665979:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594135168:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143761.666170:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6224 00000100:00100000:3.0:1746143761.666177:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594135040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.676706:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594135040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10520us (10976us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.676717:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6224 00002000:00100000:3.0:1746143761.676728:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a54e9180 x1830963594135040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.676737:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e9180 with x1830963594135040 ext(1048576->2097151) 00002000:00010000:3.0:1746143761.676742:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a54e9180 00000100:00100000:2.0:1746143761.682944:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594135168:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16955us (17162us total) trans 21474840401 rc 0/0 00000100:00100000:2.0:1746143761.682952:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1768 00002000:00100000:2.0:1746143761.682961:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2019327) req@ffff8800a54eaa00 x1830963594135168/t21474840401(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.682967:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54eaa00 with x1830963594135168 ext(1048576->2019327) 00010000:00010000:2.0:1746143761.682974:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 25 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.682986:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 25 pid: 12618 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.682991:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a54eaa00 00000100:00100000:0.0:1746143761.683952:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.684048:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594135296 00000100:00100000:3.0:1746143761.684054:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594135296 00000100:00100000:3.0:1746143761.684646:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13276 00000100:00100000:3.0:1746143761.684653:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31267:x1830963594135296:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.684667:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.684680:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7619 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.684702:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.684706:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 26 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.684715:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 26 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.684723:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1c00, rc 0) 00000100:00100000:3.0:1746143761.684764:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31267:x1830963594135296:12345-192.168.202.48@tcp:101:cat.0 Request processed in 112us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.684770:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13276 00000100:00100000:0.0:1746143761.686942:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.687024:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594135424 00000100:00100000:3.0:1746143761.687031:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594135424 00010000:00010000:3.0:1746143761.687059:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 26 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:2.0:1746143761.687243:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7095 00000100:00100000:2.0:1746143761.687251:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594135424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143761.687263:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143761.687279:0:9890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143760 -> 1746143761 00002000:00010000:2.0:1746143761.687282:0:9890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143760 -> 1746143761 00010000:00010000:2.0:1746143761.687287:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 26 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.687298:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 26 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.687316:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f800/0xe984082ccd72f811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2019327) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75fd expref: 26 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.687333:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.687334:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.687340:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.687348:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.687355:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.687356:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143761.687359:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 25 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.687364:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 25 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143761.687388:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 25 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.687398:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594337792:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143761.688309:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143761.688319:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594337920:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143761.688991:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.694006:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594337792:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143761.694511:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.694570:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594135680 00000100:00100000:3.0:1746143761.694576:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594135680 00000100:00100000:2.0:1746143761.694577:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594337920:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143761.694596:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143761.694612:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a54ea300 x1830963594135680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.694620:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ea300 with x1830963594135680 ext(1048576->2097151) 00002000:00010000:3.0:1746143761.694625:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54ea300 00000100:00100000:2.0:1746143761.694640:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594135424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7390us (7705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.694641:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6225 00000100:00100000:3.0:1746143761.694647:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594135680:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.694648:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7095 00000100:00100000:0.0:1746143761.699988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.700170:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594135936 00000100:00100000:3.0:1746143761.700179:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594135936 00002000:00100000:3.0:1746143761.700215:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a54eb480 x1830963594135936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.700237:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54eb480 with x1830963594135936 ext(1048576->2097151) 00002000:00010000:3.0:1746143761.700242:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54eb480 00000100:00100000:3.0:1746143761.700265:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6226 00000100:00100000:3.0:1746143761.700272:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594135936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.701758:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594135680:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7107us (7245us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.701766:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6225 00002000:00100000:3.0:1746143761.701771:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a54ea300 x1830963594135680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.701784:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54ea300 with x1830963594135680 ext(1048576->2097151) 00002000:00010000:3.0:1746143761.701788:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54ea300 00000100:00100000:3.0:1746143761.708127:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594135936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7847us (8138us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143761.708162:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6226 00002000:00100000:3.0:1746143761.708171:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a54eb480 x1830963594135936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.708179:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54eb480 with x1830963594135936 ext(1048576->2097151) 00002000:00010000:3.0:1746143761.708184:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54eb480 00000100:00100000:1.0:1746143761.715098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.715258:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594136192 00000100:00100000:0.0:1746143761.715267:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594136192 00002000:00100000:0.0:1746143761.715305:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093ceb800 x1830963594136192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.715314:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceb800 with x1830963594136192 ext(2097152->3145727) 00002000:00010000:0.0:1746143761.715320:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ceb800 00000100:00100000:0.0:1746143761.715348:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6227 00000100:00100000:0.0:1746143761.715355:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594136192:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143761.718913:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.719060:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594136320 00000100:00100000:1.0:1746143761.719067:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594136320 00000100:00100000:1.0:1746143761.719117:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13277 00000100:00100000:1.0:1746143761.719124:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31267:x1830963594136320:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.719154:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.719170:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7620 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.719195:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.719207:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143761.719208:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143761.719212:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.719248:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 32 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.719258:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 32 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.719268:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338048:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.719323:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.722559:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594136192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7196us (7460us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143761.722568:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6227 00002000:00100000:2.0:1746143761.722579:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880093ceb800 x1830963594136192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.722589:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceb800 with x1830963594136192 ext(2097152->3145727) 00002000:00010000:2.0:1746143761.722593:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ceb800 00000100:00100000:1.0:1746143761.723257:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338048:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.723281:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.723295:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f400, rc 0) 00000100:00100000:1.0:1746143761.723314:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31267:x1830963594136320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4191us (4408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.723320:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13277 00000100:00100000:0.0:1746143761.724516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.725352:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594136448 00000100:00100000:2.0:1746143761.725359:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594136448 00002000:00100000:2.0:1746143761.725395:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3297280->3674111) req@ffff8800a54e9880 x1830963594136448/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.725403:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e9880 with x1830963594136448 ext(3297280->3674111) 00010000:00010000:2.0:1746143761.725419:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 33 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.725431:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 33 pid: 12618 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.725437:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a54e9880 00000100:00100000:2.0:1746143761.725465:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1769 00000100:00100000:2.0:1746143761.725471:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594136448:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143761.728351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.728775:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594136576 00000100:00100000:1.0:1746143761.728781:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594136576 00000100:00100000:1.0:1746143761.728827:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13278 00000100:00100000:1.0:1746143761.728833:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31263:x1830963594136576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.728848:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.728861:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7627 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.728884:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.728891:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143761.728893:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143761.728896:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.728919:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.728927:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 25 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.728938:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338176:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.729014:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143761.731206:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338176:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.731242:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.731257:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f200, rc 0) 00000100:00100000:1.0:1746143761.731438:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31263:x1830963594136576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2603us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.731449:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13278 00000100:00100000:0.0:1746143761.731938:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.732049:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594136448:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6577us (7534us total) trans 17179873078 rc 0/0 00000100:00100000:3.0:1746143761.732056:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1769 00002000:00100000:3.0:1746143761.732063:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3297280->3674111) req@ffff8800a54e9880 x1830963594136448/t17179873078(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143761.732071:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e9880 with x1830963594136448 ext(3297280->3674111) 00010000:00010000:3.0:1746143761.732077:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 36 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.732077:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594136704 00000100:00100000:1.0:1746143761.732082:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594136704 00010000:00010000:3.0:1746143761.732087:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 36 pid: 12618 timeout: 940 lvb_type: 0 00002000:00100000:1.0:1746143761.732725:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2879488->3145727) req@ffff88008efac000 x1830963594136704/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.732732:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efac000 with x1830963594136704 ext(2879488->3145727) 00010000:00010000:1.0:1746143761.732738:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 26 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.732745:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 26 pid: 6929 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143761.732751:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efac000 00000100:00100000:1.0:1746143761.732766:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1770 00000100:00100000:1.0:1746143761.732771:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594136704:12345-192.168.202.48@tcp:4:cat.0 00002000:00010000:3.0:1746143761.732949:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a54e9880 00000100:00100000:2.0:1746143761.734804:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.735382:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594136832 00000100:00100000:3.0:1746143761.735388:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594136832 00010000:00010000:3.0:1746143761.735411:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 36 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.735648:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7096 00000100:00100000:3.0:1746143761.735656:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594136832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.735666:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.735680:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 36 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.735690:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 36 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.735708:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8fa00/0xe984082ccd72f80a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3297280->18446744073709551615] (req 3297280->3674111) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75f6 expref: 36 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.736159:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594136704:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3386us (4220us total) trans 17179873079 rc 0/0 00000100:00100000:1.0:1746143761.736167:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1770 00010000:00010000:3.0:1746143761.736169:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.736171:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746143761.736175:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2879488->3145727) req@ffff88008efac000 x1830963594136704/t17179873079(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143761.736178:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143761.736183:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efac000 with x1830963594136704 ext(2879488->3145727) 00010000:00010000:3.0:1746143761.736186:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.736190:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 28 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:1.0:1746143761.736201:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 28 pid: 6929 timeout: 940 lvb_type: 0 00002000:00010000:1.0:1746143761.736208:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efac000 00010000:00010000:3.0:1746143761.736213:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.736239:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594338304:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.736281:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.738506:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594338304:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.738523:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.739079:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594136832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3422us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.739089:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7096 00000100:00100000:0.0:1746143761.740014:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.740046:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.740048:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594137216 00000100:00100000:1.0:1746143761.740055:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594137216 00002000:00100000:1.0:1746143761.740083:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008efac380 x1830963594137216/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.740091:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efac380 with x1830963594137216 ext(3145728->4194303) 00002000:00010000:1.0:1746143761.740095:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efac380 00000100:00100000:1.0:1746143761.740119:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6228 00000100:00100000:1.0:1746143761.740128:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594137216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.740765:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594136960 00000100:00100000:3.0:1746143761.740769:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594136960 00010000:00010000:3.0:1746143761.740784:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 30 pid: 6929 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.740809:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7097 00000100:00100000:3.0:1746143761.740814:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594136960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.740820:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.740831:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 30 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.740841:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 30 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.740858:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f22e00/0xe984082ccd72f6c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2879488->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a751d expref: 30 pid: 6929 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.740872:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.740874:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.740880:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.740887:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.740916:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.740926:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594338432:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.740974:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.744500:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594338432:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.744519:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.744566:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594136960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3751us (4518us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.744576:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7097 00000100:00100000:1.0:1746143761.747854:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963594137216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7722us (7833us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143761.747868:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6228 00002000:00100000:1.0:1746143761.747877:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008efac380 x1830963594137216/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.747886:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efac380 with x1830963594137216 ext(3145728->4194303) 00002000:00010000:1.0:1746143761.747890:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efac380 00000100:00100000:0.0:1746143761.748593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.749285:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594137472 00000100:00100000:1.0:1746143761.749291:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594137472 00002000:00100000:1.0:1746143761.749325:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008efaca80 x1830963594137472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.749332:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaca80 with x1830963594137472 ext(2097152->3145727) 00002000:00010000:1.0:1746143761.749336:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaca80 00000100:00100000:1.0:1746143761.749366:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6229 00000100:00100000:1.0:1746143761.749373:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594137472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143761.749650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.749665:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594137984 00000100:00100000:0.0:1746143761.749668:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594137984 00002000:00100000:0.0:1746143761.749684:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008eface00 x1830963594137984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143761.749692:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eface00 with x1830963594137984 ext(3145728->4194303) 00002000:00010000:0.0:1746143761.749696:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eface00 00000100:00100000:0.0:1746143761.749710:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6230 00000100:00100000:0.0:1746143761.749714:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594137984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143761.750683:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.750806:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594137728 00000100:00100000:1.0:1746143761.750811:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594137728 00002000:00100000:1.0:1746143761.750829:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008efad180 x1830963594137728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.750836:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efad180 with x1830963594137728 ext(3145728->4194303) 00002000:00010000:1.0:1746143761.750839:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efad180 00000100:00100000:1.0:1746143761.750866:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6231 00000100:00100000:1.0:1746143761.750871:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963594137728:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143761.753760:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.754080:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594138112 00000100:00100000:1.0:1746143761.754086:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594138112 00000100:00100000:1.0:1746143761.754806:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13279 00000100:00100000:1.0:1746143761.754815:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594138112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.754830:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.754843:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a762e expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.754864:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.754865:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.754873:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 28 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.754885:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 28 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.754895:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beda800, rc 0) 00000100:00100000:1.0:1746143761.754935:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594138112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 122us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.754941:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13279 00000100:00100000:1.0:1746143761.757771:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594137984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8048us (8113us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143761.757780:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6230 00002000:00100000:1.0:1746143761.757789:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008eface00 x1830963594137984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.757799:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eface00 with x1830963594137984 ext(3145728->4194303) 00002000:00010000:1.0:1746143761.757803:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eface00 00000100:00100000:1.0:1746143761.765981:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963594137728:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15101us (15291us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143761.765993:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6231 00002000:00100000:1.0:1746143761.766004:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008efad180 x1830963594137728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.766013:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efad180 with x1830963594137728 ext(3145728->4194303) 00002000:00010000:1.0:1746143761.766020:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efad180 00000100:00100000:1.0:1746143761.766717:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594137472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17343us (18125us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143761.766723:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6229 00002000:00100000:1.0:1746143761.766728:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008efaca80 x1830963594137472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.766735:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaca80 with x1830963594137472 ext(2097152->3145727) 00002000:00010000:1.0:1746143761.766738:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaca80 00010000:00010000:2.0:1746143761.768238:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143761.779037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.779759:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594138368 00000100:00100000:2.0:1746143761.779768:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594138368 00000100:00100000:2.0:1746143761.779836:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3925 00000100:00100000:2.0:1746143761.779843:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:31263:x1830963594138368:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143761.781299:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31263:x1830963594138368:12345-192.168.202.48@tcp:35:cat.0 Request processed in 1452us (2264us total) trans 8589943479 rc 0/0 00000100:00100000:2.0:1746143761.781313:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3925 00000100:00100000:0.0:1746143761.818816:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.818919:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594138496 00000100:00100000:1.0:1746143761.818927:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594138496 00000100:00100000:1.0:1746143761.819324:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13280 00000100:00100000:1.0:1746143761.819331:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31271:x1830963594138496:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.819346:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.819360:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7635 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.819385:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.819393:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.819400:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.819401:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143761.819404:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2617344->3121151] (req 2617344->3121151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.819428:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.819442:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 29 pid: 12618 timeout: 940 lvb_type: 1 00000100:00100000:1.0:1746143761.819452:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338560:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.819536:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.819544:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 34 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:1.0:1746143761.819551:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338688:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.819573:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143761.822612:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338560:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143761.822623:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093807800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594338688:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143761.822648:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2617344->3121151] (req 2617344->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.822663:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beda400, rc 0) 00000100:00100000:1.0:1746143761.822711:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31271:x1830963594138496:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3379us (3901us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143761.822718:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13280 00000100:00100000:0.0:1746143761.822998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.823109:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594138624 00000100:00100000:3.0:1746143761.823437:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594138624 00010000:00010000:3.0:1746143761.823461:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 29 pid: 12618 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.823491:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7098 00000100:00100000:3.0:1746143761.823496:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594138624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.823508:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.823702:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 29 pid: 12618 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.823717:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 29 pid: 12618 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.823735:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009beda800/0xe984082ccd72f842 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a762e expref: 29 pid: 12618 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.823788:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.823862:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594138624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 364us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.823868:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7098 00000100:00100000:0.0:1746143761.824919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.824971:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594138752 00000100:00100000:3.0:1746143761.824976:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594138752 00010000:00010000:3.0:1746143761.824994:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 35 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.825025:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7099 00000100:00100000:3.0:1746143761.825030:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594138752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.825038:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.825051:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 35 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.825060:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 35 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.825073:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f200/0xe984082ccd72f83b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7627 expref: 35 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.825082:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.825084:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.825090:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.825096:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.825494:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.825507:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594338816:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.825802:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.827955:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.828109:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594338816:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.828123:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.828176:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594138752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3145us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.828184:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7099 00000100:00100000:1.0:1746143761.829946:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594139008 00000100:00100000:1.0:1746143761.829954:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594139008 00002000:00100000:1.0:1746143761.829992:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2617344->2621439) req@ffff88008efae300 x1830963594139008/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.830001:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efae300 with x1830963594139008 ext(2617344->2621439) 00002000:00010000:1.0:1746143761.830005:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efae300 00000100:00100000:1.0:1746143761.830028:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6232 00000100:00100000:1.0:1746143761.830034:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594139008:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143761.830186:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594139008:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 151us (2234us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143761.830191:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6232 00002000:00100000:1.0:1746143761.830196:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2617344->2621439) req@ffff88008efae300 x1830963594139008/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.830201:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efae300 with x1830963594139008 ext(2617344->2621439) 00002000:00010000:1.0:1746143761.830204:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efae300 00000100:00100000:0.0:1746143761.839240:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.839430:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594139264 00000100:00100000:2.0:1746143761.839441:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594139264 00002000:00100000:2.0:1746143761.839478:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3117056->3121151) req@ffff88008efae680 x1830963594139264/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.839486:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efae680 with x1830963594139264 ext(3117056->3121151) 00002000:00010000:2.0:1746143761.839490:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efae680 00000100:00100000:2.0:1746143761.839507:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6233 00000100:00100000:2.0:1746143761.839514:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594139264:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.839652:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594139264:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 137us (419us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.839658:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6233 00002000:00100000:2.0:1746143761.839663:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3117056->3121151) req@ffff88008efae680 x1830963594139264/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.839669:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efae680 with x1830963594139264 ext(3117056->3121151) 00002000:00010000:2.0:1746143761.839671:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efae680 00000100:00100000:0.0:1746143761.867489:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.867665:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594139520 00000100:00100000:1.0:1746143761.867673:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594139520 00000100:00100000:1.0:1746143761.867726:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9163 00000100:00100000:1.0:1746143761.867733:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31275:x1830963594139520:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143761.867753:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.867767:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a763c expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.867862:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.867873:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.867883:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.867893:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.867899:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.867903:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.867988:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f865 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.867997:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f865 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868002:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f865 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143761.868010:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143761.868092:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868098:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868103:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868108:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009beda600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.868111:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868117:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868127:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143761.868129:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.868132:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868170:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868216:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868230:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868234:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868239:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedaa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143761.868241:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868246:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868252:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74900) 00010000:00010000:1.0:1746143761.868254:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143761.868256:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868261:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f85e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143761.868297:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a763c expref: 260 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.868306:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f865 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a763c expref: 259 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.868316:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143761.868317:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143761.868319:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bedb000, rc 0) 00000100:00100000:1.0:1746143761.868369:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31275:x1830963594139520:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 636us (887us total) trans 8589943480 rc 0/0 00000100:00100000:1.0:1746143761.868375:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9163 00000100:00100000:0.0:1746143761.872366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.873819:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594139648 00000100:00100000:3.0:1746143761.873828:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594139648 00000100:00100000:3.0:1746143761.873990:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 725 00000100:00100000:3.0:1746143761.873998:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1963:x1830963594139648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.874068:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.874090:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f865 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a763c expref: 259 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.874673:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143761.874677:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.874732:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1963:x1830963594139648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 735us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.874738:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 725 00000100:00100000:0.0:1746143761.889093:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143761.890589:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594139776 00000100:00100000:1.0:1746143761.890600:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594139776 00000100:00100000:1.0:1746143761.890663:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13281 00000100:00100000:1.0:1746143761.890670:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594139776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143761.890687:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143761.890701:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bedb400/0xe984082ccd72f873 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7643 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143761.890726:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bedb400/0xe984082ccd72f873 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7643 expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.890736:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bedb400/0xe984082ccd72f873 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7643 expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143761.890750:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bedb400, rc 0) 00000100:00100000:1.0:1746143761.890793:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594139776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 124us (1708us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143761.890797:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13281 00000100:00100000:0.0:1746143761.903461:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.903549:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594139904 00000100:00100000:3.0:1746143761.903558:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594139904 00000100:00100000:3.0:1746143761.903646:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13282 00000100:00100000:3.0:1746143761.903653:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31278:x1830963594139904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.903669:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.903682:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a764a expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.903706:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.903712:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.903714:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143761.903717:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.903739:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.903749:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 29 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.903763:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594338944:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.904725:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.906313:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594338944:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.906338:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.906352:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1600, rc 0) 00000100:00100000:3.0:1746143761.906383:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31278:x1830963594139904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2730us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.906389:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13282 00000100:00100000:0.0:1746143761.919350:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.919450:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594140032 00000100:00100000:2.0:1746143761.919458:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594140032 00002000:00100000:2.0:1746143761.919498:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2617344->3121151) req@ffff88008efaf480 x1830963594140032/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.919507:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaf480 with x1830963594140032 ext(2617344->3121151) 00010000:00010000:2.0:1746143761.919516:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 29 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.919534:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 29 pid: 12618 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.919540:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efaf480 00000100:00100000:2.0:1746143761.919573:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1771 00000100:00100000:2.0:1746143761.919580:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594140032:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143761.935727:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594140032:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16138us (16377us total) trans 17179873080 rc 0/0 00000100:00100000:2.0:1746143761.935741:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1771 00002000:00100000:2.0:1746143761.935753:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2617344->3121151) req@ffff88008efaf480 x1830963594140032/t17179873080(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/448 e 0 to 0 dl 1746143772 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.935762:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaf480 with x1830963594140032 ext(2617344->3121151) 00010000:00010000:2.0:1746143761.935771:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 31 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:2.0:1746143761.935783:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 31 pid: 12618 timeout: 940 lvb_type: 0 00002000:00010000:2.0:1746143761.935790:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008efaf480 00000100:00100000:0.0:1746143761.940459:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.940551:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594140160 00000100:00100000:3.0:1746143761.940558:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594140160 00010000:00010000:3.0:1746143761.940589:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 31 pid: 12618 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.940623:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7100 00000100:00100000:3.0:1746143761.940629:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594140160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.940640:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.940656:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 31 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.940666:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 31 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.940689:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009beda400/0xe984082ccd72f849 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->3121151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7635 expref: 31 pid: 12618 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.943320:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.943325:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.943338:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.943349:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.943396:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 30 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.943408:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594339072:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.946092:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.949321:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.949405:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594140416 00000100:00100000:2.0:1746143761.949413:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594140416 00002000:00100000:2.0:1746143761.949452:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008efafb80 x1830963594140416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.949462:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efafb80 with x1830963594140416 ext(2097152->3145727) 00002000:00010000:2.0:1746143761.949467:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efafb80 00000100:00100000:2.0:1746143761.949496:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6234 00000100:00100000:2.0:1746143761.949503:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1963:x1830963594140416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143761.950937:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594339072:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143761.950954:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.950981:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594140160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 10351us (10527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.950990:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7100 00000100:00100000:0.0:1746143761.956097:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.956353:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594140544 00000100:00100000:3.0:1746143761.956360:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594140544 00000100:00100000:3.0:1746143761.957866:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13283 00000100:00100000:3.0:1746143761.957877:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31275:x1830963594140544:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143761.957895:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.957910:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7651 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.957934:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.957941:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.957947:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.957948:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.957951:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1294336->1880063] (req 1294336->1880063) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.957975:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.957985:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 31 pid: 12618 timeout: 940 lvb_type: 1 00000100:00100000:3.0:1746143761.957995:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339200:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.959077:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.959088:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 35 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.959102:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339328:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.959130:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143761.959547:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594140416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10043us (10232us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143761.959556:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6234 00002000:00100000:2.0:1746143761.959564:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008efafb80 x1830963594140416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:157/0 lens 488/440 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.959573:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efafb80 with x1830963594140416 ext(2097152->3145727) 00002000:00010000:2.0:1746143761.959577:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efafb80 00000100:00100000:3.0:1746143761.965064:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339200:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143761.965701:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339328:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143761.965725:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1294336->1880063] (req 1294336->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.965745:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0800, rc 0) 00000100:00100000:3.0:1746143761.965932:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31275:x1830963594140544:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8055us (9840us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.965939:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13283 00000100:00100000:0.0:1746143761.970360:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.970913:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.971041:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.971094:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594140672 00000100:00100000:2.0:1746143761.971103:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594140672 00010000:00010000:2.0:1746143761.971165:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 30 pid: 12618 timeout: 940 lvb_type: 1 00000100:00100000:2.0:1746143761.971983:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594140800 00000100:00100000:2.0:1746143761.971987:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594140800 00010000:00010000:2.0:1746143761.972014:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 35 pid: 2839 timeout: 940 lvb_type: 0 00000100:00100000:3.0:1746143761.972382:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7101 00000100:00100000:3.0:1746143761.972391:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594140672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.972403:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.972422:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 30 pid: 12618 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.972433:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 30 pid: 12618 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.972450:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8e600/0xe984082ccd72f818 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7604 expref: 30 pid: 12618 timeout: 940 lvb_type: 1 00010000:00010000:3.0:1746143761.972476:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.972513:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594140672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 124us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.972519:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7101 00000100:00100000:3.0:1746143761.972534:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7102 00000100:00100000:3.0:1746143761.972538:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594140800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143761.972544:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143761.972551:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 35 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.972559:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 35 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.972570:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a71e9a00/0xe984082ccd72f803 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75ef expref: 35 pid: 2839 timeout: 940 lvb_type: 0 00010000:00010000:3.0:1746143761.972578:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.972579:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143761.972585:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.972592:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143761.972617:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.972628:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594339456:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143761.972673:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.972689:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594140928 00000100:00100000:3.0:1746143761.972692:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594140928 00000100:00100000:3.0:1746143761.972713:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13284 00000100:00100000:3.0:1746143761.972718:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594140928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.972728:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.972736:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f888 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7658 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.972758:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339584:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143761.972777:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.975090:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594339456:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143761.975094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143761.975104:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143761.975254:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594140800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2713us (4340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143761.975262:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7102 00000100:00100000:2.0:1746143761.975637:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594141184 00000100:00100000:2.0:1746143761.975642:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594141184 00002000:00100000:2.0:1746143761.975671:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1294336->1298431) req@ffff88012fc24000 x1830963594141184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.975680:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24000 with x1830963594141184 ext(1294336->1298431) 00002000:00010000:2.0:1746143761.975683:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc24000 00000100:00100000:2.0:1746143761.975697:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6235 00000100:00100000:2.0:1746143761.975702:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963594141184:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143761.975826:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963594141184:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (733us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143761.975832:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6235 00002000:00100000:2.0:1746143761.975837:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1294336->1298431) req@ffff88012fc24000 x1830963594141184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143761.975844:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24000 with x1830963594141184 ext(1294336->1298431) 00002000:00010000:2.0:1746143761.975846:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc24000 00000100:00100000:3.0:1746143761.976307:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339584:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143761.976326:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f888 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7658 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.976336:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f888 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7658 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.976352:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1400, rc 0) 00000100:00100000:3.0:1746143761.976373:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594140928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3655us (5332us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.976379:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13284 00000100:00100000:0.0:1746143761.982475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143761.982590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.983057:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594141568 00000100:00100000:3.0:1746143761.983064:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594141568 00000100:00100000:3.0:1746143761.983119:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13285 00000100:00100000:1.0:1746143761.983179:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594141440 00000100:00100000:1.0:1746143761.983184:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594141440 00002000:00100000:1.0:1746143761.983212:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1875968->1880063) req@ffff88012fc24700 x1830963594141440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/0 e 0 to 0 dl 1746143772 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.983238:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24700 with x1830963594141440 ext(1875968->1880063) 00002000:00010000:1.0:1746143761.983245:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc24700 00000100:00100000:1.0:1746143761.983258:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6236 00000100:00100000:1.0:1746143761.983264:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963594141440:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143761.983413:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963594141440:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 148us (821us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143761.983419:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6236 00002000:00100000:1.0:1746143761.983425:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1875968->1880063) req@ffff88012fc24700 x1830963594141440/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746143772 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143761.983432:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24700 with x1830963594141440 ext(1875968->1880063) 00002000:00010000:1.0:1746143761.983434:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc24700 00000100:00100000:3.0:1746143761.983845:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594141568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.983854:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.983869:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1000/0xe984082ccd72f88f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a765f expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.983903:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339712:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143761.983940:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143761.986009:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143761.986061:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594141824 00000100:00100000:2.0:1746143761.986066:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594141824 00000100:00100000:2.0:1746143761.986094:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3926 00000100:00100000:2.0:1746143761.986099:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:31275:x1830963594141824:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143761.986107:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339712:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143761.986134:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1000/0xe984082ccd72f88f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a765f expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.986159:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1000/0xe984082ccd72f88f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a765f expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.986489:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1000, rc 0) 00000100:00100000:3.0:1746143761.986562:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594141568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3435us (4093us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.986572:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13285 00000100:00100000:2.0:1746143761.986633:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31275:x1830963594141824:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 532us (625us total) trans 8589943481 rc 0/0 00000100:00100000:2.0:1746143761.986638:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3926 00000100:00100000:0.0:1746143761.990064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143761.990128:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594141952 00000100:00100000:3.0:1746143761.990135:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594141952 00000100:00100000:3.0:1746143761.990201:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13286 00000100:00100000:3.0:1746143761.990207:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594141952:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143761.990232:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143761.990246:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1200/0xe984082ccd72f896 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7666 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143761.990289:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339840:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143761.990366:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143761.993472:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594339840:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143761.993500:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1200/0xe984082ccd72f896 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7666 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.993512:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1200/0xe984082ccd72f896 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7666 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143761.994105:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1200, rc 0) 00000100:00100000:3.0:1746143761.994171:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594141952:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3963us (4118us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143761.994179:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13286 00000100:00100000:0.0:1746143762.008672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.009589:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594142208 00000100:00100000:1.0:1746143762.009597:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594142208 00000100:00100000:1.0:1746143762.009770:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9164 00000100:00100000:1.0:1746143762.009779:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31283:x1830963594142208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.009798:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.009812:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb600/0xe984082ccd72f89d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a766d expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.009906:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00000100:00080000:3.0:1746143762.009912:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746143762.009916:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.009926:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.009937:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.009947:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.009952:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010040:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f8b2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010048:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010053:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143762.010061:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143762.010132:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010155:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010160:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010165:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedb200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143762.010168:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010174:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010184:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143762.010186:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143762.010190:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010194:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb200/0xe984082ccd72f8a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010212:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010230:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010235:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010239:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009beda400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143762.010241:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010244:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010250:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74100) 00010000:00010000:1.0:1746143762.010252:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143762.010254:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010257:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f8ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.010292:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb600/0xe984082ccd72f89d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a766d expref: 262 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.010302:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a766d expref: 261 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.010307:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.010309:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143762.010311:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bedb400, rc 0) 00000100:00100000:1.0:1746143762.010364:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:31283:x1830963594142208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 587us (1700us total) trans 8589943482 rc 0/0 00000100:00100000:1.0:1746143762.010370:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9164 00000100:00100000:0.0:1746143762.011279:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.011375:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594142336 00000100:00100000:1.0:1746143762.011380:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594142336 00000100:00100000:1.0:1746143762.011425:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9165 00000100:00100000:1.0:1746143762.011429:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31284:x1830963594142336:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143762.011440:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.011449:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda200/0xe984082ccd72f8c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7674 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143762.011513:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746143762.011561:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011569:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011575:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011586:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011590:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011595:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011654:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011663:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 22 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.011668:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.011689:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 22 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.011698:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 22 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.011707:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093807800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594339968:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.011771:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.012005:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.012075:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594142464 00000100:00100000:3.0:1746143762.012079:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594142464 00000100:00100000:3.0:1746143762.012162:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 726 00000100:00100000:3.0:1746143762.012169:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:1963:x1830963594142464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.012176:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.012185:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f8b2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a766d expref: 261 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.012202:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143762.012205:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143762.012211:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143762.012215:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143762.012230:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.012251:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1963:x1830963594142464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.012260:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 726 00000100:00100000:1.0:1746143762.013463:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093807800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594339968:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143762.013478:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143762.014018:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.014092:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594142592 00000100:00100000:3.0:1746143762.014097:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594142592 00000100:00100000:3.0:1746143762.014159:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13287 00000100:00100000:3.0:1746143762.014165:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594142592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.014177:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.014187:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a767b expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.014206:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.014208:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.014215:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 35 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.014238:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 35 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.014246:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0e00, rc 0) 00000100:00100000:3.0:1746143762.014282:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594142592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 117us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.014287:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13287 00000100:00080000:0.0:1746143762.014705:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143762.014894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.014966:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594142848 00000100:00100000:2.0:1746143762.014969:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594142848 00000100:00080000:0.0:1746143762.014994:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143762.015016:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3927 00000100:00100000:2.0:1746143762.015021:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:7695:x1830963594142848:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143762.015328:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:7695:x1830963594142848:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 306us (433us total) trans 8589943483 rc 0/0 00000100:00100000:2.0:1746143762.015334:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3927 00000100:00100000:1.0:1746143762.017126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.017228:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594142976 00000100:00100000:2.0:1746143762.017234:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594142976 00010000:00010000:2.0:1746143762.017258:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 24 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.017376:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7103 00000100:00100000:2.0:1746143762.017383:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594142976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.017394:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.017398:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 24 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.017408:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 24 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.017426:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f683e00/0xe984082ccd72f7a1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a75cc expref: 24 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.017439:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.017443:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.017451:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.017457:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.017836:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.017875:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594142976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 492us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.017881:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7103 00010000:00010000:1.0:1746143762.018182:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018188:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143762.018234:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143762.018239:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143762.018252:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018261:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018269:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018273:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018278:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018282:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedb000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143762.018285:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018290:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018298:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143762.018300:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143762.018303:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018307:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb000/0xe984082ccd72f8c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018315:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018319:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018323:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018326:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedae00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143762.018327:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018331:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018335:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74f00) 00010000:00010000:1.0:1746143762.018337:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143762.018338:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018342:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f8ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.018369:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda200/0xe984082ccd72f8c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.018379:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.018385:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.018387:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143762.018388:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bedaa00, rc 0) 00000100:00100000:1.0:1746143762.018411:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31284:x1830963594142336:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 6981us (7133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.018416:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9165 00000100:00100000:1.0:1746143762.019838:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.019923:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594143232 00000100:00100000:2.0:1746143762.019928:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594143232 00002000:00100000:2.0:1746143762.019960:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093805180 x1830963594143232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 504/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.019968:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805180 with x1830963594143232 ext(1048576->2097151) 00002000:00010000:2.0:1746143762.019972:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805180 00000100:00100000:2.0:1746143762.019986:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6237 00000100:00100000:2.0:1746143762.019992:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594143232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.021272:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.021305:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.021322:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594143360 00000100:00100000:2.0:1746143762.021322:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594143616 00000100:00100000:3.0:1746143762.021326:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594143360 00000100:00100000:2.0:1746143762.021326:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594143616 00000100:00100000:2.0:1746143762.021366:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13288 00000100:00100000:2.0:1746143762.021379:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594143616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143762.021472:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.021487:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7690 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.021504:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.021506:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.021514:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.021528:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 10 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.021537:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f5aa00, rc 0) 00000100:00100000:2.0:1746143762.021565:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594143616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 186us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.021571:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13288 00000100:00100000:2.0:1746143762.021599:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.021610:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594143488 00000100:00100000:2.0:1746143762.021612:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594143488 00000100:00100000:2.0:1746143762.021625:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13289 00000100:00100000:2.0:1746143762.021630:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594143488:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143762.021635:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.021641:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7689 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.021649:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.021651:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.021655:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.021662:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 11 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.021668:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f5ac00, rc 0) 00000100:00100000:2.0:1746143762.021681:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594143488:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 52us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.021686:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13289 00000100:00100000:2.0:1746143762.021730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.021743:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594143744 00000100:00100000:2.0:1746143762.021746:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594143744 00000100:00100000:2.0:1746143762.021760:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13290 00000100:00100000:2.0:1746143762.021765:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594143744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143762.021771:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.021780:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7697 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.021791:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.021792:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.021798:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.021807:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 11 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.021814:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f5b000, rc 0) 00000100:00100000:2.0:1746143762.021829:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594143744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 64us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.021834:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13290 00000100:00100000:3.0:1746143762.021884:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13291 00000100:00100000:3.0:1746143762.021889:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594143360:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143762.021895:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.021902:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1a00/0xe984082ccd72f8f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7682 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.021934:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594340096:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.021980:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971180 going to sleep for 11 seconds 00000100:00080000:1.0:1746143762.022088:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143762.022092:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143762.024464:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594143232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4466us (4625us total) trans 0 rc 462848/462848 00000100:00100000:2.0:1746143762.024472:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6237 00002000:00100000:2.0:1746143762.024481:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093805180 x1830963594143232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 504/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 462848/462848 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143762.024489:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594340096:192.168.202.48@tcp:106: 00002000:00100000:2.0:1746143762.024489:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805180 with x1830963594143232 ext(1048576->2097151) 00002000:00010000:2.0:1746143762.024493:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805180 00010000:00010000:3.0:1746143762.024514:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1a00/0xe984082ccd72f8f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7682 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.024529:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1a00/0xe984082ccd72f8f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7682 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.024553:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1a00, rc 0) 00000100:00100000:3.0:1746143762.024572:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594143360:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2683us (3304us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143762.024578:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13291 00000100:00100000:0.0:1746143762.027063:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.027128:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594144000 00000100:00100000:1.0:1746143762.027135:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594144000 00000100:00100000:1.0:1746143762.027460:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9166 00000100:00100000:1.0:1746143762.027468:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31284:x1830963594144000:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143762.027483:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.027497:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedac00/0xe984082ccd72f8ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a769e expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.027576:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.027588:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.027594:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.027618:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.027632:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 10 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.027642:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594340224:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.027713:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.029974:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594340224:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143762.029996:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143762.031280:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.031540:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594144128 00000100:00100000:2.0:1746143762.031547:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594144128 00010000:00010000:2.0:1746143762.031579:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.031614:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7104 00000100:00100000:2.0:1746143762.031620:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594144128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.031631:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.031636:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.031645:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.031662:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f8d5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7674 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.031690:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.031695:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.031703:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.031709:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.031733:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.031767:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594144128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 147us (491us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143762.031768:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143762.031773:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7104 00010000:00010000:1.0:1746143762.031774:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143762.031791:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143762.031906:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedac00/0xe984082ccd72f8ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.031920:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.031926:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.031929:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143762.031930:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beda800, rc 0) 00000100:00100000:1.0:1746143762.031954:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31284:x1830963594144000:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4487us (4898us total) trans 8589943484 rc 0/0 00000100:00100000:1.0:1746143762.031963:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9166 00000100:00100000:0.0:1746143762.034664:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.034747:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594144256 00000100:00100000:1.0:1746143762.034753:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594144256 00000100:00100000:1.0:1746143762.034798:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9167 00000100:00100000:1.0:1746143762.034804:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31284:x1830963594144256:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143762.034824:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.034838:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f914 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76a5 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.034902:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.034913:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.034919:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.034941:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.034949:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.034959:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594340352:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.035030:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.037402:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.037496:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594340352:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143762.037518:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143762.037654:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594144384 00000100:00100000:2.0:1746143762.037659:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594144384 00010000:00010000:2.0:1746143762.037681:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 12 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.037875:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7105 00000100:00100000:2.0:1746143762.037882:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594144384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.037893:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.037898:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 12 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.037908:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 12 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.037925:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f906 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a769e expref: 12 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.038115:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.038119:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.038127:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.038133:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.038174:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.038205:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594144384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 323us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.038210:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7105 00010000:00010000:0.0:1746143762.038396:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.038402:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143762.038439:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:0.0:1746143762.038443:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746143762.038456:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.038480:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda400/0xe984082ccd72f914 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.038495:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.038501:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143762.038503:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143762.038505:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bedb400, rc 0) 00000100:00100000:0.0:1746143762.038531:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31284:x1830963594144256:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3727us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.038537:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9167 00000100:00100000:0.0:1746143762.039993:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.040033:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.040569:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594144640 00000100:00100000:2.0:1746143762.040577:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594144640 00002000:00100000:2.0:1746143762.040615:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012fc26d80 x1830963594144640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.040624:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc26d80 with x1830963594144640 ext(2097152->3145727) 00002000:00010000:2.0:1746143762.040629:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc26d80 00000100:00100000:1.0:1746143762.040632:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594144896 00000100:00100000:1.0:1746143762.040636:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594144896 00000100:00100000:2.0:1746143762.040646:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6238 00002000:00100000:1.0:1746143762.040649:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012fc27100 x1830963594144896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143762.040652:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594144640:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143762.040656:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc27100 with x1830963594144896 ext(3145728->4194303) 00002000:00010000:1.0:1746143762.040658:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc27100 00000100:00100000:1.0:1746143762.040682:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6239 00000100:00100000:1.0:1746143762.040687:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594144896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143762.042829:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.042935:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594145024 00000100:00100000:3.0:1746143762.042940:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594145024 00000100:00100000:3.0:1746143762.043015:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13292 00000100:00100000:3.0:1746143762.044980:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594145024:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143762.044999:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.045014:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f922 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76ac expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.045060:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594340480:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.045122:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130971180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.053126:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594340480:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143762.053178:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f922 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ac expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.053190:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72f922 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ac expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.053207:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0600, rc 0) 00000100:00100000:3.0:1746143762.053822:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594145024:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 10798us (10995us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143762.053830:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13292 00000100:00100000:3.0:1746143762.055056:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594144640:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14400us (15065us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.055064:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6238 00002000:00100000:3.0:1746143762.055073:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012fc26d80 x1830963594144640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.055082:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc26d80 with x1830963594144640 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.055086:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc26d80 00000100:00100000:1.0:1746143762.057731:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594144896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17035us (17689us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143762.057740:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6239 00002000:00100000:1.0:1746143762.057749:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012fc27100 x1830963594144896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.057757:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc27100 with x1830963594144896 ext(3145728->4194303) 00002000:00010000:1.0:1746143762.057762:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc27100 00000100:00100000:0.0:1746143762.057989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.058277:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594145280 00000100:00100000:1.0:1746143762.058283:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594145280 00000100:00100000:1.0:1746143762.058323:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9168 00000100:00100000:1.0:1746143762.058329:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31284:x1830963594145280:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143762.058342:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.058357:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f929 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76b3 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.058432:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.058445:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.058455:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143762.058465:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143762.058560:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda800/0xe984082ccd72f929 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.058577:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.058585:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.058588:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143762.058591:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beda600, rc 0) 00000100:00100000:1.0:1746143762.058627:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31284:x1830963594145280:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 298us (639us total) trans 8589943485 rc 0/0 00000100:00100000:1.0:1746143762.058633:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9168 00000100:00100000:0.0:1746143762.061840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.062471:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.062504:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.062518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.062530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.062776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.062974:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594145536 00000100:00100000:2.0:1746143762.062982:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594145536 00000100:00100000:2.0:1746143762.063020:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594145792 00000100:00100000:2.0:1746143762.063022:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594145792 00000100:00100000:2.0:1746143762.063033:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594146048 00000100:00100000:2.0:1746143762.063034:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594146048 00000100:00100000:2.0:1746143762.063042:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594145408 00000100:00100000:2.0:1746143762.063043:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594145408 00000100:00100000:2.0:1746143762.063052:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594145664 00000100:00100000:2.0:1746143762.063053:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594145664 00000100:00100000:2.0:1746143762.063060:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594145920 00000100:00100000:2.0:1746143762.063062:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594145920 00000100:00100000:2.0:1746143762.063073:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13293 00000100:00100000:2.0:1746143762.063080:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594145536:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143762.063116:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063130:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063151:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063158:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 34 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063164:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.063166:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.063168:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063195:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 34 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063206:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 34 pid: 15784 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063230:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594340608:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063295:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 12 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063303:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 12 pid: 9527 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063310:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594340736:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063333:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063345:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 28 pid: 15784 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063352:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594340864:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.063367:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.063384:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13294 00000100:00100000:2.0:1746143762.063390:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1962:x1830963594145792:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143762.063419:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063429:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063435:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063441:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 24 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063446:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.063447:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.063449:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063466:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 24 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063473:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 24 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.063482:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594340992:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063508:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063515:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 13 pid: 8495 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063521:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594341120:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063542:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 29 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063549:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 29 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.063555:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594341248:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.063569:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.063585:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13295 00000100:00100000:2.0:1746143762.063591:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594146048:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143762.063607:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063621:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 28 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063627:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063634:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 34 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063639:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063645:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.063646:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.063648:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 7/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063662:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063669:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 28 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.063676:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341376:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063700:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 34 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063708:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 34 pid: 2839 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063715:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341504:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063734:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 12 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063741:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 12 pid: 12618 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063747:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341632:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063763:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 28 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063769:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 28 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.063775:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341760:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.063786:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.063801:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13296 00000100:00100000:2.0:1746143762.063807:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1962:x1830963594145408:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143762.063827:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063839:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063846:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063852:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 24 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063857:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.063858:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.063860:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063875:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 24 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063881:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 24 pid: 2839 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063888:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594341888:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063909:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.063916:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 13 pid: 4581 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.063927:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594342016:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.063944:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 29 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.063951:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 29 pid: 15784 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.063958:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594342144:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.063969:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.063983:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13297 00000100:00100000:2.0:1746143762.063988:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594145664:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143762.064001:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.064010:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.064015:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.064017:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.064018:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.064032:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.064044:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.064051:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594342272:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.064065:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.064335:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13298 00000100:00100000:0.0:1746143762.064342:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1962:x1830963594145920:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143762.064357:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064366:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064373:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.064379:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064385:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064389:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143762.064390:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143762.064392:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 7/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064405:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064412:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 24 pid: 8495 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.064419:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342400:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143762.064458:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 24 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064469:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 24 pid: 8495 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.064477:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342528:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143762.064499:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.064505:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 13 pid: 12618 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.064512:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342656:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143762.064530:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.064538:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 29 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.064544:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342784:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143762.064557:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.066383:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.066454:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594146304 00000100:00100000:2.0:1746143762.066461:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594146304 00000100:00100000:2.0:1746143762.066747:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9169 00000100:00100000:2.0:1746143762.066754:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31286:x1830963594146304:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143762.066772:0:21713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.066786:0:21713:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3800/0xe984082ccd72f968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76ba expref: -99 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.066867:0:21713:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143762.066879:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.066886:0:21713:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.066891:0:21713:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143762.066912:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.066925:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.066934:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594342912:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.068005:0:21713:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.068015:0:21713:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.068024:0:21713:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594343040:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.068347:0:21713:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.071522:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.071820:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594146432 00000100:00100000:3.0:1746143762.071827:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594146432 00010000:00010000:3.0:1746143762.071982:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 13 pid: 12618 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.072006:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7106 00000100:00100000:3.0:1746143762.072012:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963594146432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.072021:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.072039:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 13 pid: 12618 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143762.072048:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 13 pid: 12618 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143762.072072:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.072118:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963594146432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 107us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.072124:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7106 00000100:00100000:3.0:1746143762.072190:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594341888:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.072205:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594340992:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.072212:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594341120:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.072235:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594341248:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.072257:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.072333:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341376:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.072342:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341504:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.072350:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f5b000/0xe984082ccd72f8f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7697 expref: 12 pid: 12618 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.072365:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341632:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.072372:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594341760:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.072387:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.072413:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594340608:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.072420:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594340736:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.072435:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594340864:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.072450:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.072582:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594342272:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.072592:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143762.072710:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342400:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143762.072719:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342528:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143762.072726:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342656:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143762.072731:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594342784:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143762.072744:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.072894:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594342016:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.072900:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594342144:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.072913:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143762.074341:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.074379:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.074398:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147328 00000100:00100000:2.0:1746143762.074404:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147328 00000100:00100000:0.0:1746143762.074404:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.074415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.074425:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.074435:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.074451:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:1.0:1746143762.074687:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143762.074690:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.074742:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147712 00000100:00100000:3.0:1746143762.074747:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147712 00010000:00010000:2.0:1746143762.074760:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 29 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.074770:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147968 00000100:00100000:3.0:1746143762.074772:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147968 00000100:00100000:2.0:1746143762.074775:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147072 00000100:00100000:2.0:1746143762.074777:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147072 00000100:00100000:3.0:1746143762.074779:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148224 00000100:00100000:3.0:1746143762.074780:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148224 00000100:00100000:3.0:1746143762.074786:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147840 00010000:00010000:2.0:1746143762.074786:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 25 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.074787:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147840 00000100:00100000:3.0:1746143762.074793:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148096 00000100:00100000:3.0:1746143762.074795:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148096 00000100:00100000:2.0:1746143762.074797:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147456 00000100:00100000:2.0:1746143762.074798:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147456 00000100:00100000:3.0:1746143762.074803:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13299 00010000:00010000:2.0:1746143762.074806:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 14 pid: 4581 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.074809:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594147712:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143762.074816:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7107 00000100:00100000:2.0:1746143762.074820:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594147328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.074821:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.074832:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f976 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76c1 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.074833:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.074845:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.074849:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 29 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.074853:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f976 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76c1 expref: 33 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.074857:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 29 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.074861:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1e00/0xe984082ccd72f976 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76c1 expref: 33 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.074870:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa8f400/0xe984082ccd72f834 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7620 expref: 29 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.074873:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1e00, rc 0) 00010000:00010000:2.0:1746143762.074879:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.074903:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594147712:12345-192.168.202.48@tcp:101:cat.0 Request processed in 93us (523us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.074903:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594147328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.074908:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13299 00000100:00100000:2.0:1746143762.074908:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7107 00000100:00100000:3.0:1746143762.074920:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13300 00000100:00100000:2.0:1746143762.074920:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7108 00000100:00100000:3.0:1746143762.074924:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594147968:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143762.074924:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594147072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.074929:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.074931:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.074934:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f97d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76cf expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.074941:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.074941:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 25 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.074945:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f97d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76cf expref: 32 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.074949:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 25 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.074959:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1200/0xe984082ccd72f97d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 8 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76cf expref: 32 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.074959:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72f82d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7619 expref: 25 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.074966:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1200, rc 0) 00010000:00010000:2.0:1746143762.074970:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.074978:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594147968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (573us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.074980:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594147072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.074982:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13300 00000100:00100000:2.0:1746143762.074984:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7108 00000100:00100000:3.0:1746143762.074989:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13301 00000100:00100000:2.0:1746143762.074991:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7109 00000100:00100000:3.0:1746143762.074993:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963594148224:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143762.074994:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1963:x1830963594147456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.074999:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.074999:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.075003:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1000/0xe984082ccd72f984 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76dd expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.075007:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 14 pid: 4581 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143762.075011:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.075013:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 14 pid: 4581 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143762.075015:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1000/0xe984082ccd72f984 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76dd expref: 37 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.075022:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1000/0xe984082ccd72f984 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76dd expref: 37 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.075022:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed3d400/0xe984082ccd72f666 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c9 expref: 14 pid: 4581 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143762.075028:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1000, rc 0) 00010000:00010000:2.0:1746143762.075029:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.075039:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963594148224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 45us (623us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.075039:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963594147456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 44us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.075043:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13301 00000100:00100000:2.0:1746143762.075043:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7109 00000100:00100000:3.0:1746143762.075051:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13302 00000100:00100000:3.0:1746143762.075055:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963594147840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.075059:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.075064:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f98b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76c8 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.075072:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.075076:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f98b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76c8 expref: 36 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.075083:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1400/0xe984082ccd72f98b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76c8 expref: 36 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.075089:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1400, rc 0) 00000100:00100000:2.0:1746143762.075098:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594342912:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.075100:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1963:x1830963594147840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 45us (652us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143762.075104:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13302 00000100:00100000:3.0:1746143762.075111:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13303 00000100:00100000:3.0:1746143762.075116:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594148096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.075120:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.075125:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f992 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76d6 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.075133:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.075136:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f992 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76d6 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.075167:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f992 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76d6 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.075173:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0400, rc 0) 00000100:00100000:2.0:1746143762.075182:0:21713:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21713:1830963594343040:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.075186:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594148096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 70us (496us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143762.075190:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13303 00010000:00010000:2.0:1746143762.075196:0:21713:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00080000:2.0:1746143762.076407:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143762.077167:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077248:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077272:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077282:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077306:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594146688 00000100:00100000:0.0:1746143762.077310:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594146688 00010000:00010000:0.0:1746143762.077331:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 35 pid: 15784 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.077345:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594146944 00000100:00100000:0.0:1746143762.077347:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594146944 00010000:00010000:0.0:1746143762.077356:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 13 pid: 8495 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.077363:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147584 00000100:00100000:0.0:1746143762.077364:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147584 00010000:00010000:0.0:1746143762.077371:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 30 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.077378:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148736 00000100:00100000:0.0:1746143762.077379:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148736 00010000:00010000:0.0:1746143762.077386:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 14 pid: 12618 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.077392:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594146560 00000100:00100000:0.0:1746143762.077394:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594146560 00010000:00010000:0.0:1746143762.077401:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 12 pid: 9527 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.077409:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594146816 00000100:00100000:0.0:1746143762.077410:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594146816 00010000:00010000:0.0:1746143762.077417:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 28 pid: 15784 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.077427:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7110 00000100:00100000:0.0:1746143762.077431:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594146688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.077440:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.077455:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 35 pid: 15784 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077468:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 35 pid: 15784 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077482:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf80400/0xe984082ccd72f43d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73bf expref: 35 pid: 15784 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077497:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.077520:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594146688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 89us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.077526:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7110 00000100:00100000:0.0:1746143762.077537:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7111 00000100:00100000:0.0:1746143762.077541:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594146944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.077546:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.077554:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 14 pid: 8495 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077560:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 14 pid: 8495 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077570:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f5ac00/0xe984082ccd72f8ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7689 expref: 14 pid: 8495 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077577:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.077587:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594146944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.077594:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7111 00000100:00100000:0.0:1746143762.077621:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7112 00000100:00100000:0.0:1746143762.077624:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594147584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.077628:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.077633:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 30 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.077640:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 30 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.077649:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f826 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7612 expref: 30 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.077655:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.077657:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.077660:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.077667:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.077681:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.077693:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594147584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.077697:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7112 00000100:00100000:0.0:1746143762.077704:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7113 00000100:00100000:0.0:1746143762.077708:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594148736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.077712:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.077719:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 12 pid: 12618 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077725:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 12 pid: 12618 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077733:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f5aa00/0xe984082ccd72f8e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7690 expref: 12 pid: 12618 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077740:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.077750:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594148736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.077754:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7113 00000100:00100000:0.0:1746143762.077761:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7114 00000100:00100000:0.0:1746143762.077764:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594146560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.077768:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.077773:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 12 pid: 9527 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077779:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 12 pid: 9527 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077787:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed3da00/0xe984082ccd72f67b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74d0 expref: 12 pid: 9527 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077798:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.077808:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594146560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 43us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.077812:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7114 00000100:00100000:0.0:1746143762.077819:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7115 00000100:00100000:0.0:1746143762.077822:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594146816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.077826:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.077831:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 28 pid: 15784 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077837:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 28 pid: 15784 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077845:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f192600/0xe984082ccd72f3db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7372 expref: 28 pid: 15784 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.077850:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.077851:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.077854:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.077859:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.077869:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.077880:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594146816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 57us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.077884:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7115 00000100:00100000:0.0:1746143762.077910:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.077921:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594147200 00000100:00100000:0.0:1746143762.077923:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594147200 00010000:00010000:0.0:1746143762.077932:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 27 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.077942:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7116 00000100:00100000:0.0:1746143762.077946:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594147200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.077950:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.077958:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 27 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.077965:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 27 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.077974:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f1600/0xe984082ccd72f87a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a764a expref: 27 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.077982:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.077995:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594147200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.078000:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7116 00010000:00010000:2.0:1746143762.078165:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078172:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078190:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078196:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078203:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078209:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f5be00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143762.078212:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078228:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078237:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.078242:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f5be00/0xe984082ccd72f93e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.078316:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148480 00000100:00100000:1.0:1746143762.078320:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148480 00002000:00100000:1.0:1746143762.078343:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1294336->1880063) req@ffff8800a0816a00 x1830963594148480/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.078355:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816a00 with x1830963594148480 ext(1294336->1880063) 00010000:00010000:1.0:1746143762.078360:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.078367:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 34 pid: 2839 timeout: 941 lvb_type: 0 00002000:00010000:1.0:1746143762.078372:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0816a00 00000100:00100000:1.0:1746143762.078384:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1772 00000100:00100000:1.0:1746143762.078389:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594148480:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:3.0:1746143762.078699:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078707:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078720:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078726:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078732:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078736:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090cec000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143762.078738:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078744:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078757:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.078762:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090cec000/0xe984082ccd72f945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.079053:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594145536:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 15973us (17219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.079060:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13293 00000100:00100000:0.0:1746143762.079394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.079425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.079446:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.079463:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.079483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.079494:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148352 00000100:00100000:0.0:1746143762.079497:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148352 00010000:00010000:0.0:1746143762.079510:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 29 pid: 15784 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.079520:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148608 00000100:00100000:0.0:1746143762.079522:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148608 00010000:00010000:0.0:1746143762.079529:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 24 pid: 2839 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.079535:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149120 00000100:00100000:3.0:1746143762.079536:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594145792:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 16147us (17066us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.079537:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149120 00000100:00100000:3.0:1746143762.079542:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13294 00010000:00010000:0.0:1746143762.079544:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 35 pid: 2839 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.079550:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148992 00000100:00100000:0.0:1746143762.079552:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148992 00000100:00100000:3.0:1746143762.079557:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594148864 00000100:00100000:3.0:1746143762.079559:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594148864 00010000:00010000:0.0:1746143762.079560:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 12 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.079568:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 13 pid: 16090 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.079568:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7117 00000100:00100000:0.0:1746143762.079572:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594148352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143762.079576:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7118 00010000:00010000:0.0:1746143762.079578:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143762.079580:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594148608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.079585:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.079586:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 29 pid: 15784 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.079589:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 24 pid: 2839 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143762.079596:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 24 pid: 2839 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.079608:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 29 pid: 15784 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.079619:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095728000/0xe984082ccd72f4d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a741a expref: 29 pid: 15784 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.079629:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.079643:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594148352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.079647:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7117 00000100:00100000:2.0:1746143762.079651:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7119 00000100:00100000:0.0:1746143762.079656:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7120 00000100:00100000:2.0:1746143762.079657:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594149120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143762.079660:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963594148992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.079663:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.079665:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.079669:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 13 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079672:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 35 pid: 2839 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.079676:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 13 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079679:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 35 pid: 2839 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.079685:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f91b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76a5 expref: 13 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079687:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f8dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a767b expref: 35 pid: 2839 timeout: 941 lvb_type: 1 00010000:00010000:0.0:1746143762.079694:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.079695:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.079696:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.079698:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143762.079699:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.079705:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079707:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:0.0:1746143762.079711:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143762.079718:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.079722:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963594148992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 62us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.079727:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7120 00000100:00100000:2.0:1746143762.079728:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594149120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.079734:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7119 00000100:00100000:0.0:1746143762.079737:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7121 00000100:00100000:0.0:1746143762.079740:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594148864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.079746:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.079749:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079750:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079755:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079756:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079764:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beda600/0xe984082ccd72f930 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76b3 expref: 11 pid: 16090 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079767:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079770:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.079773:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079773:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143762.079778:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079778:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143762.079783:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090cece00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143762.079783:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143762.079786:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.079791:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079797:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143762.079798:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.079802:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090cece00/0xe984082ccd72f94c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143762.079807:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594148864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.079812:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7121 00000100:00100000:2.0:1746143762.079823:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594146048:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 16233us (17319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.079827:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13295 00000100:00100000:0.0:1746143762.079838:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143762.079843:0:21713:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00010000:00010000:2.0:1746143762.079848:0:21713:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21713 initiator: MDT0 00000100:00100000:0.0:1746143762.079850:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.079857:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149248 00000100:00100000:0.0:1746143762.079859:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149248 00000004:00200000:2.0:1746143762.079862:0:21713:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143762.079866:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 25 pid: 8495 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.079875:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149376 00000100:00100000:0.0:1746143762.079877:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149376 00010000:00010000:0.0:1746143762.079883:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 28 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:0.0:1746143762.079891:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7122 00000100:00100000:0.0:1746143762.079894:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594149248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.079899:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143762.079906:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 25 pid: 8495 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.079912:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 25 pid: 8495 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.079922:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009106f400/0xe984082ccd72f715 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7563 expref: 25 pid: 8495 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.079934:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.079943:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594149248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.079947:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7122 00000100:00100000:0.0:1746143762.079954:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7123 00000100:00100000:0.0:1746143762.079958:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594149376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143762.079963:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.079966:0:21713:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3800/0xe984082ccd72f968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 26 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.079968:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 28 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.079974:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 28 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079977:0:21713:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 25 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.079983:0:21713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143762.079983:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72f731 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a757f expref: 28 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.079985:0:21713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143762.079987:0:21713:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bea3a00, rc 0) 00010000:00010000:0.0:1746143762.079989:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.079996:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594149376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.079997:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31286:x1830963594146304:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 13245us (13621us total) trans 8589943486 rc 0/0 00000100:00100000:0.0:1746143762.080000:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7123 00000100:00100000:2.0:1746143762.080003:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9169 00000100:00100000:0.0:1746143762.080037:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143762.080048:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b51ad400/0xe984082ccd72f501 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7428 expref: 23 pid: 2839 timeout: 941 lvb_type: 1 00010000:00010000:3.0:1746143762.080061:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.080062:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.080065:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080071:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080084:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.080095:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594148608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 514us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.080100:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7118 00010000:00010000:3.0:1746143762.080127:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080133:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080158:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080165:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080170:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080179:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bea2000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143762.080182:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080187:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080194:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080200:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bea2000/0xe984082ccd72f953 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.080234:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594145408:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 16427us (17714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.080239:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13296 00000100:00100000:3.0:1746143762.080250:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149504 00000100:00100000:3.0:1746143762.080252:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149504 00000100:00100000:3.0:1746143762.080265:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13304 00000100:00100000:3.0:1746143762.080269:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31283:x1830963594149504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.080277:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.080285:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76e4 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080295:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.080297:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080302:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143762.080305:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4755455] (req 4194304->4755455) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080313:0:4582:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080320:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4755455] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.080327:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1a00, rc 0) 00000100:00100000:3.0:1746143762.080337:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31283:x1830963594149504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 68us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.080342:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13304 00000100:00100000:2.0:1746143762.084815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.085100:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149632 00000100:00100000:3.0:1746143762.085107:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149632 00010000:00010000:3.0:1746143762.085137:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 22 pid: 8495 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.085190:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7124 00000100:00100000:3.0:1746143762.085198:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594149632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.085209:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.085235:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 22 pid: 8495 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.085250:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 22 pid: 8495 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.085268:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f22400/0xe984082ccd72f746 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7594 expref: 22 pid: 8495 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.085279:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.085281:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.085284:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.085292:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.085317:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.085363:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594149632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 165us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.085369:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7124 00010000:00010000:0.0:1746143762.086043:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086051:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086072:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086078:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086084:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086089:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2bea00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143762.086091:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086097:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086105:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.086106:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.086112:0:9527:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086118:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.086698:0:9527:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143762.086715:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594343168:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143762.089971:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.093970:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594148480:12345-192.168.202.48@tcp:4:cat.0 Request processed in 15566us (16706us total) trans 17179873081 rc 0/0 00000100:00100000:1.0:1746143762.093982:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1772 00002000:00100000:1.0:1746143762.093996:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1294336->1880063) req@ffff8800a0816a00 x1830963594148480/t17179873081(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.094005:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816a00 with x1830963594148480 ext(1294336->1880063) 00010000:00010000:1.0:1746143762.094015:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.094029:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00002000:00010000:1.0:1746143762.094036:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0816a00 00000100:00100000:1.0:1746143762.094588:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594343168:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143762.094606:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.094614:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bea00/0xe984082ccd72f961 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.094885:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594145920:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 30544us (32109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.094893:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13298 00000100:00100000:0.0:1746143762.097923:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.098262:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594149888 00000100:00100000:2.0:1746143762.098270:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594149888 00002000:00100000:2.0:1746143762.098307:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88012fc25880 x1830963594149888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.098322:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25880 with x1830963594149888 ext(4194304->4755455) 00002000:00010000:2.0:1746143762.098326:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc25880 00000100:00100000:2.0:1746143762.098343:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6240 00000100:00100000:2.0:1746143762.098349:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963594149888:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.099966:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.100074:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594150016 00000100:00100000:3.0:1746143762.100080:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594150016 00010000:00010000:3.0:1746143762.100112:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.100137:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7125 00000100:00100000:3.0:1746143762.100159:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594150016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.100169:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.100186:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.100197:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.100223:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72f881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1880063) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7651 expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.100235:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.100236:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.100240:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.100247:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.100266:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143762.100288:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594150016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.100294:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7125 00010000:00010000:2.0:1746143762.100943:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.100951:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.100973:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.100980:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.100986:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.100992:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bea2e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143762.100996:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.101003:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.101019:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.101024:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bea2e00/0xe984082ccd72f95a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.102308:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594145664:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 38315us (39771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.102315:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13297 00000100:00100000:0.0:1746143762.113482:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.113504:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594150272 00000100:00100000:2.0:1746143762.113512:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594150272 00000100:00100000:2.0:1746143762.113929:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9170 00000100:00100000:2.0:1746143762.113938:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31284:x1830963594150272:12345-192.168.202.48@tcp:36:lfs.0 00000100:00100000:2.0:1746143762.114031:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31284:x1830963594150272:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 94us (555us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746143762.114037:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9170 00000100:00100000:2.0:1746143762.114313:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963594149888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15961us (16398us total) trans 0 rc 561152/561152 00000100:00100000:2.0:1746143762.114321:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6240 00002000:00100000:2.0:1746143762.114331:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff88012fc25880 x1830963594149888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.114339:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25880 with x1830963594149888 ext(4194304->4755455) 00002000:00010000:2.0:1746143762.114344:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc25880 00000100:00100000:0.0:1746143762.120277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.120544:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594150528 00000100:00100000:2.0:1746143762.120552:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594150528 00000100:00100000:0.0:1746143762.120569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.120596:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3928 00000100:00100000:0.0:1746143762.120598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.120604:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c630050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31284:x1830963594150528:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:0.0:1746143762.120609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.120620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.120683:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.120736:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594150656 00000100:00100000:3.0:1746143762.120740:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594150656 00000100:00100000:3.0:1746143762.120765:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594150784 00000100:00100000:3.0:1746143762.120767:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594150784 00000100:00100000:3.0:1746143762.120776:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594151040 00000100:00100000:2.0:1746143762.120776:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c630050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31284:x1830963594150528:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 172us (506us total) trans 8589943487 rc 0/0 00000100:00100000:3.0:1746143762.120778:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594151040 00000100:00100000:2.0:1746143762.120782:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3928 00000100:00100000:3.0:1746143762.120785:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594150912 00000100:00100000:3.0:1746143762.120786:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594150912 00000100:00100000:3.0:1746143762.120792:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594151168 00000100:00100000:3.0:1746143762.120794:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594151168 00000100:00100000:3.0:1746143762.120803:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13305 00000100:00100000:3.0:1746143762.120807:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963594150656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.120816:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143762.120819:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13306 00000100:00100000:2.0:1746143762.120823:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963594150784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.120828:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.120830:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76eb expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.120835:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76f2 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143762.120847:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a10, atime: 0x68140a0e, ctime: 0x68140a10, blocks: 0x7a7 00002000:00010000:2.0:1746143762.120847:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a0f, atime: 0x68140a0f, ctime: 0x68140a0f, blocks: 0x81d 00010000:00010000:3.0:1746143762.120858:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.120858:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.120860:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.120860:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.120866:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.120866:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 37 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.120877:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 30 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.120877:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 37 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.120885:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0400, rc 0) 00010000:00010000:2.0:1746143762.120885:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2c000, rc 0) 00000100:00100000:2.0:1746143762.120903:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594150784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.120908:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13306 00000100:00100000:2.0:1746143762.120919:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13307 00000100:00100000:2.0:1746143762.120923:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594151040:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143762.120923:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13308 00010000:00010000:2.0:1746143762.120928:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143762.120928:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963594150912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143762.120933:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.120936:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7700 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.120939:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a76f9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143762.120945:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a11, atime: 0x68140a10, ctime: 0x68140a11, blocks: 0x81f 00002000:00010000:0.0:1746143762.120948:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a11, atime: 0x68140a11, ctime: 0x68140a11, blocks: 0x821 00010000:00010000:2.0:1746143762.120951:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.120952:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.120952:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.120954:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.120955:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 31 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.120957:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.120963:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 31 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.120964:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.120970:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2c200, rc 0) 00010000:00010000:0.0:1746143762.120974:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bf400, rc 0) 00000100:00100000:3.0:1746143762.121007:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594150656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 198us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.121012:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13305 00000100:00100000:1.0:1746143762.121021:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13309 00000100:00100000:1.0:1746143762.121027:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594151168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.121032:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.121040:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7707 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143762.121051:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a11, atime: 0x68140a11, ctime: 0x68140a11, blocks: 0x1029 00010000:00010000:1.0:1746143762.121058:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.121059:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.121067:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 38 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.121077:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 38 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.121083:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beda600, rc 0) 00000100:00100000:1.0:1746143762.121097:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594151168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.121102:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13309 00000100:00100000:0.0:1746143762.121161:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594150912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 232us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.121162:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594151040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 238us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.121166:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13308 00000100:00100000:2.0:1746143762.121260:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13307 00000100:00100000:0.0:1746143762.124125:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.125342:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594151424 00000100:00100000:1.0:1746143762.125350:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594151424 00000100:00100000:1.0:1746143762.125535:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3929 00000100:00100000:1.0:1746143762.125541:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31284:x1830963594151424:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:1.0:1746143762.126045:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31284:x1830963594151424:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 502us (1923us total) trans 8589943488 rc 0/0 00000100:00100000:1.0:1746143762.126051:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3929 00000100:00100000:0.0:1746143762.128699:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.131309:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594151680 00000100:00100000:1.0:1746143762.131319:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594151680 00000100:00100000:1.0:1746143762.131376:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3930 00000100:00100000:1.0:1746143762.131382:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:31283:x1830963594151680:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143762.131554:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:31283:x1830963594151680:12345-192.168.202.48@tcp:35:cat.0 Request processed in 171us (2861us total) trans 8589943489 rc 0/0 00000100:00100000:1.0:1746143762.131561:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3930 00000100:00100000:0.0:1746143762.158742:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.158846:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594151808 00000100:00100000:3.0:1746143762.158853:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594151808 00000100:00100000:3.0:1746143762.158926:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13310 00000100:00100000:3.0:1746143762.158933:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31286:x1830963594151808:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143762.158948:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.158963:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a770e expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.158992:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.158998:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.159000:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.159003:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.159027:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.159038:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 29 pid: 4582 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.159048:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594343296:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.159771:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.161263:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594343296:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.161282:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.161294:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0a00, rc 0) 00000100:00100000:3.0:1746143762.161321:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31286:x1830963594151808:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2388us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.161328:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13310 00000100:00100000:0.0:1746143762.162464:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.162540:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594151936 00000100:00100000:2.0:1746143762.162545:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594151936 00010000:00010000:2.0:1746143762.162647:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 30 pid: 4582 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.162679:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7126 00000100:00100000:2.0:1746143762.162685:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594151936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.162696:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.162713:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 30 pid: 4582 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.162722:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 30 pid: 4582 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.162737:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72f9a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76e4 expref: 30 pid: 4582 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.164045:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.164049:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.164057:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 21 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.164065:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 21 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.164095:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 21 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.164105:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594343424:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.164198:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.166384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.166543:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594152192 00000100:00100000:3.0:1746143762.166549:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594152192 00002000:00100000:3.0:1746143762.166585:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2625536->2629631) req@ffff8800a54e9f80 x1830963594152192/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.166594:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e9f80 with x1830963594152192 ext(2625536->2629631) 00002000:00010000:3.0:1746143762.166597:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54e9f80 00000100:00100000:3.0:1746143762.166630:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6241 00000100:00100000:3.0:1746143762.166637:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594152192:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143762.166670:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594343424:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.166684:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.166711:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594151936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4026us (4248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.166718:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7126 00000100:00100000:3.0:1746143762.167202:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594152192:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 563us (822us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.167208:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6241 00002000:00100000:3.0:1746143762.167213:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2625536->2629631) req@ffff8800a54e9f80 x1830963594152192/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.167229:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e9f80 with x1830963594152192 ext(2625536->2629631) 00002000:00010000:3.0:1746143762.167232:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54e9f80 00000100:00100000:0.0:1746143762.173689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.173797:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594152320 00000100:00100000:3.0:1746143762.173804:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594152320 00000100:00100000:3.0:1746143762.173853:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13311 00000100:00100000:3.0:1746143762.173860:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31286:x1830963594152320:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143762.173874:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.173888:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7715 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.173913:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 36 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.173924:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.173926:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.173929:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->2199551] (req 2097152->2199551) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.173953:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 36 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.173963:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 36 pid: 6929 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.173973:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594343552:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.174036:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.178426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.178534:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594152448 00000100:00100000:2.0:1746143762.178541:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594152448 00010000:00010000:2.0:1746143762.178570:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 37 pid: 6929 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.178582:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594343552:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.178594:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7127 00000100:00100000:2.0:1746143762.178600:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963594152448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143762.178603:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->2199551] (req 2097152->2199551) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.178610:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143762.178617:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0e00, rc 0) 00010000:00010000:2.0:1746143762.178627:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 37 pid: 6929 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.178637:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 37 pid: 6929 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.178656:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009beda600/0xe984082ccd72f9c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7707 expref: 37 pid: 6929 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.178666:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31286:x1830963594152320:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4806us (4983us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143762.178670:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143762.178672:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13311 00010000:00010000:2.0:1746143762.178672:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.178677:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.178685:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.178708:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 26 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.178723:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594343680:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.179527:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.180700:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594343680:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.180713:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.180743:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594152448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2143us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.180750:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7127 00000100:00100000:0.0:1746143762.183387:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.183449:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594152704 00000100:00100000:3.0:1746143762.183457:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594152704 00002000:00100000:3.0:1746143762.183492:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2195456->2199551) req@ffff880093500e00 x1830963594152704/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.183505:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500e00 with x1830963594152704 ext(2195456->2199551) 00002000:00010000:3.0:1746143762.183509:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500e00 00000100:00100000:3.0:1746143762.183537:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6242 00000100:00100000:3.0:1746143762.183544:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594152704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143762.183686:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594152704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 141us (304us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.183691:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6242 00002000:00100000:3.0:1746143762.183696:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2195456->2199551) req@ffff880093500e00 x1830963594152704/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.183703:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500e00 with x1830963594152704 ext(2195456->2199551) 00002000:00010000:3.0:1746143762.183706:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500e00 00000100:00100000:0.0:1746143762.219698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.219849:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594152960 00000100:00100000:1.0:1746143762.219858:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594152960 00000100:00100000:1.0:1746143762.219911:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9171 00000100:00100000:1.0:1746143762.219918:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+261:31292:x1830963594152960:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143762.219938:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.219953:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a771c expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.220048:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220063:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220071:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220083:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220088:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220093:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220379:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedbc00/0xe984082ccd72f9ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220388:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedbc00/0xe984082ccd72f9ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220395:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedbc00/0xe984082ccd72f9ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143762.220403:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143762.220481:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220487:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220492:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220500:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedaa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143762.220503:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220508:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220517:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143762.220520:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143762.220523:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220528:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedaa00/0xe984082ccd72f9df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220549:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220554:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220558:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220562:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedb400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143762.220564:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220568:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220573:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090e74f00) 00010000:00010000:1.0:1746143762.220575:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143762.220578:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220583:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedb400/0xe984082ccd72f9e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143762.220619:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedae00/0xe984082ccd72f9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a771c expref: 264 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.220629:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedbc00/0xe984082ccd72f9ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a771c expref: 263 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.220635:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.220637:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143762.220639:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bedbc00, rc 0) 00000100:00100000:1.0:1746143762.220681:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:31292:x1830963594152960:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 763us (990us total) trans 8589943490 rc 0/0 00000100:00100000:1.0:1746143762.220687:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9171 00000100:00100000:0.0:1746143762.222073:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.222384:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153088 00000100:00100000:3.0:1746143762.222389:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153088 00000100:00100000:0.0:1746143762.222574:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.223256:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153216 00000100:00100000:3.0:1746143762.223262:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153216 00000100:00100000:1.0:1746143762.223266:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13312 00000100:00100000:0.0:1746143762.223274:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.223276:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594153088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.223289:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143762.223297:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153344 00000100:00100000:2.0:1746143762.223301:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153344 00000100:00100000:3.0:1746143762.223302:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13313 00010000:00010000:1.0:1746143762.223302:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7723 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.223307:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594153216:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143762.223313:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143762.223315:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.223321:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143762.223323:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153472 00010000:00010000:1.0:1746143762.223323:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143762.223324:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153472 00010000:00010000:3.0:1746143762.223325:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a772a expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143762.223328:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13314 00010000:00010000:1.0:1746143762.223330:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143762.223333:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594153344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.223335:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.223336:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143762.223337:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13315 00010000:00010000:0.0:1746143762.223340:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.223341:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143762.223341:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594153472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.223342:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.223346:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.223346:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7731 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.223351:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7738 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.223352:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beda600, rc 0) 00010000:00010000:3.0:1746143762.223353:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 30 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.223356:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.223358:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.223359:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0600, rc 0) 00010000:00010000:2.0:1746143762.223360:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.223361:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.223362:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 30 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.223365:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.223370:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 30 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.223373:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 25 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.223377:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be400, rc 0) 00010000:00010000:2.0:1746143762.223383:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2cc00, rc 0) 00000100:00100000:3.0:1746143762.223386:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963594153216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 78us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.223387:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594153088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 112us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.223391:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13313 00000100:00100000:0.0:1746143762.223392:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594153344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.223394:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594153472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 54us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.223394:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13312 00000100:00100000:0.0:1746143762.223398:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13314 00000100:00100000:2.0:1746143762.223400:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13315 00000100:00100000:0.0:1746143762.223460:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.224422:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153600 00000100:00100000:2.0:1746143762.224427:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153600 00000100:00100000:2.0:1746143762.224467:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 727 00000100:00100000:2.0:1746143762.224473:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:1963:x1830963594153600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.224480:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.224496:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedbc00/0xe984082ccd72f9ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a771c expref: 263 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.224524:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.224528:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.224562:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:1963:x1830963594153600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 89us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.224567:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 727 00000100:00100000:0.0:1746143762.236849:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.236892:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.236919:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.236940:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594153984 00000100:00100000:0.0:1746143762.236947:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594153984 00000100:00100000:1.0:1746143762.236966:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594154240 00000100:00100000:1.0:1746143762.236970:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594154240 00002000:00100000:0.0:1746143762.236985:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a04cc000 x1830963594153984/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.236987:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a04cc700 x1830963594154240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.236994:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc700 with x1830963594154240 ext(1048576->2097151) 00002000:00100000:0.0:1746143762.236995:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc000 with x1830963594153984 ext(0->1048575) 00002000:00010000:1.0:1746143762.236999:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cc700 00002000:00010000:0.0:1746143762.236999:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cc000 00000100:00100000:0.0:1746143762.237703:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594154368 00000100:00100000:0.0:1746143762.237707:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594154368 00002000:00100000:0.0:1746143762.237721:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a04cca80 x1830963594154368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.237728:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cca80 with x1830963594154368 ext(1048576->2097151) 00002000:00010000:0.0:1746143762.237732:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cca80 00000100:00100000:0.0:1746143762.237889:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6243 00000100:00100000:3.0:1746143762.237896:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6244 00000100:00100000:0.0:1746143762.237897:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594153984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.237904:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594154240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.238033:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6245 00000100:00100000:1.0:1746143762.238040:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594154368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.238993:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.239014:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594154624 00000100:00100000:3.0:1746143762.239018:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594154624 00002000:00100000:3.0:1746143762.239038:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800949f1f80 x1830963594154624/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.239045:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963594154624 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.239049:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:3.0:1746143762.239062:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6246 00000100:00100000:3.0:1746143762.239067:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594154624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.250394:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1963:x1830963594154240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12482us (13492us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.250405:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6244 00002000:00100000:3.0:1746143762.250415:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a04cc700 x1830963594154240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.250431:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc700 with x1830963594154240 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.250436:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cc700 00000100:00100000:2.0:1746143762.262889:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594153984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24984us (26040us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143762.262899:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6243 00002000:00100000:2.0:1746143762.262910:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a04cc000 x1830963594153984/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.262918:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc000 with x1830963594153984 ext(0->1048575) 00002000:00010000:2.0:1746143762.262923:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cc000 00000100:00100000:2.0:1746143762.263475:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.263476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.263748:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155008 00000100:00100000:0.0:1746143762.263754:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155008 00000100:00100000:0.0:1746143762.263780:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13316 00000100:00100000:0.0:1746143762.263785:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31292:x1830963594155008:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143762.263796:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.263808:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7746 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.263827:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.263834:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 30 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.263838:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.263839:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.263842:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1945600->2097151] (req 1945600->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 37 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.263861:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 30 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.263871:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 30 pid: 21542 timeout: 941 lvb_type: 1 00000100:00100000:0.0:1746143762.263883:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594343808:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143762.263948:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.263955:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.263956:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594154368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25917us (27036us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143762.263962:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594343936:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.263963:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6245 00002000:00100000:2.0:1746143762.263968:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a04cca80 x1830963594154368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.263975:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cca80 with x1830963594154368 ext(1048576->2097151) 00000100:00100000:0.0:1746143762.263976:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143762.263979:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 29 pid: 21542 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.263987:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 29 pid: 21542 timeout: 941 lvb_type: 1 00002000:00010000:2.0:1746143762.263992:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cca80 00000100:00100000:0.0:1746143762.263997:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594154880 00000100:00100000:0.0:1746143762.264000:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594154880 00000100:00100000:0.0:1746143762.264018:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9172 00000100:00100000:0.0:1746143762.264023:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+262:31298:x1830963594154880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143762.264034:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.264042:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b600/0xe984082ccd72fa1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a773f expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.264122:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264131:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264156:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264167:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264173:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264178:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264269:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60bc00/0xe984082ccd72fa33 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264276:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60bc00/0xe984082ccd72fa33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264281:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60bc00/0xe984082ccd72fa33 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143762.264289:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143762.264347:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264353:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264358:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264363:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e60b800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143762.264366:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264371:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264379:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143762.264382:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143762.264385:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264390:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b800/0xe984082ccd72fa25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264413:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264417:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264421:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264425:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e60ba00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143762.264428:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264433:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264438:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009322f600) 00010000:00010000:0.0:1746143762.264439:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143762.264441:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264446:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60ba00/0xe984082ccd72fa2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.264476:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60b600/0xe984082ccd72fa1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a773f expref: 265 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.264489:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60bc00/0xe984082ccd72fa33 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a773f expref: 264 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.264495:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143762.264496:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143762.264498:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e60bc00, rc 0) 00000100:00100000:0.0:1746143762.264518:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:31298:x1830963594154880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 494us (1042us total) trans 8589943491 rc 0/0 00000100:00100000:0.0:1746143762.264523:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9172 00000100:00100000:0.0:1746143762.271839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.272450:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594343808:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.272460:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04ce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594343936:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.272484:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1945600->2097151] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 37 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.272498:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e60aa00, rc 0) 00000100:00100000:2.0:1746143762.272539:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:31292:x1830963594155008:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8753us (9064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.272546:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13316 00000100:00100000:1.0:1746143762.273014:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155136 00000100:00100000:1.0:1746143762.273020:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155136 00010000:00010000:1.0:1746143762.273044:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143762.273070:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7128 00000100:00100000:1.0:1746143762.273077:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963594155136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.273088:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.273107:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143762.273117:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143762.273136:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf400/0xe984082ccd72f9bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f9 expref: 37 pid: 21542 timeout: 941 lvb_type: 1 00010000:00010000:1.0:1746143762.273164:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.273186:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594155136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.273191:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7128 00000100:00100000:0.0:1746143762.273810:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.274113:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594154624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35044us (35119us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.274121:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6246 00002000:00100000:3.0:1746143762.274128:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800949f1f80 x1830963594154624/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.274136:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963594154624 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.274158:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:2.0:1746143762.274223:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155264 00000100:00100000:2.0:1746143762.274228:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155264 00010000:00010000:2.0:1746143762.274245:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 29 pid: 21542 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.274262:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7129 00000100:00100000:2.0:1746143762.274267:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594155264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.274276:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.274287:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 29 pid: 21542 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.274295:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 29 pid: 21542 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.274309:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be400/0xe984082ccd72fa09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7731 expref: 29 pid: 21542 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.274321:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.274323:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.274329:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.274335:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.274358:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.274374:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594344064:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.274419:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.280006:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.280187:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155392 00000100:00100000:2.0:1746143762.280194:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155392 00000100:00100000:2.0:1746143762.280251:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13317 00000100:00100000:2.0:1746143762.280258:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31295:x1830963594155392:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.280273:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.280287:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a774d expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.280313:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.280321:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.280322:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.280325:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.280350:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 35 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.280360:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 35 pid: 9527 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.280371:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594344192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.280492:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.281040:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.281064:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.281094:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.281201:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155520 00000100:00100000:3.0:1746143762.281205:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155520 00000100:00100000:3.0:1746143762.281237:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155648 00000100:00100000:3.0:1746143762.281239:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155648 00000100:00100000:3.0:1746143762.281251:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155776 00000100:00100000:3.0:1746143762.281253:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155776 00000100:00100000:3.0:1746143762.281264:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13318 00000100:00100000:3.0:1746143762.281268:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594155520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.281275:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.281282:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72fa48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7754 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.281307:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594344320:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.281347:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.281360:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13319 00000100:00100000:3.0:1746143762.281364:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594155648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.281371:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.281379:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1400/0xe984082ccd72fa4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a775b expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.281398:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594344448:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.281416:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.281431:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13320 00000100:00100000:3.0:1746143762.281436:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594155776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.281441:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.281447:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b51ad400/0xe984082ccd72fa56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7762 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.281466:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594344576:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.281483:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.286628:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.287060:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594155904 00000100:00100000:1.0:1746143762.287068:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594155904 00000100:00100000:1.0:1746143762.287123:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 728 00000100:00100000:1.0:1746143762.287130:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:1962:x1830963594155904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.287170:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.287190:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e60bc00/0xe984082ccd72fa33 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a773f expref: 264 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.287208:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.287211:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.287254:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:1962:x1830963594155904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 125us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.287260:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 728 00000100:00100000:0.0:1746143762.287422:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.287530:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594156160 00000100:00100000:3.0:1746143762.287533:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594156160 00002000:00100000:3.0:1746143762.287562:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1945600->1949695) req@ffff8800a04cf800 x1830963594156160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.287572:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf800 with x1830963594156160 ext(1945600->1949695) 00010000:00010000:3.0:1746143762.287578:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 40 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.287589:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 40 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.287595:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cf800 00000100:00100000:2.0:1746143762.287678:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594344064:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.287692:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.287718:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594155264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 13450us (13909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.287724:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7129 00002000:00010000:0.0:1746143762.287831:0:2839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143761 -> 1746143762 00000100:00100000:0.0:1746143762.287847:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594344448:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143762.287864:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1400/0xe984082ccd72fa4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a775b expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.287873:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f1400/0xe984082ccd72fa4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a775b expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.287888:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1400, rc 0) 00000100:00100000:0.0:1746143762.287910:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594155648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6546us (6846us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143762.287916:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13319 00002000:00010000:0.0:1746143762.287969:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143761 -> 1746143762 00000100:00100000:0.0:1746143762.287978:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594344576:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143762.287990:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b51ad400/0xe984082ccd72fa56 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7762 expref: 40 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.287998:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b51ad400/0xe984082ccd72fa56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7762 expref: 40 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.288004:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51ad400, rc 0) 00000100:00100000:0.0:1746143762.288016:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594155776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6581us (6922us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143762.288021:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13320 00000100:00100000:2.0:1746143762.288098:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594344192:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.288110:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 29 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.288119:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2d600, rc 0) 00000100:00100000:2.0:1746143762.288154:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31295:x1830963594155392:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7897us (8156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.288159:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13317 00000100:00100000:3.0:1746143762.288254:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1773 00000100:00100000:3.0:1746143762.288260:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594156160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143762.288364:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594156160:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 104us (942us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.288369:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1773 00002000:00100000:3.0:1746143762.288374:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1945600->1949695) req@ffff8800a04cf800 x1830963594156160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.288380:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf800 with x1830963594156160 ext(1945600->1949695) 00010000:00010000:3.0:1746143762.288383:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 38 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.288392:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 38 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.288397:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cf800 00002000:00010000:3.0:1746143762.288414:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143761 -> 1746143762 00002000:00010000:3.0:1746143762.288417:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143761 -> 1746143762 00000100:00100000:3.0:1746143762.288422:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594344320:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143762.288433:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72fa48 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7754 expref: 37 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.288440:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0800/0xe984082ccd72fa48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7754 expref: 37 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.288449:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f0800, rc 0) 00000100:00100000:3.0:1746143762.288463:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594155520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7194us (7424us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143762.288467:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13318 00000100:00100000:0.0:1746143762.297561:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.298620:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594156416 00000100:00100000:2.0:1746143762.298629:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594156416 00002000:00100000:2.0:1746143762.298667:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1945600->2097151) req@ffff8800a04ce300 x1830963594156416/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.298676:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04ce300 with x1830963594156416 ext(1945600->2097151) 00010000:00010000:2.0:1746143762.298685:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 36 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.298697:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 36 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.298704:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04ce300 00000100:00100000:0.0:1746143762.298899:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.299682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.299700:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594156544 00000100:00100000:3.0:1746143762.299704:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594156544 00000100:00100000:3.0:1746143762.299735:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13321 00000100:00100000:3.0:1746143762.299741:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31292:x1830963594156544:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143762.299752:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.299764:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7769 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.299784:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.299792:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.299798:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.299799:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.299802:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->1335295] (req 1048576->1335295) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.299824:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.299833:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 23 pid: 25369 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.299847:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594344704:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.299919:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 30 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.299926:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 30 pid: 25369 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.299933:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594344832:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.300163:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.300347:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594156800 00000100:00100000:2.0:1746143762.300351:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594156800 00002000:00100000:2.0:1746143762.300367:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093806300 x1830963594156800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.300380:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806300 with x1830963594156800 ext(0->1048575) 00002000:00010000:2.0:1746143762.300383:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806300 00000100:00100000:2.0:1746143762.300396:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1774 00000100:00100000:2.0:1746143762.300402:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594156416:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143762.300587:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6247 00000100:00100000:2.0:1746143762.300592:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594156800:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.300959:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.302057:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594344704:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.302632:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594157056 00000100:00100000:3.0:1746143762.302636:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594157056 00002000:00100000:3.0:1746143762.302665:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093806a00 x1830963594157056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.302673:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806a00 with x1830963594157056 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.302677:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093806a00 00000100:00100000:3.0:1746143762.302701:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6248 00000100:00100000:3.0:1746143762.302707:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594157056:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143762.304336:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.304390:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594157184 00000100:00100000:2.0:1746143762.304396:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594157184 00010000:00010000:2.0:1746143762.304425:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 24 pid: 25369 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.304454:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7130 00000100:00100000:2.0:1746143762.304460:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594157184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.304471:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.304486:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 24 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.304495:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 24 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.304514:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff2cc00/0xe984082ccd72fa10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7738 expref: 24 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.304538:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.304560:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594157184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.304566:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7130 00000100:00100000:2.0:1746143762.306264:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594156416:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5856us (8704us total) trans 17179873082 rc 0/0 00000100:00100000:2.0:1746143762.306273:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1774 00002000:00100000:2.0:1746143762.306282:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1945600->2097151) req@ffff8800a04ce300 x1830963594156416/t17179873082(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.306291:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04ce300 with x1830963594156416 ext(1945600->2097151) 00010000:00010000:2.0:1746143762.306298:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 40 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.306308:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 40 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.306314:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04ce300 00000100:00100000:0.0:1746143762.313862:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.313990:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594157312 00000100:00100000:2.0:1746143762.313998:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594157312 00010000:00010000:2.0:1746143762.314028:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 33 pid: 25369 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.314065:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7131 00000100:00100000:2.0:1746143762.314071:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594157312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.314082:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.314101:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 33 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.314115:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 33 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.314136:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.314152:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.314158:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.314165:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.314193:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.314205:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594344960:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143762.314277:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594156800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13682us (14594us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143762.314280:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.314284:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6247 00002000:00100000:3.0:1746143762.314292:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093806300 x1830963594156800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.314305:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806300 with x1830963594156800 ext(0->1048575) 00002000:00010000:3.0:1746143762.314309:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093806300 00010000:00010000:1.0:1746143762.314347:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff2c200/0xe984082ccd72f9b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7700 expref: 31 pid: 25369 timeout: 941 lvb_type: 1 00000100:00100000:1.0:1746143762.314376:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594344832:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143762.314395:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 30 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.314403:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090ceda00, rc 0) 00000100:00100000:1.0:1746143762.314421:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:31292:x1830963594156544:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14681us (15524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.314427:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13321 00000100:00100000:3.0:1746143762.319106:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594157056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16391us (18934us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.319116:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6248 00002000:00100000:3.0:1746143762.319126:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093806a00 x1830963594157056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.319134:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093806a00 with x1830963594157056 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.319153:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093806a00 00000100:00100000:2.0:1746143762.319470:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.319488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.319566:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594344960:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.319581:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.319644:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594157312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5573us (5788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.319652:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7131 00000100:00100000:2.0:1746143762.319669:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594157696 00000100:00100000:2.0:1746143762.319673:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594157696 00010000:00010000:2.0:1746143762.319691:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 38 pid: 9527 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.320017:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594157568 00000100:00100000:3.0:1746143762.320020:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594157568 00002000:00100000:3.0:1746143762.320043:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2519040->2523135) req@ffff880093b05880 x1830963594157568/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.320049:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b05880 with x1830963594157568 ext(2519040->2523135) 00002000:00010000:3.0:1746143762.320052:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b05880 00000100:00100000:3.0:1746143762.320069:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6249 00000100:00100000:3.0:1746143762.320075:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594157568:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143762.320123:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7132 00000100:00100000:2.0:1746143762.320130:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594157696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.320160:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.320173:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 38 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.320182:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 38 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.320200:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e60aa00/0xe984082ccd72fa17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7746 expref: 38 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.320367:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.320369:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.320376:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 29 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.320384:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 29 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.320409:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 29 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.320419:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594345088:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143762.320501:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594157568:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 425us (1030us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.320507:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6249 00002000:00100000:3.0:1746143762.320512:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2519040->2523135) req@ffff880093b05880 x1830963594157568/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.320518:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b05880 with x1830963594157568 ext(2519040->2523135) 00002000:00010000:3.0:1746143762.320521:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b05880 00000100:00100000:2.0:1746143762.321274:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.324736:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.324884:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594157952 00000100:00100000:3.0:1746143762.324891:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594157952 00002000:00100000:3.0:1746143762.324927:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1331200->1335295) req@ffff880093804000 x1830963594157952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.324937:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804000 with x1830963594157952 ext(1331200->1335295) 00002000:00010000:3.0:1746143762.324941:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804000 00000100:00100000:3.0:1746143762.324967:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6250 00000100:00100000:3.0:1746143762.324974:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594157952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.325114:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594157952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 140us (385us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.325119:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6250 00002000:00100000:3.0:1746143762.325125:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1331200->1335295) req@ffff880093804000 x1830963594157952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.325131:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804000 with x1830963594157952 ext(1331200->1335295) 00002000:00010000:3.0:1746143762.325134:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804000 00000100:00100000:1.0:1746143762.325509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.325564:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594158080 00000100:00100000:0.0:1746143762.325567:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594158080 00000100:00100000:0.0:1746143762.325597:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13322 00000100:00100000:0.0:1746143762.325603:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:31298:x1830963594158080:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143762.325611:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.325623:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7770 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.325639:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.325640:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.325645:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.325656:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.325664:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0835a00, rc 0) 00000100:00100000:2.0:1746143762.325766:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594345088:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.325780:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.325814:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:31298:x1830963594158080:12345-192.168.202.48@tcp:101:cat.0 Request processed in 211us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.325820:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13322 00000100:00100000:2.0:1746143762.325853:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594157696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5723us (6363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.325860:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7132 00000100:00100000:0.0:1746143762.327246:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.327352:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594158336 00000100:00100000:3.0:1746143762.327357:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594158336 00002000:00100000:3.0:1746143762.327382:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a04cf480 x1830963594158336/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.327389:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf480 with x1830963594158336 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.327393:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cf480 00000100:00100000:3.0:1746143762.327405:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6251 00000100:00100000:3.0:1746143762.327410:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594158336:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143762.330469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.331294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.331368:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594158592 00000100:00100000:2.0:1746143762.331375:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594158592 00002000:00100000:2.0:1746143762.331406:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2850816->2854911) req@ffff8800a04cdf80 x1830963594158592/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.331414:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdf80 with x1830963594158592 ext(2850816->2854911) 00002000:00010000:2.0:1746143762.331419:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cdf80 00000100:00100000:2.0:1746143762.331433:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6252 00000100:00100000:2.0:1746143762.331438:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594158592:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143762.331556:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594158592:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 118us (1095us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143762.331562:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6252 00002000:00100000:2.0:1746143762.331567:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2850816->2854911) req@ffff8800a04cdf80 x1830963594158592/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.331574:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdf80 with x1830963594158592 ext(2850816->2854911) 00002000:00010000:2.0:1746143762.331576:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cdf80 00000100:00100000:3.0:1746143762.332262:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594158848 00000100:00100000:3.0:1746143762.332266:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594158848 00000100:00100000:3.0:1746143762.332300:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3931 00000100:00100000:3.0:1746143762.332305:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+263:31292:x1830963594158848:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143762.332475:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:31292:x1830963594158848:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 169us (1181us total) trans 8589943492 rc 0/0 00000100:00100000:3.0:1746143762.332481:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3931 00000100:00100000:0.0:1746143762.333949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.334029:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594159104 00000100:00100000:2.0:1746143762.334034:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594159104 00000100:00100000:0.0:1746143762.334048:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.334091:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594159360 00000100:00100000:3.0:1746143762.334095:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594159360 00002000:00100000:3.0:1746143762.334114:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1335296->2097151) req@ffff8800a0a95500 x1830963594159360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.334115:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0a96680 x1830963594159104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.334122:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95500 with x1830963594159360 ext(1335296->2097151) 00002000:00010000:3.0:1746143762.334125:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95500 00002000:00100000:2.0:1746143762.334127:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a96680 with x1830963594159104 ext(1048576->2097151) 00002000:00010000:2.0:1746143762.334129:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a96680 00000100:00100000:3.0:1746143762.334169:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6253 00000100:00100000:2.0:1746143762.334173:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6254 00000100:00100000:3.0:1746143762.334175:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963594159360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.334178:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594159104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.339774:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594158336:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12354us (12522us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.339783:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6251 00002000:00100000:3.0:1746143762.339794:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a04cf480 x1830963594158336/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.339802:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf480 with x1830963594158336 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.339807:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cf480 00000100:00100000:3.0:1746143762.340948:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963594159360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6770us (6895us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746143762.340957:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6253 00002000:00100000:3.0:1746143762.340962:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1335296->2097151) req@ffff8800a0a95500 x1830963594159360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.340969:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a95500 with x1830963594159360 ext(1335296->2097151) 00002000:00010000:3.0:1746143762.340972:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0a95500 00000100:00100000:3.0:1746143762.342070:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594159104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7821us (8054us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.342077:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6254 00002000:00100000:3.0:1746143762.342083:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0a96680 x1830963594159104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.342089:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0a96680 with x1830963594159104 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.342092:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0a96680 00000100:00100000:0.0:1746143762.342622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.342751:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594159488 00000100:00100000:3.0:1746143762.342758:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594159488 00000100:00100000:3.0:1746143762.342793:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13323 00000100:00100000:3.0:1746143762.342799:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31295:x1830963594159488:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.342811:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.342825:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7777 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.342846:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.342853:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143762.342855:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143762.342858:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.342882:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 28 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.342892:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 28 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.342903:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594345216:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.342973:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.346961:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.347057:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594159616 00000100:00100000:2.0:1746143762.347065:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594159616 00002000:00100000:2.0:1746143762.347098:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1335295) req@ffff8800a63a2d80 x1830963594159616/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143762.347103:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594345216:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.347122:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 24 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.347132:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090cecc00, rc 0) 00000100:00100000:3.0:1746143762.347273:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31295:x1830963594159488:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4472us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.347279:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13323 00000100:00100000:0.0:1746143762.347504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.347540:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594159744 00000100:00100000:3.0:1746143762.347544:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594159744 00000100:00100000:1.0:1746143762.347622:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13324 00000100:00100000:1.0:1746143762.347630:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:31298:x1830963594159744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.347641:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.347652:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a777e expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143762.347667:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2d80 with x1830963594159616 ext(1048576->1335295) 00010000:00010000:1.0:1746143762.347668:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.347672:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.347675:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 31 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.347679:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.347685:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c113c00, rc 0) 00010000:00010000:2.0:1746143762.347686:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 31 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.347692:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a2d80 00000100:00100000:2.0:1746143762.347705:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1775 00000100:00100000:1.0:1746143762.347706:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31298:x1830963594159744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.347711:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594159616:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143762.347711:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13324 00000100:00100000:2.0:1746143762.351157:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594159616:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3424us (4180us total) trans 21474840402 rc 0/0 00000100:00100000:2.0:1746143762.351167:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1775 00002000:00100000:2.0:1746143762.351176:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1335295) req@ffff8800a63a2d80 x1830963594159616/t21474840402(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.351189:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2d80 with x1830963594159616 ext(1048576->1335295) 00010000:00010000:2.0:1746143762.351197:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.351209:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.351225:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a2d80 00000100:00100000:0.0:1746143762.354207:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.354347:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594159872 00000100:00100000:2.0:1746143762.354354:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594159872 00010000:00010000:2.0:1746143762.354383:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.354405:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7133 00000100:00100000:2.0:1746143762.354411:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594159872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.354422:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143762.354437:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143761 -> 1746143762 00002000:00010000:2.0:1746143762.354439:0:23335:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143761 -> 1746143762 00010000:00010000:2.0:1746143762.354444:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.354454:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.354471:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090ceda00/0xe984082ccd72fa5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1335295) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7769 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.355077:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.355079:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.355086:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.355094:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.355102:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.355103:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.355105:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.355111:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.355136:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.355166:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594345344:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.355471:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.355479:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594345472:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.355499:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.358634:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.358731:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594345344:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.358742:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594345472:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.358758:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.358789:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594159872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4377us (4588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.358798:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7133 00000100:00100000:3.0:1746143762.359111:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594160128 00000100:00100000:3.0:1746143762.359116:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594160128 00002000:00100000:3.0:1746143762.359165:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012b79ea00 x1830963594160128/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.359174:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ea00 with x1830963594160128 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.359179:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79ea00 00000100:00100000:3.0:1746143762.359194:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6255 00000100:00100000:3.0:1746143762.359201:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594160128:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143762.360445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.360496:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594160384 00000100:00100000:2.0:1746143762.360500:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594160384 00002000:00100000:2.0:1746143762.360523:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012f185c00 x1830963594160384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.360529:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963594160384 ext(1048576->2097151) 00002000:00010000:2.0:1746143762.360532:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:2.0:1746143762.360546:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6256 00000100:00100000:2.0:1746143762.360550:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594160384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.366645:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594160128:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7436us (8009us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.366655:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6255 00002000:00100000:3.0:1746143762.366665:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012b79ea00 x1830963594160128/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.366673:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ea00 with x1830963594160128 ext(1048576->2097151) 00002000:00010000:3.0:1746143762.366678:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79ea00 00000100:00100000:2.0:1746143762.367473:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594160384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6920us (7029us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143762.367479:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6256 00002000:00100000:2.0:1746143762.367485:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012f185c00 x1830963594160384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.367491:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963594160384 ext(1048576->2097151) 00002000:00010000:2.0:1746143762.367494:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:0.0:1746143762.373413:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.373469:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.373534:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594160512 00000100:00100000:1.0:1746143762.373543:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594160512 00000100:00100000:1.0:1746143762.373588:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594160640 00000100:00100000:1.0:1746143762.373590:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594160640 00000100:00100000:1.0:1746143762.373606:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13325 00000100:00100000:1.0:1746143762.373613:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594160512:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.373627:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.373642:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2be600/0xe984082ccd72fa79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7785 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.373683:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594345600:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.373742:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13326 00000100:00100000:3.0:1746143762.373751:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594160640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.373759:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.373767:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090cec400/0xe984082ccd72fa80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a778c expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.373791:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594345728:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.373850:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.374266:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.374959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:3.0:1746143762.375231:0:9527:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143761 -> 1746143762 00002000:00010000:3.0:1746143762.375235:0:9527:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143761 -> 1746143762 00000100:00100000:3.0:1746143762.375252:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594345728:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143762.375269:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090cec400/0xe984082ccd72fa80 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a778c expref: 39 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.375285:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090cec400/0xe984082ccd72fa80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a778c expref: 39 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.375357:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090cec400, rc 0) 00000100:00100000:3.0:1746143762.375392:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594160640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1642us (1922us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143762.375399:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13326 00000100:00100000:3.0:1746143762.375419:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594161024 00000100:00100000:3.0:1746143762.375422:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594161024 00002000:00100000:3.0:1746143762.375441:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3665919) req@ffff88009c275180 x1830963594161024/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 504/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143762.375575:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.375670:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143762.375727:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275180 with x1830963594161024 ext(2097152->3665919) 00002000:00010000:3.0:1746143762.375731:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c275180 00000100:00100000:3.0:1746143762.375742:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594161152 00000100:00100000:3.0:1746143762.375745:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594161152 00000100:00100000:2.0:1746143762.375750:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594161536 00000100:00100000:2.0:1746143762.375753:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594161536 00002000:00100000:3.0:1746143762.375757:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3665920->4194303) req@ffff88009c276a00 x1830963594161152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.375763:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276a00 with x1830963594161152 ext(3665920->4194303) 00002000:00010000:3.0:1746143762.375766:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c276a00 00002000:00100000:2.0:1746143762.375766:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3584000->4194303) req@ffff88009c274a80 x1830963594161536/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143762.375774:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6257 00002000:00100000:2.0:1746143762.375777:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274a80 with x1830963594161536 ext(3584000->4194303) 00000100:00100000:3.0:1746143762.375779:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594161024:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:2.0:1746143762.375779:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c274a80 00000100:00100000:2.0:1746143762.375793:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6258 00000100:00100000:2.0:1746143762.375797:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594161152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.375821:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6259 00000100:00100000:0.0:1746143762.375976:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.376237:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594161408 00000100:00100000:1.0:1746143762.376241:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594161408 00002000:00100000:1.0:1746143762.376257:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2199552->3583999) req@ffff88009c277100 x1830963594161408/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 504/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.376264:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277100 with x1830963594161408 ext(2199552->3583999) 00002000:00010000:1.0:1746143762.376267:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c277100 00000100:00100000:1.0:1746143762.376357:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6260 00000100:00100000:1.0:1746143762.376363:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963594161408:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.376364:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963594161536:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:1.0:1746143762.377566:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143761 -> 1746143762 00002000:00010000:1.0:1746143762.377571:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143761 -> 1746143762 00000100:00100000:1.0:1746143762.377582:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594345600:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143762.377605:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2be600/0xe984082ccd72fa79 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7785 expref: 32 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.377617:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be600/0xe984082ccd72fa79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7785 expref: 32 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.377647:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be600, rc 0) 00000100:00100000:1.0:1746143762.377672:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594160512:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4059us (4266us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143762.377679:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13325 00000100:00100000:0.0:1746143762.382338:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.383309:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594161792 00000100:00100000:1.0:1746143762.383318:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594161792 00000100:00100000:1.0:1746143762.383368:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13327 00000100:00100000:1.0:1746143762.383378:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31298:x1830963594161792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.383394:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.383408:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7793 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.383432:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.383439:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.383441:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.383443:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.383467:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.383478:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.383489:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594345856:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.383553:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.383636:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594161152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7837us (8060us total) trans 0 rc 528384/528384 00000100:00100000:2.0:1746143762.383644:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6258 00002000:00100000:2.0:1746143762.383652:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3665920->4194303) req@ffff88009c276a00 x1830963594161152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.383660:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276a00 with x1830963594161152 ext(3665920->4194303) 00010000:00010000:2.0:1746143762.383665:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 26 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.383675:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 26 pid: 12618 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.383681:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c276a00 00000100:00100000:3.0:1746143762.385546:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594161024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9761us (10582us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.385557:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6257 00002000:00100000:3.0:1746143762.385564:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3665919) req@ffff88009c275180 x1830963594161024/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 504/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.385572:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275180 with x1830963594161024 ext(2097152->3665919) 00010000:00010000:3.0:1746143762.385577:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 24 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.385588:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 24 pid: 12618 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.385594:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c275180 00000100:00100000:1.0:1746143762.386255:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594345856:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143762.386277:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.386369:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be200, rc 0) 00000100:00100000:1.0:1746143762.386407:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31298:x1830963594161792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3029us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.386414:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13327 00000100:00100000:0.0:1746143762.388701:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.388792:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594161920 00000100:00100000:3.0:1746143762.388800:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594161920 00002000:00100000:3.0:1746143762.388836:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2625536->3145727) req@ffff88009c277800 x1830963594161920/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.388846:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277800 with x1830963594161920 ext(2625536->3145727) 00010000:00010000:3.0:1746143762.388853:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 24 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.388865:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 24 pid: 12618 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.388871:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c277800 00000100:00100000:3.0:1746143762.389276:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1776 00000100:00100000:3.0:1746143762.389283:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594161920:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143762.390036:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594161536:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14209us (14365us total) trans 0 rc 610304/610304 00000100:00100000:2.0:1746143762.390044:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6259 00002000:00100000:2.0:1746143762.390049:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3584000->4194303) req@ffff88009c274a80 x1830963594161536/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 610304/610304 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.390057:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274a80 with x1830963594161536 ext(3584000->4194303) 00002000:00010000:2.0:1746143762.390060:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c274a80 00000100:00100000:1.0:1746143762.392553:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594161408:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16181us (16844us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143762.392563:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6260 00002000:00100000:1.0:1746143762.392573:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2199552->3583999) req@ffff88009c277100 x1830963594161408/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 504/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.392581:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277100 with x1830963594161408 ext(2199552->3583999) 00002000:00010000:1.0:1746143762.392586:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c277100 00000100:00100000:0.0:1746143762.396516:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.396579:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594162048 00000100:00100000:1.0:1746143762.396587:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594162048 00000100:00100000:1.0:1746143762.396633:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13328 00000100:00100000:1.0:1746143762.396641:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31295:x1830963594162048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.396658:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.396673:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a779a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.396695:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.396696:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.396700:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.396711:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.396721:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bec00, rc 0) 00000100:00100000:1.0:1746143762.396769:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31295:x1830963594162048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.396775:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13328 00000100:00100000:3.0:1746143762.397752:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594161920:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8467us (9055us total) trans 21474840403 rc 0/0 00000100:00100000:3.0:1746143762.397759:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1776 00002000:00100000:3.0:1746143762.397768:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2625536->3145727) req@ffff88009c277800 x1830963594161920/t21474840403(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.397776:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277800 with x1830963594161920 ext(2625536->3145727) 00010000:00010000:3.0:1746143762.397781:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.397791:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.397796:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c277800 00000100:00100000:0.0:1746143762.404419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.404516:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594162176 00000100:00100000:2.0:1746143762.404523:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594162176 00010000:00010000:2.0:1746143762.404552:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.404586:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7134 00000100:00100000:2.0:1746143762.404593:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594162176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.404604:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.404624:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.404635:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.404653:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0a00/0xe984082ccd72f9ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a770e expref: 27 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.404682:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.404683:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.404690:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.404696:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.404707:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.404709:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.404711:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.404721:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.404748:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.404758:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594345984:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.404858:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.404867:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594346112:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.404886:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.408597:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594345984:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143762.408608:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594346112:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143762.408624:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143762.408661:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594162176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4068us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.408670:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7134 00000100:00100000:0.0:1746143762.410725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.412153:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.412166:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594162432 00000100:00100000:3.0:1746143762.412174:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594162432 00002000:00100000:3.0:1746143762.412222:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094763100 x1830963594162432/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.412232:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763100 with x1830963594162432 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.412236:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094763100 00000100:00100000:3.0:1746143762.412264:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594162688 00000100:00100000:3.0:1746143762.412267:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594162688 00002000:00100000:3.0:1746143762.412279:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88013691b100 x1830963594162688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.412285:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b100 with x1830963594162688 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.412288:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691b100 00000100:00100000:3.0:1746143762.412318:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6261 00000100:00100000:3.0:1746143762.412325:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594162432:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.413253:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6262 00000100:00100000:2.0:1746143762.413261:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594162688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.427645:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594162688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14377us (15498us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143762.427655:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6262 00002000:00100000:2.0:1746143762.427666:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88013691b100 x1830963594162688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.427681:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691b100 with x1830963594162688 ext(2097152->3145727) 00002000:00010000:2.0:1746143762.427686:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691b100 00000100:00100000:3.0:1746143762.429367:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594162432:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17038us (18644us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.429376:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6261 00002000:00100000:3.0:1746143762.429383:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094763100 x1830963594162432/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.429391:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763100 with x1830963594162432 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.429394:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094763100 00000100:00100000:0.0:1746143762.431569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.431654:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594162816 00000100:00100000:1.0:1746143762.431663:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594162816 00000100:00100000:1.0:1746143762.431714:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13329 00000100:00100000:1.0:1746143762.431721:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:31298:x1830963594162816:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.431736:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.431750:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77a1 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.431774:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.431786:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.431787:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.431790:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.431815:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.431825:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 28 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.431837:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594346240:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.431908:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.435716:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594346240:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143762.435721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143762.435741:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.435755:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bf600, rc 0) 00000100:00100000:1.0:1746143762.435791:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:31298:x1830963594162816:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4070us (4228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.435798:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13329 00000100:00100000:3.0:1746143762.435981:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594162944 00000100:00100000:3.0:1746143762.435987:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594162944 00002000:00100000:3.0:1746143762.436301:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2854911) req@ffff880136919500 x1830963594162944/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 504/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.436310:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919500 with x1830963594162944 ext(2097152->2854911) 00010000:00010000:3.0:1746143762.436316:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 29 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.436325:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 29 pid: 12618 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.436331:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136919500 00000100:00100000:3.0:1746143762.436626:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1777 00000100:00100000:3.0:1746143762.436633:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594162944:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143762.438718:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.439158:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594163072 00000100:00100000:1.0:1746143762.439165:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594163072 00000100:00100000:1.0:1746143762.439220:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13330 00000100:00100000:1.0:1746143762.439226:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31295:x1830963594163072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.439241:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.439255:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77a8 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.439277:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.439279:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.439283:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.439293:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.439302:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be800, rc 0) 00000100:00100000:1.0:1746143762.439346:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31295:x1830963594163072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 120us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.439352:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13330 00000100:00100000:3.0:1746143762.446765:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1963:x1830963594162944:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10124us (11035us total) trans 17179873083 rc 0/0 00000100:00100000:3.0:1746143762.446775:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1777 00002000:00100000:3.0:1746143762.446785:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2854911) req@ffff880136919500 x1830963594162944/t17179873083(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 504/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.446794:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919500 with x1830963594162944 ext(2097152->2854911) 00010000:00010000:3.0:1746143762.446802:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 32 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.446816:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 32 pid: 12618 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.446822:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136919500 00000100:00100000:0.0:1746143762.450437:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.450547:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594163200 00000100:00100000:2.0:1746143762.450556:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594163200 00010000:00010000:2.0:1746143762.450589:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 32 pid: 12618 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.450631:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7135 00000100:00100000:2.0:1746143762.450638:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1962:x1830963594163200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.450648:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.450667:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 32 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.450677:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 32 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.450695:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0e00/0xe984082ccd72f9d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2199551) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7715 expref: 32 pid: 12618 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.450721:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.450722:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.450728:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.450734:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.450746:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.450747:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.450750:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.450756:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.450786:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.450797:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594346368:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.450880:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.450887:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594346496:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.450902:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.454485:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594346368:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.454495:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594346496:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.454513:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.454552:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963594163200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3914us (4121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.454560:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7135 00000100:00100000:0.0:1746143762.459572:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.459612:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.459639:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.459655:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594163712 00000100:00100000:3.0:1746143762.459662:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594163712 00000100:00100000:0.0:1746143762.459676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143762.459701:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136918700 x1830963594163712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.459709:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918700 with x1830963594163712 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.459714:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136918700 00000100:00100000:3.0:1746143762.459734:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594163968 00000100:00100000:3.0:1746143762.459736:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594163968 00002000:00100000:3.0:1746143762.459749:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093804700 x1830963594163968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.459755:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963594163968 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.459757:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:3.0:1746143762.459765:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594163584 00000100:00100000:3.0:1746143762.459767:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594163584 00000100:00100000:2.0:1746143762.459769:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594164224 00000100:00100000:2.0:1746143762.459773:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594164224 00002000:00100000:3.0:1746143762.459775:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093805f80 x1830963594163584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.459781:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805f80 with x1830963594163584 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.459783:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805f80 00002000:00100000:2.0:1746143762.459791:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093807100 x1830963594164224/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143762.459793:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6263 00002000:00100000:2.0:1746143762.459798:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807100 with x1830963594164224 ext(3145728->4194303) 00000100:00100000:3.0:1746143762.459799:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594163712:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:2.0:1746143762.459800:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093807100 00000100:00100000:2.0:1746143762.459813:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6264 00000100:00100000:2.0:1746143762.459818:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594163968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.459892:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6265 00000100:00100000:1.0:1746143762.459899:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594163584:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.460827:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6266 00000100:00100000:2.0:1746143762.460833:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594164224:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.479585:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594163968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19759us (19964us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.479595:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6264 00002000:00100000:3.0:1746143762.479604:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093804700 x1830963594163968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.479613:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963594163968 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.479618:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:3.0:1746143762.480072:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963594163712:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20271us (20506us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.480077:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6263 00002000:00100000:3.0:1746143762.480083:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136918700 x1830963594163712/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.480088:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918700 with x1830963594163712 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.480091:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136918700 00000100:00100000:2.0:1746143762.485469:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594164224:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24628us (25783us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143762.485480:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6266 00002000:00100000:2.0:1746143762.485489:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093807100 x1830963594164224/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.485498:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807100 with x1830963594164224 ext(3145728->4194303) 00002000:00010000:2.0:1746143762.485503:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093807100 00000100:00100000:3.0:1746143762.489664:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594163584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29759us (30017us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.489673:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6265 00002000:00100000:3.0:1746143762.489684:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093805f80 x1830963594163584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.489694:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805f80 with x1830963594163584 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.489699:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805f80 00000100:00100000:0.0:1746143762.494108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.494733:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594164352 00000100:00100000:3.0:1746143762.494741:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594164352 00000100:00100000:3.0:1746143762.494784:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13331 00000100:00100000:3.0:1746143762.494791:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31304:x1830963594164352:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143762.494807:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.494822:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77af expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.494847:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.494855:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.494861:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.494863:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.494867:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 32 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.494891:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.494901:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.494918:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594346624:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.495017:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.495025:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 38 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.495032:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594346752:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.495049:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.498386:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.498454:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594164608 00000100:00100000:3.0:1746143762.498461:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594164608 00002000:00100000:3.0:1746143762.498498:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093804e00 x1830963594164608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.498506:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804e00 with x1830963594164608 ext(4194304->4755455) 00002000:00010000:3.0:1746143762.498511:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804e00 00000100:00100000:3.0:1746143762.498541:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6267 00000100:00100000:3.0:1746143762.498548:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594164608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.499736:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594346624:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.499746:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594346752:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.499767:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3100672->3145727] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 32 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.499781:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba39600, rc 0) 00000100:00100000:2.0:1746143762.499814:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31304:x1830963594164352:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5023us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.499822:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13331 00000100:00100000:2.0:1746143762.506772:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.506829:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594164864 00000100:00100000:0.0:1746143762.506836:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594164864 00002000:00100000:0.0:1746143762.506875:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093b04380 x1830963594164864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.506883:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04380 with x1830963594164864 ext(4194304->4755455) 00002000:00010000:0.0:1746143762.506888:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b04380 00000100:00100000:3.0:1746143762.507024:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6268 00000100:00100000:3.0:1746143762.507037:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594164864:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.507419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.508825:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594164992 00000100:00100000:2.0:1746143762.508831:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594164992 00010000:00010000:2.0:1746143762.508854:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.508886:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7136 00000100:00100000:2.0:1746143762.508892:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594164992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.508901:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.508917:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.508928:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.508947:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be800/0xe984082ccd72fa9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a8 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.508975:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.509008:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594164992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.509014:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7136 00000100:00100000:0.0:1746143762.511180:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.511316:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594165120 00000100:00100000:1.0:1746143762.511322:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594165120 00010000:00010000:1.0:1746143762.511346:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 39 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.511374:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7137 00000100:00100000:1.0:1746143762.511379:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594165120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.511391:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.511408:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 39 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.511417:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 39 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.511433:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf600/0xe984082ccd72fa95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77a1 expref: 39 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.511448:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.511450:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.511455:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.511463:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.511486:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.511496:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594346880:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143762.511541:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.512700:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594164608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14150us (14316us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143762.512708:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6267 00002000:00100000:3.0:1746143762.512717:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093804e00 x1830963594164608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.512725:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804e00 with x1830963594164608 ext(4194304->4755455) 00002000:00010000:3.0:1746143762.512729:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804e00 00000100:00100000:3.0:1746143762.516311:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594164864:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9272us (9538us total) trans 0 rc 561152/561152 00000100:00100000:3.0:1746143762.516321:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6268 00002000:00100000:3.0:1746143762.516332:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4755455) req@ffff880093b04380 x1830963594164864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 561152/561152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.516341:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04380 with x1830963594164864 ext(4194304->4755455) 00002000:00010000:3.0:1746143762.516346:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b04380 00000100:00100000:0.0:1746143762.517308:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.517365:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594165376 00000100:00100000:3.0:1746143762.517371:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594165376 00002000:00100000:3.0:1746143762.517400:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3100672->3104767) req@ffff880093807800 x1830963594165376/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.517408:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963594165376 ext(3100672->3104767) 00002000:00010000:3.0:1746143762.517411:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:3.0:1746143762.517436:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6269 00000100:00100000:3.0:1746143762.517442:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594165376:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.517555:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594165376:12345-192.168.202.48@tcp:3:cat.0 Request processed in 112us (248us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.517561:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6269 00002000:00100000:3.0:1746143762.517565:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3100672->3104767) req@ffff880093807800 x1830963594165376/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.517578:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963594165376 ext(3100672->3104767) 00002000:00010000:3.0:1746143762.517581:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:1.0:1746143762.517660:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594346880:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143762.517676:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.517699:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594165120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6320us (6524us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.517707:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7137 00000100:00100000:0.0:1746143762.520328:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.522283:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594165504 00000100:00100000:2.0:1746143762.522293:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594165504 00000100:00100000:2.0:1746143762.522347:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13332 00000100:00100000:2.0:1746143762.522355:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31304:x1830963594165504:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143762.522370:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.522383:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77b6 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.522407:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.522414:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.522420:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.522422:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.522424:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3334143] (req 3145728->3334143) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.522448:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.522458:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.522468:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594347008:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.522549:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.522557:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 31 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.522565:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594347136:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.522581:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.529693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.529876:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594165632 00000100:00100000:1.0:1746143762.529883:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594165632 00000100:00100000:1.0:1746143762.529919:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13333 00000100:00100000:1.0:1746143762.529925:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594165632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.529940:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.529953:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2bea00/0xe984082ccd72fab1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77bd expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.529994:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594347264:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143762.530067:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.530166:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594347008:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.530176:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594347136:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.530195:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3334143] (req 3145728->3334143) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.530205:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f600, rc 0) 00000100:00100000:2.0:1746143762.530236:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31304:x1830963594165504:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7881us (9913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.530242:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13332 00000100:00100000:0.0:1746143762.530846:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.530909:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594165760 00000100:00100000:1.0:1746143762.530913:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594165760 00010000:00010000:1.0:1746143762.530929:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.530957:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7138 00000100:00100000:1.0:1746143762.530962:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594165760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.530970:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.530988:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.530999:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.531015:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bec00/0xe984082ccd72fa8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a779a expref: 27 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.531028:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.531046:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594165760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.531051:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7138 00000100:00100000:1.0:1746143762.534209:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594347264:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143762.534247:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bea00/0xe984082ccd72fab1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77bd expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.534260:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bea00/0xe984082ccd72fab1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77bd expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.534269:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bea00, rc 0) 00000100:00100000:1.0:1746143762.534305:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594165632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4379us (4618us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143762.534312:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13333 00000100:00100000:0.0:1746143762.534935:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.534995:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594165888 00000100:00100000:2.0:1746143762.535001:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594165888 00010000:00010000:2.0:1746143762.535027:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.535060:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7139 00000100:00100000:2.0:1746143762.535066:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594165888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.535077:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.535091:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.535100:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.535117:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be200/0xe984082ccd72fa87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7793 expref: 32 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.535134:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.535136:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.535159:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.535168:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.535194:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 25 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.535204:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594347392:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.535274:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.537870:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.537997:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594347392:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.538018:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.538057:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594165888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2991us (3124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.538068:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7139 00000100:00100000:0.0:1746143762.538311:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.538928:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594166272 00000100:00100000:2.0:1746143762.538933:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594166272 00002000:00100000:2.0:1746143762.538965:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3330048->3334143) req@ffff880093ceaa00 x1830963594166272/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.538985:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceaa00 with x1830963594166272 ext(3330048->3334143) 00002000:00010000:2.0:1746143762.538989:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ceaa00 00000100:00100000:1.0:1746143762.539051:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594166016 00000100:00100000:1.0:1746143762.539055:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594166016 00000100:00100000:2.0:1746143762.539061:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6270 00000100:00100000:2.0:1746143762.539067:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594166272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.539076:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13334 00000100:00100000:1.0:1746143762.539079:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31298:x1830963594166016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.539087:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.539100:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77c4 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.539118:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.539134:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.539136:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.539158:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4751360->5242879] (req 4751360->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.539183:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.539194:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 26 pid: 9527 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.539203:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594347520:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.539234:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594166272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 167us (923us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143762.539240:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6270 00002000:00100000:2.0:1746143762.539244:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3330048->3334143) req@ffff880093ceaa00 x1830963594166272/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.539251:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ceaa00 with x1830963594166272 ext(3330048->3334143) 00010000:00010000:2.0:1746143762.539256:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 26 pid: 9527 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.539257:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00010000:00010000:2.0:1746143762.539264:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 26 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.539270:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ceaa00 00000100:00100000:1.0:1746143762.543325:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594347520:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143762.543354:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4751360->5242879] (req 4751360->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 32 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.543370:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bf400, rc 0) 00000100:00100000:1.0:1746143762.543420:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31298:x1830963594166016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4338us (5560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.543427:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13334 00000100:00100000:0.0:1746143762.544625:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.544698:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594166528 00000100:00100000:3.0:1746143762.544704:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594166528 00002000:00100000:3.0:1746143762.544742:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3334143) req@ffff880093ce8700 x1830963594166528/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.544751:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8700 with x1830963594166528 ext(3145728->3334143) 00010000:00010000:3.0:1746143762.544758:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 26 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.544770:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 26 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.544776:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ce8700 00000100:00100000:3.0:1746143762.545478:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1778 00000100:00100000:3.0:1746143762.545487:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594166528:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143762.548271:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ce8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594166528:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2778us (3641us total) trans 21474840404 rc 0/0 00000100:00100000:3.0:1746143762.548282:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1778 00002000:00100000:3.0:1746143762.548292:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3334143) req@ffff880093ce8700 x1830963594166528/t21474840404(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.548300:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ce8700 with x1830963594166528 ext(3145728->3334143) 00010000:00010000:3.0:1746143762.548309:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 28 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.548325:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 28 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.548330:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ce8700 00000100:00100000:0.0:1746143762.551300:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.551905:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594166656 00000100:00100000:2.0:1746143762.551914:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594166656 00010000:00010000:2.0:1746143762.551948:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 28 pid: 9527 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.551988:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7140 00000100:00100000:2.0:1746143762.551995:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594166656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.552009:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.552028:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 28 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.552039:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 28 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.552056:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3334143) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77b6 expref: 28 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.552087:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.552089:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.552096:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.552103:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.552131:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 31 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.552177:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594347648:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.552263:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.553731:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594347648:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.553748:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.553777:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594166656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1782us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.553787:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7140 00000100:00100000:0.0:1746143762.554553:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.554672:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594166784 00000100:00100000:1.0:1746143762.554677:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594166784 00000100:00100000:1.0:1746143762.554713:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13335 00000100:00100000:1.0:1746143762.554719:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594166784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.554733:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.554746:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf800/0xe984082ccd72fabf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77cb expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.554788:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594347776:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143762.554856:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.556126:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594347776:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143762.556169:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf800/0xe984082ccd72fabf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77cb expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.556181:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bf800/0xe984082ccd72fabf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77cb expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.556194:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bf800, rc 0) 00000100:00100000:1.0:1746143762.556243:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594166784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1523us (1690us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143762.556250:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13335 00000100:00100000:0.0:1746143762.557799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.557862:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594167040 00000100:00100000:3.0:1746143762.557869:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594167040 00002000:00100000:3.0:1746143762.557909:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4751360->4755455) req@ffff880093f01180 x1830963594167040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.557917:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01180 with x1830963594167040 ext(4751360->4755455) 00002000:00010000:3.0:1746143762.557921:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01180 00000100:00100000:3.0:1746143762.557955:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6271 00000100:00100000:3.0:1746143762.557961:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594167040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.558102:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594167040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 140us (306us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.558107:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6271 00002000:00100000:3.0:1746143762.558112:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4751360->4755455) req@ffff880093f01180 x1830963594167040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.558119:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01180 with x1830963594167040 ext(4751360->4755455) 00002000:00010000:3.0:1746143762.558122:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01180 00000100:00100000:2.0:1746143762.561277:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.561399:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594167296 00000100:00100000:1.0:1746143762.561407:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594167296 00000100:00100000:1.0:1746143762.561444:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3932 00000100:00100000:1.0:1746143762.561450:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+264:31298:x1830963594167296:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143762.561620:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:31298:x1830963594167296:12345-192.168.202.48@tcp:35:cat.0 Request processed in 169us (351us total) trans 8589943493 rc 0/0 00000100:00100000:0.0:1746143762.561621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.561627:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3932 00000100:00100000:0.0:1746143762.561642:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594167552 00000100:00100000:0.0:1746143762.561645:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594167552 00000100:00100000:0.0:1746143762.561664:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9173 00000100:00100000:0.0:1746143762.561669:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+265:31309:x1830963594167552:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143762.561677:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.561694:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72fac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77d2 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.561803:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561815:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561824:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561835:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561841:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561846:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561930:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1000/0xe984082ccd72fadb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561938:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1000/0xe984082ccd72fadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561944:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1000/0xe984082ccd72fadb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:0.0:1746143762.561952:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:0.0:1746143762.561991:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.561996:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562004:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562009:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03f1c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143762.562011:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562017:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562024:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143762.562026:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143762.562029:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562033:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1c00/0xe984082ccd72facd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562055:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562059:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562063:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562066:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a03f1a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143762.562068:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562072:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562080:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ba5a200) 00010000:00010000:0.0:1746143762.562081:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143762.562084:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562088:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1a00/0xe984082ccd72fad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143762.562113:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1200/0xe984082ccd72fac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77d2 expref: 268 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.562128:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1000/0xe984082ccd72fadb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77d2 expref: 267 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.562133:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143762.562134:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143762.562136:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03f1000, rc 0) 00000100:00100000:0.0:1746143762.562195:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:31309:x1830963594167552:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 525us (572us total) trans 8589943494 rc 0/0 00000100:00100000:0.0:1746143762.562200:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9173 00000100:00100000:0.0:1746143762.564329:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.565052:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594167680 00000100:00100000:2.0:1746143762.565060:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594167680 00000100:00100000:2.0:1746143762.565115:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 729 00000100:00100000:2.0:1746143762.565123:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1963:x1830963594167680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.565136:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.565526:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03f1000/0xe984082ccd72fadb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77d2 expref: 267 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.565558:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.565562:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.565598:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:1963:x1830963594167680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 476us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.565604:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 729 00000100:00100000:0.0:1746143762.654697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.654734:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.654765:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.654792:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594167936 00000100:00100000:0.0:1746143762.654799:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.654800:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594167936 00000100:00100000:0.0:1746143762.654811:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.654826:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594168448 00000100:00100000:0.0:1746143762.654828:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594168448 00000100:00100000:3.0:1746143762.654833:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594168192 00000100:00100000:3.0:1746143762.654834:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594168192 00000100:00100000:0.0:1746143762.654844:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594168064 00000100:00100000:0.0:1746143762.654846:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594168064 00000100:00100000:3.0:1746143762.654847:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 230 00000100:00100000:3.0:1746143762.654853:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594167936:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1746143762.654856:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 385 00000100:00100000:0.0:1746143762.654859:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594168448:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1746143762.654908:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594168448:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.654914:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 385 00000100:00100000:3.0:1746143762.654921:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594167936:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.654925:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 230 00000100:00100000:0.0:1746143762.654925:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 386 00000100:00100000:0.0:1746143762.654929:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963594168064:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143762.654933:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 231 00000100:00100000:3.0:1746143762.654937:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594168192:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1746143762.654945:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963594168064:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 15us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.654950:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 386 00000100:00100000:3.0:1746143762.654952:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594168192:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 16us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.654956:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 231 00000100:00100000:3.0:1746143762.654979:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594167808 00000100:00100000:3.0:1746143762.654981:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594167808 00000100:00100000:0.0:1746143762.654986:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.654996:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 223 00000100:00100000:0.0:1746143762.654999:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594168320 00000100:00100000:3.0:1746143762.655000:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963594167808:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:0.0:1746143762.655001:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594168320 00000100:00100000:0.0:1746143762.655014:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 387 00000100:00100000:3.0:1746143762.655016:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963594167808:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 17us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.655017:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594168320:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143762.655020:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 223 00000100:00100000:0.0:1746143762.655034:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594168320:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 16us (47us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.655038:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 387 00000100:00100000:0.0:1746143762.686377:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.686483:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594168704 00000100:00100000:2.0:1746143762.686491:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594168704 00000100:00100000:2.0:1746143762.686540:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9174 00000100:00100000:2.0:1746143762.686547:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+266:31313:x1830963594168704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.686566:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.686581:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72fae9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77d9 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.686672:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686684:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686698:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686709:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686715:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686720:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686811:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72fafe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686819:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72fafe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686829:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72fafe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143762.686838:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143762.686905:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686911:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686916:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686920:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8e600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143762.686923:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686929:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686939:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143762.686941:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143762.686944:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686955:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8e600/0xe984082ccd72faf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686970:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686974:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686979:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686984:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa8f600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143762.686986:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686990:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.686995:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd200) 00010000:00010000:2.0:1746143762.686997:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143762.686998:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.687004:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f600/0xe984082ccd72faf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143762.687033:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f400/0xe984082ccd72fae9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77d9 expref: 269 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.687043:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72fafe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77d9 expref: 268 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.687049:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.687050:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143762.687052:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa8f200, rc 0) 00000100:00100000:2.0:1746143762.687087:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:31313:x1830963594168704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 540us (718us total) trans 8589943495 rc 0/0 00000100:00100000:2.0:1746143762.687093:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9174 00000100:00100000:0.0:1746143762.702275:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.702577:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594168832 00000100:00100000:1.0:1746143762.702589:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594168832 00000100:00100000:1.0:1746143762.702642:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13336 00000100:00100000:1.0:1746143762.702649:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594168832:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.702663:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.702677:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2bfa00/0xe984082ccd72fb0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77e0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.702722:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594347904:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143762.702807:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.702874:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.702988:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594168960 00000100:00100000:1.0:1746143762.702991:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594168960 00000100:00100000:1.0:1746143762.703016:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 730 00000100:00100000:1.0:1746143762.703021:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:1963:x1830963594168960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.703028:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.703046:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa8f200/0xe984082ccd72fafe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77d9 expref: 268 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.703077:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.703080:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.703107:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1963:x1830963594168960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.703112:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 730 00000100:00100000:1.0:1746143762.705386:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594347904:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143762.705609:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bfa00/0xe984082ccd72fb0c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e0 expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.705631:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bfa00/0xe984082ccd72fb0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e0 expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.705641:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bfa00, rc 0) 00000100:00100000:1.0:1746143762.705698:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594168832:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3047us (3429us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143762.705706:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13336 00000100:00100000:0.0:1746143762.718525:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.718667:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594169088 00000100:00100000:1.0:1746143762.718674:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594169088 00000100:00100000:1.0:1746143762.718721:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13337 00000100:00100000:1.0:1746143762.718728:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:31309:x1830963594169088:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143762.718743:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.718756:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77e7 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.718782:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.718788:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.718790:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.718793:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3727360->4194303] (req 3727360->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.718817:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 30 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.718832:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 30 pid: 9527 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.718842:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594348032:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.718910:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.721758:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594348032:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143762.721782:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3727360->4194303] (req 3727360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.721796:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be000, rc 0) 00000100:00100000:1.0:1746143762.721842:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:31309:x1830963594169088:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3113us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.721849:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13337 00000100:00100000:0.0:1746143762.722304:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.722635:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594169216 00000100:00100000:2.0:1746143762.722641:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594169216 00002000:00100000:2.0:1746143762.722673:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3100672->3145727) req@ffff880130fd6300 x1830963594169216/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.722681:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6300 with x1830963594169216 ext(3100672->3145727) 00010000:00010000:2.0:1746143762.722687:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 31 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.722698:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 31 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.722705:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd6300 00000100:00100000:3.0:1746143762.723250:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1779 00000100:00100000:3.0:1746143762.723260:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594169216:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143762.724925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.725977:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594169472 00000100:00100000:3.0:1746143762.725984:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594169472 00002000:00100000:3.0:1746143762.726011:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880130fd5500 x1830963594169472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.726019:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5500 with x1830963594169472 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.726023:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5500 00000100:00100000:3.0:1746143762.726050:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6272 00000100:00100000:3.0:1746143762.726055:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594169472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.726635:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1965:x1830963594169216:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2674us (3627us total) trans 17179873084 rc 0/0 00000100:00100000:2.0:1746143762.726650:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1779 00002000:00100000:2.0:1746143762.726659:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3100672->3145727) req@ffff880130fd6300 x1830963594169216/t17179873084(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.726666:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6300 with x1830963594169216 ext(3100672->3145727) 00010000:00010000:2.0:1746143762.726672:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 33 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.726684:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 33 pid: 9527 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.726689:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd6300 00000100:00100000:0.0:1746143762.733265:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.734418:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594169600 00000100:00100000:2.0:1746143762.734427:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594169600 00010000:00010000:2.0:1746143762.734461:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 33 pid: 9527 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.736463:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7141 00000100:00100000:2.0:1746143762.736477:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1964:x1830963594169600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.736494:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.736518:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 33 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.736532:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 33 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.736556:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba39600/0xe984082ccd72faa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3100672->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77af expref: 33 pid: 9527 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.736587:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.736589:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.736596:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.736603:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.736634:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.736645:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594348160:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143762.736723:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.737861:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594169472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11801us (12936us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.737870:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6272 00002000:00100000:3.0:1746143762.737880:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880130fd5500 x1830963594169472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.737888:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5500 with x1830963594169472 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.737892:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd5500 00000100:00100000:2.0:1746143762.741529:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594348160:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143762.741550:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.742699:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594169600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6222us (9436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.742710:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7141 00000100:00100000:0.0:1746143762.746054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.746724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.746804:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594169984 00000100:00100000:3.0:1746143762.746812:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594169984 00002000:00100000:3.0:1746143762.746851:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880130fd7480 x1830963594169984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143762.747036:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594170112 00000100:00100000:2.0:1746143762.747040:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594170112 00002000:00100000:2.0:1746143762.747059:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880130fd6d80 x1830963594170112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.747072:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6d80 with x1830963594170112 ext(3145728->4194303) 00002000:00010000:2.0:1746143762.747077:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd6d80 00000100:00100000:2.0:1746143762.747105:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6273 00000100:00100000:2.0:1746143762.747112:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594170112:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:3.0:1746143762.747179:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7480 with x1830963594169984 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.747183:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7480 00000100:00100000:3.0:1746143762.748448:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6274 00000100:00100000:3.0:1746143762.748458:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594169984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143762.748490:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.748509:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594170368 00000100:00100000:1.0:1746143762.748513:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594170368 00002000:00100000:1.0:1746143762.748532:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3727359) req@ffff880130fd7800 x1830963594170368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.748538:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7800 with x1830963594170368 ext(3145728->3727359) 00002000:00010000:1.0:1746143762.748541:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7800 00000100:00100000:1.0:1746143762.748562:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6275 00000100:00100000:1.0:1746143762.748567:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594170368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143762.758567:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.758642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.758668:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594170624 00000100:00100000:3.0:1746143762.758680:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594170624 00002000:00100000:3.0:1746143762.758724:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4751359) req@ffff880130fd4380 x1830963594170624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.758740:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963594170624 ext(4194304->4751359) 00002000:00010000:3.0:1746143762.758744:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4380 00000100:00100000:3.0:1746143762.758781:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6276 00000100:00100000:3.0:1746143762.758789:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963594170624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.759275:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594170752 00000100:00100000:1.0:1746143762.759283:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594170752 00000100:00100000:1.0:1746143762.759342:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13338 00000100:00100000:1.0:1746143762.759349:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594170752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.759364:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.759383:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77ee expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.759418:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.759421:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.759434:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.759450:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.759462:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bfe00, rc 0) 00000100:00100000:1.0:1746143762.759530:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594170752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 181us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.759537:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13338 00000100:00100000:0.0:1746143762.759913:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.761000:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594170880 00000100:00100000:3.0:1746143762.761007:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594170880 00000100:00100000:3.0:1746143762.761053:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13339 00000100:00100000:3.0:1746143762.761060:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594170880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143762.761072:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.761086:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba38200/0xe984082ccd72fb21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77f5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143762.761127:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594348288:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.761219:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.762002:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.762047:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594171008 00000100:00100000:3.0:1746143762.762052:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594171008 00000100:00100000:3.0:1746143762.762082:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13340 00000100:00100000:3.0:1746143762.762088:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31309:x1830963594171008:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143762.762095:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.762104:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a77fc expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.762122:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 37 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.762131:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.762136:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.762160:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.762163:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 37 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.762235:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 27 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.762245:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 27 pid: 25369 timeout: 941 lvb_type: 1 00000100:00100000:3.0:1746143762.762254:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594348416:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.762310:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 37 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.762317:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 37 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.762324:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594348544:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.762340:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094e91600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.762589:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963594170112:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15476us (15864us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.762596:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6273 00002000:00100000:3.0:1746143762.762604:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880130fd6d80 x1830963594170112/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.762612:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6d80 with x1830963594170112 ext(3145728->4194303) 00010000:00010000:3.0:1746143762.762617:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.762625:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.762631:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130fd6d80 00000100:00100000:1.0:1746143762.765059:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594170368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16481us (16564us total) trans 0 rc 581632/581632 00000100:00100000:1.0:1746143762.765526:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6275 00002000:00100000:1.0:1746143762.765539:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3727359) req@ffff880130fd7800 x1830963594170368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 581632/581632 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.765548:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7800 with x1830963594170368 ext(3145728->3727359) 00002000:00010000:1.0:1746143762.765554:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7800 00000100:00100000:0.0:1746143762.766475:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.767337:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594348416:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.767349:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594348544:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143762.767379:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.767397:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba38a00, rc 0) 00000100:00100000:3.0:1746143762.767432:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31309:x1830963594171008:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5344us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.767440:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13340 00000100:00100000:2.0:1746143762.767520:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594171136 00000100:00100000:2.0:1746143762.767527:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594171136 00010000:00010000:2.0:1746143762.767556:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 28 pid: 25369 timeout: 941 lvb_type: 1 00000100:00100000:2.0:1746143762.767592:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7142 00000100:00100000:2.0:1746143762.767598:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594171136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143762.767612:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143762.767628:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 28 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.767638:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 28 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.767661:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77ee expref: 28 pid: 25369 timeout: 941 lvb_type: 1 00010000:00010000:2.0:1746143762.767676:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143762.767694:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594171136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 96us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.767700:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7142 00000100:00100000:2.0:1746143762.767760:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594348288:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143762.767776:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ba38200/0xe984082ccd72fb21 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77f5 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.767784:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba38200/0xe984082ccd72fb21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77f5 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.767792:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba38200, rc 0) 00000100:00100000:2.0:1746143762.767809:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594170880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6750us (7898us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.767814:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13339 00000100:00100000:2.0:1746143762.769619:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594169984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21156us (23563us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143762.769629:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6274 00002000:00100000:2.0:1746143762.769638:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880130fd7480 x1830963594169984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143762.769674:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00100000:2.0:1746143762.769729:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7480 with x1830963594169984 ext(2097152->3145727) 00002000:00010000:2.0:1746143762.769736:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7480 00000100:00100000:3.0:1746143762.770639:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594170624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11847us (12079us total) trans 0 rc 557056/557056 00000100:00100000:3.0:1746143762.770646:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6276 00002000:00100000:3.0:1746143762.770651:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4751359) req@ffff880130fd4380 x1830963594170624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 557056/557056 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.770658:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963594170624 ext(4194304->4751359) 00010000:00010000:3.0:1746143762.770667:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 33 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.770679:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 33 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.770686:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130fd4380 00000100:00100000:0.0:1746143762.772663:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.772912:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594171264 00000100:00100000:2.0:1746143762.772920:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594171264 00000100:00100000:2.0:1746143762.772970:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13341 00000100:00100000:2.0:1746143762.772976:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:31313:x1830963594171264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.772993:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.773010:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7803 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.773038:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.773041:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.773047:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.773062:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.773073:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0835200, rc 0) 00000100:00100000:2.0:1746143762.773109:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31313:x1830963594171264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 133us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.773114:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13341 00000100:00100000:0.0:1746143762.776797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.777471:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594171392 00000100:00100000:1.0:1746143762.777481:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594171392 00000100:00100000:0.0:1746143762.777516:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143762.777522:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.777550:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7143 00000100:00100000:1.0:1746143762.777556:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594171392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.777571:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.777596:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.777608:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.777629:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2bf400/0xe984082ccd72fab8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4751360->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77c4 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.777649:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.777651:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.777657:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 33 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.777665:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 33 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.777700:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 33 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.777717:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594348672:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143762.777789:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.777842:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594171648 00000100:00100000:3.0:1746143762.777851:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594171648 00002000:00100000:3.0:1746143762.778000:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800930d0380 x1830963594171648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.778008:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0380 with x1830963594171648 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.778012:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0380 00000100:00100000:3.0:1746143762.778371:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6277 00000100:00100000:3.0:1746143762.778378:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963594171648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.779294:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594348672:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143762.779310:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.779338:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594171392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1782us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.779346:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7143 00000100:00100000:0.0:1746143762.780331:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.780359:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.781656:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594171776 00000100:00100000:2.0:1746143762.781665:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594171776 00000100:00100000:2.0:1746143762.781723:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594171904 00000100:00100000:2.0:1746143762.781727:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594171904 00000100:00100000:2.0:1746143762.781762:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13342 00000100:00100000:2.0:1746143762.781771:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594171776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.781789:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.781809:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0834a00/0xe984082ccd72fb36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a780a expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.781872:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594348800:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143762.781966:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.781980:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13343 00000100:00100000:2.0:1746143762.781985:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594171904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.781993:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.782003:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0834000/0xe984082ccd72fb3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7811 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.782027:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594348928:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143762.782059:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.791015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:2.0:1746143762.791320:0:9527:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size: 4755392 -> 4771552 00000100:00100000:2.0:1746143762.791343:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594348800:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.791375:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594172160 00010000:00010000:2.0:1746143762.791381:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0834a00/0xe984082ccd72fb36 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a780a expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143762.791383:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594172160 00010000:00010000:2.0:1746143762.791395:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0834a00/0xe984082ccd72fb36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a780a expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.791409:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0834a00, rc 0) 00000100:00100000:2.0:1746143762.791457:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594171776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9687us (11126us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.791465:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13342 00000100:00100000:2.0:1746143762.791516:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594348928:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143762.791530:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0834000/0xe984082ccd72fb3d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7811 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.791538:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0834000/0xe984082ccd72fb3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7811 expref: 33 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.791549:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0834000, rc 0) 00000100:00100000:2.0:1746143762.791565:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1964:x1830963594171904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9580us (11205us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.791570:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13343 00000100:00100000:3.0:1746143762.791592:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3933 00000100:00100000:3.0:1746143762.791603:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:31309:x1830963594172160:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143762.791944:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:31309:x1830963594172160:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 344us (940us total) trans 8589943496 rc 0/0 00000100:00100000:3.0:1746143762.791951:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3933 00000100:00100000:2.0:1746143762.794026:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594171648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15640us (16502us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143762.794036:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6277 00002000:00100000:2.0:1746143762.794047:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800930d0380 x1830963594171648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.794056:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0380 with x1830963594171648 ext(3145728->4194303) 00002000:00010000:2.0:1746143762.794061:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d0380 00000100:00100000:0.0:1746143762.802568:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.802621:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.802738:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594172288 00000100:00100000:2.0:1746143762.802748:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594172288 00000100:00100000:2.0:1746143762.802791:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594172416 00000100:00100000:2.0:1746143762.802793:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594172416 00000100:00100000:2.0:1746143762.802825:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13344 00000100:00100000:2.0:1746143762.802833:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31318:x1830963594172288:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143762.802856:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.802876:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7818 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.802890:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13345 00000100:00100000:1.0:1746143762.802901:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31317:x1830963594172416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.802910:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.802918:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.802921:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.802924:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.802925:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2433024->2859007] (req 2433024->2859007) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.802935:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a781f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.802949:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.802951:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143762.802957:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 38 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.802958:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.802970:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 38 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.802971:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.802980:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2ce00, rc 0) 00000100:00100000:2.0:1746143762.802985:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594349056:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143762.803040:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31317:x1830963594172416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 140us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.803051:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13345 00000100:00100000:2.0:1746143762.803805:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.805760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.806054:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594172544 00000100:00100000:2.0:1746143762.806063:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594172544 00000100:00100000:0.0:1746143762.808075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.808335:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594172800 00000100:00100000:3.0:1746143762.808342:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594172800 00002000:00100000:3.0:1746143762.808389:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305cbb80 x1830963594172800/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.808398:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cbb80 with x1830963594172800 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.808405:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305cbb80 00000100:00100000:3.0:1746143762.808427:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6278 00000100:00100000:3.0:1746143762.808435:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594172800:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143762.809391:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13346 00000100:00100000:2.0:1746143762.809403:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963594172544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.809415:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.809434:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0835c00/0xe984082ccd72fb52 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7826 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.809490:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594349184:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143762.809504:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594349056:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143762.809528:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2433024->2859007] (req 2433024->2859007) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143762.809543:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0835400, rc 0) 00000100:00100000:0.0:1746143762.809568:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:31318:x1830963594172288:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6737us (7011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.809575:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13344 00000100:00100000:2.0:1746143762.809659:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.815594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.816911:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594349184:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143762.816926:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594172928 00000100:00100000:3.0:1746143762.816935:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594172928 00010000:00010000:2.0:1746143762.816950:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0835c00/0xe984082ccd72fb52 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7826 expref: 34 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.816965:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0835c00/0xe984082ccd72fb52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7826 expref: 34 pid: 2839 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746143762.816979:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3727360->4194303) req@ffff8800a54e8700 x1830963594172928/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143762.816994:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0835c00, rc 0) 00000100:00100000:2.0:1746143762.817044:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963594172544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7642us (11289us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.817053:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13346 00002000:00100000:3.0:1746143762.817644:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8700 with x1830963594172928 ext(3727360->4194303) 00010000:00010000:3.0:1746143762.817655:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 39 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.817668:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 39 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.817674:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a54e8700 00000100:00100000:3.0:1746143762.817694:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1780 00000100:00100000:3.0:1746143762.817703:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594172928:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143762.819935:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594172800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11492us (11861us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.819945:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6278 00002000:00100000:3.0:1746143762.819955:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305cbb80 x1830963594172800/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.819964:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cbb80 with x1830963594172800 ext(2097152->3145727) 00002000:00010000:3.0:1746143762.819968:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305cbb80 00000100:00100000:2.0:1746143762.821222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.821258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.822880:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594173056 00000100:00100000:0.0:1746143762.822891:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594173056 00000100:00100000:0.0:1746143762.823032:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594173184 00000100:00100000:0.0:1746143762.823035:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594173184 00000100:00100000:0.0:1746143762.823075:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13347 00000100:00100000:0.0:1746143762.823083:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594173056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143762.823103:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143762.823115:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13348 00010000:00010000:0.0:1746143762.823121:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2be400/0xe984082ccd72fb59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a782d expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.823123:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594173184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.823131:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.823154:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff2dc00/0xe984082ccd72fb60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7834 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.823188:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594349440:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143762.823189:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594349312:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143762.823278:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.823333:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.832429:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594349312:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143762.832429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143762.832463:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2be400/0xe984082ccd72fb59 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a782d expref: 34 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.832482:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2be400/0xe984082ccd72fb59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a782d expref: 34 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.832498:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2be400, rc 0) 00000100:00100000:1.0:1746143762.832538:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594173056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9456us (11333us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143762.832545:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13347 00000100:00100000:1.0:1746143762.832572:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594173312 00000100:00100000:1.0:1746143762.832580:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594173312 00000100:00100000:1.0:1746143762.832607:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13349 00000100:00100000:1.0:1746143762.832612:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:31317:x1830963594173312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.832628:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.832642:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a783b expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.832663:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143762.832667:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2433024->2859007] (req 2433024->2859007) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.832672:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143762.832674:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.832702:0:2839:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2433024->2859007] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.832712:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.832719:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2ca00, rc 0) 00000100:00100000:1.0:1746143762.832733:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:31317:x1830963594173312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.832738:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13349 00000100:00100000:1.0:1746143762.832771:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594349440:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143762.832785:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff2dc00/0xe984082ccd72fb60 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7834 expref: 42 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.832794:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2dc00/0xe984082ccd72fb60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7834 expref: 42 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.832800:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2dc00, rc 0) 00000100:00100000:1.0:1746143762.832815:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594173184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9694us (11556us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143762.832819:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13348 00000100:00100000:3.0:1746143762.834735:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594172928:12345-192.168.202.48@tcp:4:cat.0 Request processed in 17028us (19145us total) trans 17179873085 rc 0/0 00000100:00100000:3.0:1746143762.834749:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1780 00002000:00100000:3.0:1746143762.834760:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (3727360->4194303) req@ffff8800a54e8700 x1830963594172928/t17179873085(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.834770:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8700 with x1830963594172928 ext(3727360->4194303) 00010000:00010000:3.0:1746143762.834779:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 41 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.834794:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 41 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.834801:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a54e8700 00000100:00100000:0.0:1746143762.839287:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.839420:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594173440 00000100:00100000:1.0:1746143762.839429:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594173440 00000100:00100000:1.0:1746143762.839487:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13350 00000100:00100000:1.0:1746143762.839495:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963594173440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143762.839514:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.839532:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff2d000/0xe984082ccd72fb6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7842 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.839592:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594349696:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143762.839686:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.844721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.844750:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.844816:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594173696 00000100:00100000:1.0:1746143762.844825:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594173696 00010000:00010000:1.0:1746143762.844861:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 41 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.844885:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7144 00000100:00100000:1.0:1746143762.844892:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963594173696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.844906:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.844927:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 41 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.844943:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 41 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.844964:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2be000/0xe984082ccd72fb13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77e7 expref: 41 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.844981:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.844983:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.844990:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.844998:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.845033:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.845043:0:7151:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 33 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.845054:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594349824:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143762.845119:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.845120:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594173568 00000100:00100000:0.0:1746143762.845125:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594173568 00000100:00100000:0.0:1746143762.845171:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13351 00000100:00100000:0.0:1746143762.845176:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963594173568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143762.845190:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.845201:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb75 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7849 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143762.845239:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594349952:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143762.845267:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143762.845559:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594349696:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143762.845582:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff2d000/0xe984082ccd72fb6e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7842 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.845593:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff2d000/0xe984082ccd72fb6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7842 expref: 34 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.845979:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff2d000, rc 0) 00000100:00100000:3.0:1746143762.846573:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963594173440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7075us (7292us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143762.846581:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13350 00000100:00100000:0.0:1746143762.851568:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.851693:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594349952:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143762.851733:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb75 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7849 expref: 42 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.851749:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2bfe00/0xe984082ccd72fb75 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7849 expref: 42 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143762.853689:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594173952 00000100:00100000:3.0:1746143762.853702:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594173952 00002000:00100000:3.0:1746143762.853757:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2433024->2437119) req@ffff880130fd6a00 x1830963594173952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.853769:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963594173952 ext(2433024->2437119) 00010000:00010000:3.0:1746143762.853779:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.853794:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.853801:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd6a00 00000100:00100000:3.0:1746143762.853836:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1781 00000100:00100000:3.0:1746143762.853845:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594173952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.854034:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594173952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 189us (2478us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.854047:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1781 00002000:00100000:3.0:1746143762.854053:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2433024->2437119) req@ffff880130fd6a00 x1830963594173952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.854061:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963594173952 ext(2433024->2437119) 00010000:00010000:3.0:1746143762.854066:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:3.0:1746143762.854075:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:3.0:1746143762.854080:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd6a00 00010000:00010000:2.0:1746143762.854183:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2bfe00, rc 0) 00000100:00100000:2.0:1746143762.854229:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963594173568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9051us (9519us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.854235:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13351 00000100:00100000:1.0:1746143762.854342:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594349824:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143762.854358:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.854379:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594173696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9487us (9628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.854388:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7144 00000100:00100000:2.0:1746143762.860792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.860917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.860965:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594174464 00000100:00100000:0.0:1746143762.860975:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594174464 00002000:00100000:0.0:1746143762.861023:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2854912->2859007) req@ffff880094c12a00 x1830963594174464/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.861033:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963594174464 ext(2854912->2859007) 00010000:00010000:0.0:1746143762.861042:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.861057:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:0.0:1746143762.861062:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c12a00 00000100:00100000:0.0:1746143762.861098:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1782 00000100:00100000:0.0:1746143762.861106:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594174464:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.861328:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594174208 00000100:00100000:0.0:1746143762.861332:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594174464:12345-192.168.202.48@tcp:3:cat.0 Request processed in 226us (413us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143762.861333:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594174208 00000100:00100000:0.0:1746143762.861339:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1782 00002000:00100000:0.0:1746143762.861344:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x358:0x0] (2854912->2859007) req@ffff880094c12a00 x1830963594174464/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.861351:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963594174464 ext(2854912->2859007) 00010000:00010000:0.0:1746143762.861356:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.861359:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3934 00000100:00100000:3.0:1746143762.861364:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c631050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:31313:x1830963594174208:12345-192.168.202.48@tcp:35:cat.0 00010000:00010000:0.0:1746143762.861364:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:0.0:1746143762.861369:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c12a00 00000100:00100000:3.0:1746143762.861539:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c631050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:31313:x1830963594174208:12345-192.168.202.48@tcp:35:cat.0 Request processed in 174us (758us total) trans 8589943497 rc 0/0 00000100:00100000:3.0:1746143762.861545:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3934 00000100:00100000:0.0:1746143762.865656:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.865793:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594174720 00000100:00100000:2.0:1746143762.865802:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594174720 00002000:00100000:2.0:1746143762.865859:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2433024->2859007) req@ffff880130fd5880 x1830963594174720/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.865875:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5880 with x1830963594174720 ext(2433024->2859007) 00010000:00010000:2.0:1746143762.865884:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.865898:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 34 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.865905:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd5880 00000100:00100000:2.0:1746143762.865925:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1783 00000100:00100000:2.0:1746143762.865933:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1965:x1830963594174720:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143762.875571:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1965:x1830963594174720:12345-192.168.202.48@tcp:4:cat.0 Request processed in 9627us (9916us total) trans 17179873086 rc 0/0 00000100:00100000:2.0:1746143762.875583:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1783 00002000:00100000:2.0:1746143762.875594:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2433024->2859007) req@ffff880130fd5880 x1830963594174720/t17179873086(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.875603:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd5880 with x1830963594174720 ext(2433024->2859007) 00010000:00010000:2.0:1746143762.875613:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:2.0:1746143762.875628:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00002000:00010000:2.0:1746143762.875634:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130fd5880 00000100:00100000:0.0:1746143762.878675:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.880357:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594174848 00000100:00100000:1.0:1746143762.880370:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594174848 00010000:00010000:1.0:1746143762.880416:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.880447:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7145 00000100:00100000:1.0:1746143762.880453:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1963:x1830963594174848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.880470:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.880495:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.880506:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.880530:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835400/0xe984082ccd72fb44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2859007) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7818 expref: 36 pid: 25369 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.880562:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.880564:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.880572:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.880579:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.880611:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 35 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.880624:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594350080:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143762.880846:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.883968:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594350080:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143762.883989:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.884034:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1963:x1830963594174848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3580us (5368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.884045:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7145 00000100:00100000:0.0:1746143762.890421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.891739:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594175104 00000100:00100000:2.0:1746143762.891754:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594175104 00000100:00100000:0.0:1746143762.891777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143762.891800:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0ad500 x1830963594175104/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143762.891808:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143762.891810:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad500 with x1830963594175104 ext(2097152->3145727) 00002000:00010000:2.0:1746143762.891815:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad500 00000100:00100000:2.0:1746143762.891842:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594175488 00000100:00100000:2.0:1746143762.891844:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594175488 00002000:00100000:2.0:1746143762.891852:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f0ad880 x1830963594175488/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.891858:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963594175488 ext(3145728->4194303) 00002000:00010000:2.0:1746143762.891861:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad880 00000100:00100000:2.0:1746143762.892009:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594175616 00000100:00100000:2.0:1746143762.892012:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594175616 00002000:00100000:2.0:1746143762.892026:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ae300 x1830963594175616/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143762.892033:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963594175616 ext(3145728->4194303) 00002000:00010000:2.0:1746143762.892035:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:1.0:1746143762.892159:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6279 00000100:00100000:3.0:1746143762.892168:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6280 00000100:00100000:1.0:1746143762.892169:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1964:x1830963594175104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143762.892178:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:1964:x1830963594175488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.892239:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6281 00000100:00100000:1.0:1746143762.893454:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594175616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.903588:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:1964:x1830963594175104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11407us (13162us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143762.903603:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6279 00002000:00100000:1.0:1746143762.903617:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0ad500 x1830963594175104/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.903627:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad500 with x1830963594175104 ext(2097152->3145727) 00002000:00010000:1.0:1746143762.903633:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad500 00000100:00100000:3.0:1746143762.906888:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1964:x1830963594175488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14702us (15103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143762.906901:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6280 00002000:00100000:3.0:1746143762.906914:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f0ad880 x1830963594175488/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143762.906924:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963594175488 ext(3145728->4194303) 00002000:00010000:3.0:1746143762.906930:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad880 00000100:00100000:1.0:1746143762.908386:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594175616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16131us (16567us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143762.908397:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6281 00002000:00100000:1.0:1746143762.908406:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ae300 x1830963594175616/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.908415:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963594175616 ext(3145728->4194303) 00002000:00010000:1.0:1746143762.908420:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:0.0:1746143762.913115:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.915260:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594175744 00000100:00100000:2.0:1746143762.915273:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594175744 00000100:00100000:2.0:1746143762.915336:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13352 00000100:00100000:2.0:1746143762.915342:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594175744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.915360:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.915376:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135180e00/0xe984082ccd72fb7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7850 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143762.915427:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594350208:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143762.915516:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.917172:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594350208:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143762.917207:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135180e00/0xe984082ccd72fb7c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7850 expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.917229:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135180e00/0xe984082ccd72fb7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7850 expref: 29 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143762.917247:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135180e00, rc 0) 00000100:00100000:2.0:1746143762.917295:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594175744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1953us (4197us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143762.917303:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13352 00000100:00100000:0.0:1746143762.919336:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.919396:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594175872 00000100:00100000:2.0:1746143762.919404:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594175872 00000100:00100000:2.0:1746143762.919453:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13353 00000100:00100000:2.0:1746143762.919459:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31317:x1830963594175872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143762.919476:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.919492:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7857 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.919528:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.919536:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.919538:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143762.919541:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.919574:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 32 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.919586:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 32 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.919597:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594350336:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.919674:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.922651:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594350336:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143762.922691:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.922712:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181000, rc 0) 00000100:00100000:2.0:1746143762.923375:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31317:x1830963594175872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3913us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.923385:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13353 00000100:00100000:0.0:1746143762.923670:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.923772:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176000 00000100:00100000:1.0:1746143762.923779:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176000 00002000:00100000:1.0:1746143762.923826:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771551) req@ffff88012fc24e00 x1830963594176000/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.923835:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24e00 with x1830963594176000 ext(4194304->4771551) 00010000:00010000:1.0:1746143762.923843:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 33 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.923855:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 33 pid: 2839 timeout: 941 lvb_type: 0 00002000:00010000:1.0:1746143762.923861:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc24e00 00000100:00100000:1.0:1746143762.924115:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1784 00000100:00100000:1.0:1746143762.924122:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594176000:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143762.938261:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594176000:12345-192.168.202.48@tcp:4:cat.0 Request processed in 14127us (14579us total) trans 21474840405 rc 0/0 00000100:00100000:0.0:1746143762.938274:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1784 00002000:00100000:0.0:1746143762.938286:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771551) req@ffff88012fc24e00 x1830963594176000/t21474840405(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:158/0 lens 488/448 e 0 to 0 dl 1746143773 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143762.938295:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24e00 with x1830963594176000 ext(4194304->4771551) 00010000:00010000:0.0:1746143762.938305:0:8502:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:0.0:1746143762.938321:0:8502:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00002000:00010000:0.0:1746143762.938327:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc24e00 00000100:00100000:0.0:1746143762.942377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.943043:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176128 00000100:00100000:1.0:1746143762.943054:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176128 00010000:00010000:1.0:1746143762.943092:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.943245:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7146 00000100:00100000:1.0:1746143762.943254:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594176128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.943271:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.943295:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.943308:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.943332:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba38a00/0xe984082ccd72fb28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a77fc expref: 35 pid: 2839 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.943351:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.943352:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.943360:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.943368:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.943413:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143762.943423:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594350464:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143762.943499:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143762.947614:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594350464:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143762.947638:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.947694:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594176128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4439us (5330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.947706:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7146 00000100:00100000:2.0:1746143762.947773:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.948229:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176384 00000100:00100000:1.0:1746143762.948235:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176384 00002000:00100000:1.0:1746143762.948272:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a54e8000 x1830963594176384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/0 e 0 to 0 dl 1746143773 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.948281:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8000 with x1830963594176384 ext(4194304->4771839) 00002000:00010000:1.0:1746143762.948286:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54e8000 00000100:00100000:1.0:1746143762.948312:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6282 00000100:00100000:1.0:1746143762.948319:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594176384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143762.952623:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594176384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4293us (4839us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746143762.952636:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6282 00002000:00100000:1.0:1746143762.952647:0:8502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a54e8000 x1830963594176384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:158/0 lens 488/440 e 0 to 0 dl 1746143773 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143762.952657:0:8502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a54e8000 with x1830963594176384 ext(4194304->4771839) 00002000:00010000:1.0:1746143762.952663:0:8502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a54e8000 00000100:00100000:0.0:1746143762.969732:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.970079:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176512 00000100:00100000:3.0:1746143762.970091:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176512 00000100:00100000:3.0:1746143762.970181:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9175 00000100:00100000:3.0:1746143762.970189:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31323:x1830963594176512:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143762.970217:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.970234:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092933200/0xe984082ccd72fb8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a785e expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.970291:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970306:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970316:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970329:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970334:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970339:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970458:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970469:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.970475:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.970507:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.970517:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 24 pid: 21713 timeout: 941 lvb_type: 0 00000100:00100000:3.0:1746143762.970530:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594350592:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143762.970620:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143762.973327:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.973387:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176768 00000100:00100000:2.0:1746143762.973395:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176768 00000100:00100000:3.0:1746143762.973438:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594350592:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.973449:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3935 00000100:00100000:2.0:1746143762.973456:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:7696:x1830963594176768:12345-192.168.202.48@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746143762.973462:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:2.0:1746143762.973650:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:7696:x1830963594176768:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 194us (333us total) trans 8589943498 rc 0/0 00000100:00100000:2.0:1746143762.973656:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3935 00000100:00100000:0.0:1746143762.974844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.974898:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594176896 00000100:00100000:1.0:1746143762.974903:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594176896 00010000:00010000:1.0:1746143762.974928:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 26 pid: 21713 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.974960:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7147 00000100:00100000:1.0:1746143762.974965:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594176896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.974976:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.974982:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 26 pid: 21713 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.974992:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 26 pid: 21713 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.975014:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bea3a00/0xe984082ccd72f96f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76ba expref: 26 pid: 21713 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.975036:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.975041:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143762.975050:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143762.975057:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143762.976259:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143762.976303:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976312:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143762.976314:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594176896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1347us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.976323:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7147 00000004:00200000:3.0:1746143762.976354:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:3.0:1746143762.976359:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143762.976375:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976385:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976394:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976400:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976404:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976410:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092933400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143762.976414:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976421:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976431:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143762.976435:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143762.976438:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976443:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933400/0xe984082ccd72fb91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976469:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976475:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976479:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976483:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092933600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143762.976485:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976490:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976496:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1f4f00) 00010000:00010000:3.0:1746143762.976498:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143762.976501:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976505:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933600/0xe984082ccd72fb98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.976535:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933200/0xe984082ccd72fb8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.976551:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.976556:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143762.976558:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143762.976561:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092933800, rc 0) 00000100:00100000:3.0:1746143762.976598:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31323:x1830963594176512:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6410us (6879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.976605:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9175 00000100:00100000:0.0:1746143762.979504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.979619:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177024 00000100:00100000:0.0:1746143762.979621:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.979629:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177024 00000100:00100000:0.0:1746143762.979639:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.980292:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143762.980403:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177152 00000100:00100000:3.0:1746143762.980407:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177152 00000100:00100000:0.0:1746143762.980412:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177280 00000100:00100000:0.0:1746143762.980415:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177280 00000100:00100000:3.0:1746143762.980425:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177408 00000100:00100000:3.0:1746143762.980427:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177408 00000100:00100000:0.0:1746143762.980434:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13354 00000100:00100000:0.0:1746143762.980441:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594177024:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143762.980451:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13355 00000100:00100000:3.0:1746143762.980456:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594177152:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143762.980458:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.980464:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143762.980474:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7865 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.980475:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a786c expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.980494:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.980494:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.980496:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.980496:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.980505:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.980505:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.980518:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.980518:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.980528:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092933e00, rc 0) 00010000:00010000:0.0:1746143762.980528:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bea2e00, rc 0) 00000100:00100000:3.0:1746143762.980566:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594177152:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 110us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.980566:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594177024:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 125us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143762.980571:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13355 00000100:00100000:0.0:1746143762.981117:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13354 00000100:00100000:3.0:1746143762.981123:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13356 00000100:00100000:3.0:1746143762.981295:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594177280:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143762.981304:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.981316:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7873 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143762.981319:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13357 00000100:00100000:0.0:1746143762.981326:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594177408:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143762.981328:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143762.981329:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.981333:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143762.981334:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.981341:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a787a expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.981342:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143762.981348:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092933a00, rc 0) 00010000:00010000:0.0:1746143762.981357:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143762.981359:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143762.981364:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594177280:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 75us (1724us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143762.981364:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143762.981369:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13356 00010000:00010000:0.0:1746143762.981373:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143762.981380:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bea2c00, rc 0) 00000100:00100000:0.0:1746143762.981396:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594177408:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 70us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143762.981401:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13357 00000100:00100000:0.0:1746143762.981431:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143762.981445:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177536 00000100:00100000:0.0:1746143762.981448:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177536 00000100:00100000:1.0:1746143762.981712:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13358 00000100:00100000:1.0:1746143762.981720:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594177536:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143762.981726:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.981733:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7881 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.981745:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.981747:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.981751:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.981759:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.981765:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ace6000, rc 0) 00000100:00100000:1.0:1746143762.981779:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594177536:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 62us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.981784:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13358 00000100:00100000:3.0:1746143762.982219:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143762.983344:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177664 00000100:00100000:1.0:1746143762.983351:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177664 00000100:00100000:1.0:1746143762.983392:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13359 00000100:00100000:1.0:1746143762.983397:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594177664:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143762.983408:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143762.983420:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7888 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143762.983436:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.983438:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143762.983444:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.983454:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143762.983463:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ace6400, rc 0) 00000100:00100000:1.0:1746143762.983500:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594177664:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 103us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.983505:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13359 00000100:00100000:0.0:1746143762.986629:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.987172:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594177920 00000100:00100000:2.0:1746143762.987181:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594177920 00000100:00100000:2.0:1746143762.987231:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9176 00000100:00100000:2.0:1746143762.987238:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31323:x1830963594177920:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143762.987256:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.987272:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135180e00/0xe984082ccd72fbd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a788f expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.987357:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143762.987371:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.987378:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143762.987407:0:14763:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.987418:0:14763:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 14 pid: 14763 timeout: 941 lvb_type: 0 00000100:00100000:2.0:1746143762.987430:0:14763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594350720:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143762.988325:0:14763:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143762.990452:0:14763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a54e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14763:1830963594350720:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143762.990460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143762.990480:0:14763:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000100:00100000:1.0:1746143762.990546:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594178048 00000100:00100000:1.0:1746143762.990552:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594178048 00010000:00010000:1.0:1746143762.990581:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 15 pid: 14763 timeout: 941 lvb_type: 0 00000100:00100000:1.0:1746143762.990606:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7148 00000100:00100000:1.0:1746143762.990613:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594178048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143762.990625:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143762.990631:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 15 pid: 14763 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.990641:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 15 pid: 14763 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.990662:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933800/0xe984082ccd72fb9f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a785e expref: 15 pid: 14763 timeout: 941 lvb_type: 0 00010000:00010000:1.0:1746143762.990680:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143762.990684:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143762.990694:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143762.990700:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143762.990733:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143762.990771:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594178048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 158us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143762.990778:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7148 00010000:00010000:3.0:1746143762.990884:0:14763:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:3.0:1746143762.990894:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:3.0:1746143762.990914:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143762.991050:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135180e00/0xe984082ccd72fbd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a788f expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.991064:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a788f expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143762.991070:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143762.991072:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143762.991075:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181e00, rc 0) 00000100:00100000:3.0:1746143762.991101:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31323:x1830963594177920:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 3863us (4482us total) trans 8589943499 rc 0/0 00000100:00100000:3.0:1746143762.991107:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9176 00000100:00100000:0.0:1746143762.993206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.993320:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594178304 00000100:00100000:2.0:1746143762.993328:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594178304 00000100:00100000:2.0:1746143762.993373:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9177 00000100:00100000:2.0:1746143762.993379:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31323:x1830963594178304:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143762.993406:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.993408:0:14763:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143762.993529:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181e00/0xe984082ccd72fbd7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a788f expref: 14 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.993547:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.993551:0:14763:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143762.993562:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135181a00/0xe984082ccd72fbe5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7896 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.993640:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135181800/0xe984082ccd72fbec lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143762.993651:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135181800/0xe984082ccd72fbec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:2.0:1746143762.993659:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135181800/0xe984082ccd72fbec lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:2.0:1746143762.993668:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143762.993758:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181a00/0xe984082ccd72fbe5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7896 expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.993768:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135181800/0xe984082ccd72fbec lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7896 expref: 15 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.993774:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.993777:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143762.993779:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181800, rc 0) 00000100:00100000:2.0:1746143762.994360:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31323:x1830963594178304:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 979us (1160us total) trans 8589943500 rc 0/0 00000100:00100000:2.0:1746143762.994546:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9177 00000100:00100000:0.0:1746143762.995943:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143762.996079:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594178432 00000100:00100000:2.0:1746143762.996086:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594178432 00000100:00100000:2.0:1746143762.996245:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9178 00000100:00100000:2.0:1746143762.996252:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31323:x1830963594178432:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143762.996270:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143762.996284:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135181600/0xe984082ccd72fbfa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a789d expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.996326:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135181600/0xe984082ccd72fbfa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a789d expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.996338:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135181600/0xe984082ccd72fbfa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a789d expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143762.996354:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143762.996357:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143762.996359:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181600, rc 0) 00000100:00100000:2.0:1746143762.996397:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31323:x1830963594178432:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 145us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143762.996402:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9178 00000100:00100000:2.0:1746143763.001388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.001604:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594178688 00000100:00100000:3.0:1746143763.001614:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594178688 00000100:00100000:3.0:1746143763.001658:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13360 00000100:00100000:3.0:1746143763.001665:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594178688:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143763.001707:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.001725:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.001732:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.001740:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.001746:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143763.001748:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143763.001751:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.001783:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 34 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.001796:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 34 pid: 12618 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143763.001810:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594350848:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.002260:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.002287:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143763.002946:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594178560 00000100:00100000:1.0:1746143763.002952:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594178560 00000100:00100000:1.0:1746143763.002974:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594178944 00000100:00100000:1.0:1746143763.002976:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594178944 00000100:00100000:1.0:1746143763.002993:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13361 00000100:00100000:1.0:1746143763.002998:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594178560:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143763.003023:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.003035:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 33 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.003042:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.003048:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.003053:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.003055:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.003057:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.003079:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.003087:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 28 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143763.003096:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594350976:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.003177:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13362 00000100:00100000:0.0:1746143763.003184:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594178944:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143763.003198:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.003206:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.003226:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.003232:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.003236:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.003237:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.003238:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.003252:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.003259:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 33 pid: 25369 timeout: 942 lvb_type: 0 00000100:00100000:0.0:1746143763.003265:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594351104:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.003363:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.003372:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 11 pid: 4582 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143763.003380:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594351232:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.003512:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.003534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.003546:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179200 00000100:00100000:2.0:1746143763.003550:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179200 00000100:00100000:2.0:1746143763.003566:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594178816 00000100:00100000:2.0:1746143763.003568:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594178816 00000100:00100000:2.0:1746143763.003579:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13363 00000100:00100000:2.0:1746143763.003584:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594179200:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143763.003600:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.003609:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.003616:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143763.003621:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143763.003623:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143763.003625:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.003638:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143763.003645:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 13 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143763.003652:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594351360:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143763.003878:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.003887:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 12 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143763.003895:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594351488:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143763.003920:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 33 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.003927:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 33 pid: 8495 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143763.003934:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594351616:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143763.003949:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143763.003970:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13364 00000100:00100000:1.0:1746143763.003975:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594178816:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143763.003992:0:2839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.004002:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.004008:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.004015:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.004019:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.004021:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.004023:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.004037:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.004044:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143763.004052:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594351744:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143763.004073:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.004085:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 13 pid: 4582 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143763.004092:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594351872:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143763.004110:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 34 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.004116:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 34 pid: 9527 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143763.004123:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594352000:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143763.004166:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5600 going to sleep for 11 seconds 00010000:00010000:0.0:1746143763.004230:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.004238:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 12 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143763.004245:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594352128:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143763.004266:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.004273:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 28 pid: 9527 timeout: 942 lvb_type: 0 00000100:00100000:0.0:1746143763.004280:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594352256:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.004289:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143763.004323:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143763.004473:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.004481:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.004488:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594352384:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.004513:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143763.004525:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179072 00000100:00100000:2.0:1746143763.004528:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179072 00000100:00100000:2.0:1746143763.004555:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13365 00000100:00100000:2.0:1746143763.004561:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594179072:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143763.004576:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.004587:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.004593:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.004600:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 13 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143763.004606:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.004614:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143763.004616:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143763.004618:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 7/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.004638:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.004645:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.004652:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594352512:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.004679:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 39 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.004693:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 39 pid: 25369 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143763.004701:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594352768:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143763.004722:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f429c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143763.005085:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 13 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143763.005095:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 13 pid: 2839 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143763.005103:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594352640:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143763.006408:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.006417:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.006431:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594352896:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143763.006661:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594350848:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143763.006902:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 33 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.006911:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 33 pid: 25369 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.006920:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594353024:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.006939:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143763.008806:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594351360:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143763.008975:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594350976:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143763.008984:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594351488:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143763.008992:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594351616:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143763.009024:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.009121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.009202:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594351744:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.009217:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594351872:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.009268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.009593:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179328 00000100:00100000:3.0:1746143763.009599:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179328 00010000:00010000:3.0:1746143763.009629:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 14 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143763.009655:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179712 00000100:00100000:3.0:1746143763.009657:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179712 00010000:00010000:3.0:1746143763.009666:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 15 pid: 4582 timeout: 942 lvb_type: 1 00000100:00100000:3.0:1746143763.010089:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7149 00000100:00100000:3.0:1746143763.010097:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1963:x1830963594179328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143763.010110:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143763.010133:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 15 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143763.010161:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 15 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143763.010313:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7150 00000100:00100000:1.0:1746143763.010320:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1962:x1830963594179712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143763.010328:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143763.010339:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 15 pid: 4582 timeout: 942 lvb_type: 1 00010000:00010000:1.0:1746143763.010347:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 15 pid: 4582 timeout: 942 lvb_type: 1 00010000:00010000:1.0:1746143763.010365:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092933a00/0xe984082ccd72fbb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7873 expref: 15 pid: 4582 timeout: 942 lvb_type: 1 00010000:00010000:1.0:1746143763.010384:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143763.010417:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1962:x1830963594179712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.010423:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7150 00010000:00010000:3.0:1746143763.010770:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ace6400/0xe984082ccd72fbc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7888 expref: 13 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:3.0:1746143763.010786:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143763.010808:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963594179328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 712us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.010813:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7149 00000100:00100000:3.0:1746143763.010870:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594352768:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.012726:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594351104:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.012792:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594352128:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.012819:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594352256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.012828:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594352640:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.012839:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594352896:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143763.012845:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143763.012847:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594353024:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143763.012895:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594352384:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.012911:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143763.012912:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143763.012929:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594352512:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.012930:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179584 00000100:00100000:0.0:1746143763.012935:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179584 00010000:00010000:2.0:1746143763.012943:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.012959:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 14 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143763.012979:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7151 00000100:00100000:0.0:1746143763.012985:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594179584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.013005:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.013026:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 14 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.013035:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 14 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.013053:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bea2e00/0xe984082ccd72fba6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7865 expref: 14 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.013078:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.013107:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594179584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.013112:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7151 00000100:00100000:0.0:1746143763.013168:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.013180:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180480 00000100:00100000:0.0:1746143763.013182:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180480 00010000:00010000:0.0:1746143763.013193:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 40 pid: 25369 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143763.013218:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7152 00000100:00100000:0.0:1746143763.013222:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594180480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.013230:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.013242:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 40 pid: 25369 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.013254:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 40 pid: 25369 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.013274:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2c000/0xe984082ccd72f9ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76f2 expref: 40 pid: 25369 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.013283:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.013300:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594180480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.013305:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7152 00000100:00100000:0.0:1746143763.013347:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.013425:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.013860:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179968 00000100:00100000:2.0:1746143763.013865:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179968 00010000:00010000:2.0:1746143763.013880:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 34 pid: 8495 timeout: 942 lvb_type: 1 00000100:00100000:2.0:1746143763.013897:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180608 00000100:00100000:2.0:1746143763.013899:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180608 00010000:00010000:2.0:1746143763.013909:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 35 pid: 9527 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.013923:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7153 00000100:00100000:2.0:1746143763.013928:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1962:x1830963594179968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143763.013934:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143763.013943:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 34 pid: 8495 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143763.013951:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 34 pid: 8495 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143763.013962:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03f0400/0xe984082ccd72f9a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a76eb expref: 34 pid: 8495 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143763.013974:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143763.013994:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594179968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.013998:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7153 00000100:00100000:2.0:1746143763.014009:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7154 00000100:00100000:2.0:1746143763.014013:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1962:x1830963594180608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143763.014018:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143763.014028:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 35 pid: 9527 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.014036:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 35 pid: 9527 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.014047:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143763.014061:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1962:x1830963594180608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.014066:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7154 00010000:00010000:3.0:1746143763.014167:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2d600/0xe984082ccd72fa41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a774d expref: 34 pid: 9527 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.014177:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594352000:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.014199:0:2839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143763.014235:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594351232:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.014251:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.014493:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.014621:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143763.014883:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594181120 00000100:00100000:1.0:1746143763.014887:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594181120 00010000:00010000:1.0:1746143763.014903:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 29 pid: 9527 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143763.014924:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180096 00000100:00100000:1.0:1746143763.014926:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180096 00010000:00010000:1.0:1746143763.014933:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 942 lvb_type: 0 00000100:00100000:0.0:1746143763.015382:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143763.015600:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180352 00000100:00100000:1.0:1746143763.015603:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180352 00010000:00010000:1.0:1746143763.015616:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 33 pid: 25369 timeout: 942 lvb_type: 0 00000100:00100000:1.0:1746143763.015631:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7155 00000100:00100000:1.0:1746143763.015636:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594181120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143763.015659:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143763.015674:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 29 pid: 9527 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015682:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 29 pid: 9527 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015696:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fa6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7777 expref: 29 pid: 9527 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015707:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143763.015728:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594181120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.015733:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7155 00000100:00100000:1.0:1746143763.015744:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7156 00000100:00100000:1.0:1746143763.015749:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594180096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143763.015755:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143763.015765:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015773:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015784:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0835a00/0xe984082ccd72fa64 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7770 expref: 39 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015796:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.015798:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.015802:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.015809:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.015827:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143763.015841:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594180096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.015846:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7156 00000100:00100000:1.0:1746143763.015878:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7157 00000100:00100000:1.0:1746143763.015883:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594180352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143763.015888:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143763.015896:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 33 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015904:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 33 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015913:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c113c00/0xe984082ccd72fa72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a777e expref: 33 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.015921:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143763.015935:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594180352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.015940:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7157 00000100:00100000:2.0:1746143763.016059:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.016072:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180864 00000100:00100000:2.0:1746143763.016074:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180864 00010000:00010000:2.0:1746143763.016086:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 32 pid: 25369 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.016098:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7158 00000100:00100000:2.0:1746143763.016102:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594180864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143763.016108:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143763.016117:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 32 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.016124:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 32 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.016160:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0835200/0xe984082ccd72fb2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7803 expref: 32 pid: 25369 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.016168:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143763.016182:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594180864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.016187:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7158 00000100:00100000:0.0:1746143763.016288:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.016297:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594181248 00000100:00100000:0.0:1746143763.016299:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594181248 00010000:00010000:0.0:1746143763.016310:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 942 lvb_type: 0 00000100:00100000:0.0:1746143763.016327:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7159 00000100:00100000:0.0:1746143763.016332:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1964:x1830963594181248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.016336:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.016346:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.016354:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.016363:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff2ca00/0xe984082ccd72fb67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a783b expref: 34 pid: 2839 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.016372:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.016373:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.016375:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016381:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016393:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.016406:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1964:x1830963594181248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.016411:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7159 00000100:00100000:0.0:1746143763.016434:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.016442:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180224 00000100:00100000:0.0:1746143763.016444:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180224 00010000:00010000:0.0:1746143763.016452:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 13 pid: 2839 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143763.016464:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7160 00000100:00100000:0.0:1746143763.016468:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594180224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.016476:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.016482:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 13 pid: 2839 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016489:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 13 pid: 2839 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016498:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ace6000/0xe984082ccd72fbc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7881 expref: 13 pid: 2839 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016507:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.016520:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594180224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.016525:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7160 00000100:00100000:0.0:1746143763.016547:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.016555:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180736 00000100:00100000:0.0:1746143763.016557:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180736 00010000:00010000:0.0:1746143763.016564:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 12 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143763.016575:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7161 00000100:00100000:0.0:1746143763.016578:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594180736:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.016583:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.016590:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 12 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016602:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 12 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016611:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bea2c00/0xe984082ccd72fbbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a787a expref: 12 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016619:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.016620:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.016622:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016628:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016639:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.016652:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594180736:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.016657:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7161 00010000:00010000:0.0:1746143763.016672:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016679:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016696:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016707:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016714:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016720:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bea3a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143763.016724:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016731:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016740:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.016746:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bea3a00/0xe984082ccd72fc0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.016782:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594178944:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 13599us (14493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.016789:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13362 00000100:00100000:0.0:1746143763.016816:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.016825:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594180992 00000100:00100000:0.0:1746143763.016828:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594180992 00010000:00010000:0.0:1746143763.016838:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 12 pid: 4582 timeout: 942 lvb_type: 1 00000100:00100000:0.0:1746143763.016849:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7162 00000100:00100000:0.0:1746143763.016853:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594180992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.016865:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.016873:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 12 pid: 4582 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016880:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 12 pid: 4582 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016890:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092933e00/0xe984082ccd72fbad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a786c expref: 12 pid: 4582 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.016899:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.016909:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594180992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.016914:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7162 00000100:00100000:0.0:1746143763.016947:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.016957:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594181376 00000100:00100000:0.0:1746143763.016959:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594181376 00010000:00010000:0.0:1746143763.016968:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00000100:00100000:0.0:1746143763.016979:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7163 00000100:00100000:0.0:1746143763.016982:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594181376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.016990:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.016996:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.017002:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.017012:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135181000/0xe984082ccd72fb83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7857 expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.017019:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.017028:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594181376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.017033:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7163 00010000:00010000:2.0:1746143763.017098:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017105:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017119:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017125:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017131:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017137:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135181200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143763.017152:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017162:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017171:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.017176:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135181200/0xe984082ccd72fc16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143763.017206:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594179200:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 13621us (13694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.017221:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13363 00010000:00010000:3.0:1746143763.017473:0:2839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017481:0:2839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017498:0:2839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017504:0:2839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017510:0:2839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017515:0:2839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ace7600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143763.017518:0:2839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017524:0:2839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017533:0:2839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.017539:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ace7600/0xe984082ccd72fc1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143763.017571:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594178816:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 13595us (14035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.017577:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13364 00000100:00100000:0.0:1746143763.019091:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.019930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.020347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143763.021357:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179456 00000100:00100000:1.0:1746143763.021367:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179456 00000100:00100000:2.0:1746143763.021370:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594179840 00000100:00100000:2.0:1746143763.021373:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594179840 00010000:00010000:2.0:1746143763.021404:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 33 pid: 12618 timeout: 942 lvb_type: 1 00010000:00010000:1.0:1746143763.021404:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 27 pid: 15784 timeout: 942 lvb_type: 1 00000100:00100000:1.0:1746143763.021427:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594181504 00000100:00100000:1.0:1746143763.021430:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594181504 00000100:00100000:2.0:1746143763.021435:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7164 00010000:00010000:1.0:1746143763.021438:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.021441:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594179456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143763.021461:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7165 00000100:00100000:1.0:1746143763.021465:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1965:x1830963594179840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143763.021473:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143763.021482:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7166 00000100:00100000:0.0:1746143763.021488:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594181504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143763.021492:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 33 pid: 12618 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.021493:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143763.021502:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 33 pid: 12618 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.021504:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.021510:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.021521:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03f0600/0xe984082ccd72fa02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a772a expref: 33 pid: 12618 timeout: 942 lvb_type: 1 00010000:00010000:0.0:1746143763.021524:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff2ce00/0xe984082ccd72fb4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a781f expref: 28 pid: 12618 timeout: 942 lvb_type: 0 00010000:00010000:1.0:1746143763.021536:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.021536:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.021537:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.021537:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.021542:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.021542:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.021550:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.021550:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.021568:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143763.021569:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143763.021631:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021640:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021660:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021667:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021673:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021679:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092933800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143763.021683:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021690:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021699:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.021705:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092933800/0xe984082ccd72fc01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.021722:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143763.021736:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 27 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143763.021744:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 27 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143763.021758:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009beda600/0xe984082ccd72f9fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7723 expref: 27 pid: 15784 timeout: 942 lvb_type: 1 00010000:00010000:2.0:1746143763.021765:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143763.021766:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143763.021769:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.021775:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.021789:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.021899:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594181504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 411us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.021900:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1965:x1830963594179840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 433us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.021905:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7166 00000100:00100000:3.0:1746143763.021950:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a54e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594178688:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 20286us (20573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.021958:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13360 00010000:00010000:0.0:1746143763.022009:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.022017:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.022029:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.022035:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143763.022042:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7165 00010000:00010000:0.0:1746143763.022045:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.022050:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5db8200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143763.022053:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.022058:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.022060:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.022066:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.022067:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.022072:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5db8200/0xe984082ccd72fc24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.022078:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.022084:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.022089:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.022093:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ace6800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143763.022096:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.022102:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594179072:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 17541us (17779us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143763.022106:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143763.022107:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13365 00010000:00010000:1.0:1746143763.022114:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.022119:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ace6800/0xe984082ccd72fc08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143763.022162:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594178560:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 19164us (19902us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.022167:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13361 00000100:00100000:2.0:1746143763.022359:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594179456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 917us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.022365:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7164 00000100:00100000:0.0:1746143763.024013:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.024069:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594181760 00000100:00100000:3.0:1746143763.024079:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594181760 00000100:00100000:3.0:1746143763.024265:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9179 00000100:00100000:3.0:1746143763.024273:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31323:x1830963594181760:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143763.024323:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143763.024346:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181600/0xe984082ccd72fbfa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a789d expref: 16 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024362:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143763.024366:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143763.024391:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143763.024403:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 24 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024410:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024415:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 268 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024419:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024422:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 268 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024430:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 24 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024434:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 9/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143763.024458:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 24 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024465:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 24 pid: 16090 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.024475:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353152:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.024562:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 268 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024570:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 268 pid: 16090 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.024576:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353280:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.024598:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024605:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 24 pid: 21713 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.024611:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353408:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.024637:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 268 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024643:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 268 pid: 16090 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.024650:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353536:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.024721:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 24 pid: 21713 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024728:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 24 pid: 21713 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.024735:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.024758:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 24 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143763.024765:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 24 pid: 16090 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.024772:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353792:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143763.024787:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143763.026756:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353152:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143763.027194:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353280:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143763.027623:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353408:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143763.027802:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143763.027851:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594182272 00000100:00100000:1.0:1746143763.027858:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594182272 00000100:00100000:0.0:1746143763.027866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.027921:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594182016 00000100:00100000:3.0:1746143763.027925:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594182016 00010000:00010000:3.0:1746143763.027948:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 269 pid: 16090 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.027982:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7167 00000100:00100000:3.0:1746143763.027990:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+269:1964:x1830963594182016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143763.028003:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143763.028009:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 269 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.028019:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 269 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.028038:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800951f6200/0xe984082ccd72f563 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7467 expref: 269 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.028051:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143763.028056:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143763.028066:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143763.028103:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:1964:x1830963594182016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 114us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.028110:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7167 00000100:00100000:1.0:1746143763.028432:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3936 00000100:00100000:1.0:1746143763.028438:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:7695:x1830963594182272:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143763.028616:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:7695:x1830963594182272:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 176us (815us total) trans 8589943501 rc 0/0 00000100:00100000:1.0:1746143763.028622:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3936 00000100:00100000:0.0:1746143763.029640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.029686:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594181888 00000100:00100000:2.0:1746143763.029691:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594181888 00010000:00010000:2.0:1746143763.029711:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 26 pid: 16090 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.029731:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7168 00000100:00100000:2.0:1746143763.029736:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594181888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143763.029745:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143763.029749:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 26 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.029758:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 26 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.029773:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bf1400/0xe984082ccd72f586 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a746e expref: 26 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.029787:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143763.029791:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143763.029798:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143763.029832:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594181888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.029838:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7168 00000100:00100000:3.0:1746143763.029892:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353536:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143763.029900:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353664:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143763.029909:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594353792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143763.029936:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143763.030331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.030355:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594182400 00000100:00100000:3.0:1746143763.030359:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594182400 00000100:00100000:2.0:1746143763.030359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.030369:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594182656 00000100:00100000:2.0:1746143763.030372:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594182656 00010000:00010000:3.0:1746143763.030376:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 268 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.030381:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 25 pid: 16090 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.030394:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7169 00000100:00100000:2.0:1746143763.030398:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7170 00000100:00100000:3.0:1746143763.030399:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+268:1965:x1830963594182400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143763.030402:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594182656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143763.030407:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143763.030409:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143763.030411:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 268 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.030412:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 25 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.030418:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 268 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.030490:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 25 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.030505:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009089fc00/0xe984082ccd72f47c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73db expref: 25 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:2.0:1746143763.030513:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143763.030516:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143763.030520:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143763.030537:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594182656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 135us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.030543:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7170 00010000:00010000:3.0:1746143763.030725:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba200/0xe984082ccd72f491 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73f0 expref: 268 pid: 16090 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.030735:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143763.030738:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143763.030744:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143763.030764:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+267:1965:x1830963594182400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 365us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.030773:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7169 00000100:00100000:0.0:1746143763.030940:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.030961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.031069:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594182528 00000100:00100000:3.0:1746143763.031072:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594182528 00000100:00100000:2.0:1746143763.031083:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594182784 00010000:00010000:3.0:1746143763.031084:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 24 pid: 21713 timeout: 942 lvb_type: 0 00000100:00100000:2.0:1746143763.031087:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594182784 00010000:00010000:2.0:1746143763.031098:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 25 pid: 21713 timeout: 942 lvb_type: 0 00000100:00100000:3.0:1746143763.031307:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7171 00000100:00100000:3.0:1746143763.031469:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594182528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143763.031477:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143763.031481:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 25 pid: 21713 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.031488:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 25 pid: 21713 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.031500:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a084fa00/0xe984082ccd72f483 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a73e2 expref: 25 pid: 21713 timeout: 942 lvb_type: 0 00010000:00010000:3.0:1746143763.031508:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143763.031511:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143763.031516:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143763.031555:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7172 00000100:00100000:0.0:1746143763.031563:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594182784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143763.031570:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143763.031574:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 24 pid: 21713 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.031582:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 24 pid: 21713 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.031614:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0835000/0xe984082ccd72f635 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a74c2 expref: 24 pid: 21713 timeout: 942 lvb_type: 0 00010000:00010000:0.0:1746143763.031627:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143763.031630:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143763.031638:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143763.031644:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143763.031673:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594182528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 205us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.031678:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7171 00010000:00010000:0.0:1746143763.031718:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143763.031839:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143763.031846:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143763.032359:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594182784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 188us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.032366:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7172 00000040:00080000:3.0:1746143763.032731:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2659, 88 off224528 00000004:00080000:3.0:1746143763.032739:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842042599151ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.032942:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2678, 88 off226376 00000004:00080000:3.0:1746143763.032948:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842042808762ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143763.033087:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2679, 88 off226464 00000004:00080000:3.0:1746143763.033094:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842042954133ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143763.033101:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2660, 88 off224616 00000004:00080000:3.0:1746143763.033104:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842042964487ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033112:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2661, 88 off224704 00000004:00080000:3.0:1746143763.033115:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842042975723ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033122:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2680, 88 off226552 00000004:00080000:3.0:1746143763.033124:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842042984789ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143763.033130:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2681, 88 off226640 00000004:00080000:3.0:1746143763.033132:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842042992613ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143763.033155:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2682, 88 off226728 00000004:00080000:3.0:1746143763.033159:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842043019351ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143763.033167:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2662, 88 off224792 00000004:00080000:3.0:1746143763.033169:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842043029576ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033175:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2683, 88 off226816 00000004:00080000:3.0:1746143763.033177:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842043037689ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143763.033183:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2663, 88 off224880 00000004:00080000:3.0:1746143763.033186:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842043046073ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033191:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2684, 88 off226904 00000004:00080000:3.0:1746143763.033195:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842043055401ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143763.033200:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2664, 88 off224968 00000004:00080000:3.0:1746143763.033203:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842043063142ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033219:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2665, 88 off225056 00000004:00080000:3.0:1746143763.033223:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842043082993ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033229:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2666, 88 off225144 00000004:00080000:3.0:1746143763.033232:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842043092036ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033238:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2667, 88 off225232 00000004:00080000:3.0:1746143763.033240:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 842043100703ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143763.033247:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2685, 88 off226992 00000004:00080000:3.0:1746143763.033249:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 842043109532ns, next at 833304778357ns, rc = 0 00000001:00080000:0.0:1746143763.049769:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943494 is committed 00000001:00080000:0.0:1746143763.049789:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943501 is committed 00000004:00010000:3.0:1746143763.049803:0:16090:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012fc10000 reply state ffff8800945a2400 transno 8589943502 ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000001:00080000:0.0:1746143763.049805:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943488 is committed 00000100:00100000:3.0:1746143763.049816:0:16090:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746143763.049853:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943500 is committed 00000001:00080000:0.0:1746143763.049861:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943495 is committed 00000001:00080000:0.0:1746143763.049904:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943502 is committed 00000004:00080000:0.0:1746143763.049909:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2021 committed 00000004:00080000:0.0:1746143763.049916:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2003 committed 00010000:00080000:3.0:1746143763.049922:0:16090:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:0.0:1746143763.049931:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2002 committed 00000004:00080000:0.0:1746143763.049933:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2001 committed 00000004:00080000:0.0:1746143763.049934:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2000 committed 00000004:00080000:0.0:1746143763.049936:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2020 committed 00000100:00100000:3.0:1746143763.049937:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31323:x1830963594181760:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 25659us (25925us total) trans 8589943502 rc 0/0 00000004:00080000:0.0:1746143763.049938:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1999 committed 00000004:00080000:0.0:1746143763.049939:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2019 committed 00000004:00080000:0.0:1746143763.049941:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1998 committed 00000004:00080000:0.0:1746143763.049942:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2018 committed 00000004:00080000:0.0:1746143763.049944:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2017 committed 00000004:00080000:0.0:1746143763.049945:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2016 committed 00000100:00100000:3.0:1746143763.049946:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9179 00000004:00080000:0.0:1746143763.049947:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1997 committed 00000004:00080000:0.0:1746143763.049948:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1996 committed 00000004:00080000:0.0:1746143763.049949:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2015 committed 00000004:00080000:0.0:1746143763.049951:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746143763.049952:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1995 committed 00000001:00080000:0.0:1746143763.049958:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943497 is committed 00000100:00100000:3.0:1746143763.050508:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354304:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143763.050575:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143763.050583:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143763.050590:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143763.050622:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.050651:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143763.050667:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.050681:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746143763.050685:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354176:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143763.050688:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092933c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143763.050692:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143763.050701:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746143763.050701:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143763.050711:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354688:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143763.050717:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143763.050720:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143763.050724:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143763.050726:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746143763.050729:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092933c00/0xe984082ccd72fc2b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143763.050735:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143763.050746:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594353920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.050748:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.050765:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594354432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143763.050766:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143763.050779:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594354048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143763.050781:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.050791:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594354944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143763.050803:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.050824:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354304 00000100:00100000:3.0:1746143763.050831:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354304 00000100:00100000:3.0:1746143763.050863:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354816 00000100:00100000:3.0:1746143763.050866:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354816 00000100:00100000:3.0:1746143763.050875:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354176 00000100:00100000:3.0:1746143763.050877:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354176 00000100:00100000:3.0:1746143763.050886:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354688 00000100:00100000:3.0:1746143763.050887:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354688 00000100:00100000:2.0:1746143763.050889:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355200 00000100:00100000:2.0:1746143763.050891:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355200 00000100:00100000:3.0:1746143763.050894:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353920 00000100:00100000:3.0:1746143763.050896:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353920 00000100:00100000:3.0:1746143763.050901:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354432 00000100:00100000:3.0:1746143763.050902:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354432 00000100:00100000:2.0:1746143763.050904:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354944 00000100:00100000:2.0:1746143763.050905:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354944 00000100:00100000:3.0:1746143763.050910:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13366 00000100:00100000:3.0:1746143763.050916:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3293:x1830963594354304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143763.050938:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13367 00000100:00100000:2.0:1746143763.050942:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3293:x1830963594354816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143763.050968:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13368 00000100:00100000:2.0:1746143763.050972:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3293:x1830963594354176:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1746143763.051008:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746143763.051011:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143763.051048:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594355456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143763.051069:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143763.051080:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143763.051083:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594355584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143763.051096:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.051097:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3293:x1830963594354304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (475us total) trans 17179873087 rc 0/0 00000100:00100000:3.0:1746143763.051103:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13366 00000100:00100000:3.0:1746143763.051112:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355456 00000100:00100000:3.0:1746143763.051114:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355456 00000100:00100000:3.0:1746143763.051121:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355584 00000100:00100000:3.0:1746143763.051122:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355584 00000100:00100000:3.0:1746143763.051129:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13369 00000100:00100000:3.0:1746143763.051133:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3293:x1830963594354688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143763.051137:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3293:x1830963594354176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (435us total) trans 17179873088 rc 0/0 00000100:00100000:2.0:1746143763.051160:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13368 00000100:00100000:2.0:1746143763.051169:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13370 00000100:00100000:2.0:1746143763.051173:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3295:x1830963594353920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.051237:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3293:x1830963594354688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (510us total) trans 17179873089 rc 0/0 00000100:00100000:3.0:1746143763.051241:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13369 00000100:00100000:3.0:1746143763.051250:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13371 00000100:00100000:3.0:1746143763.051254:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3293:x1830963594355200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143763.051315:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13372 00000100:00100000:1.0:1746143763.051322:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3294:x1830963594354432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143763.051396:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143763.051399:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143763.051401:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143763.051403:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143763.051405:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143763.052031:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3294:x1830963594354432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 686us (1225us total) trans 17179873090 rc 0/0 00000100:00100000:1.0:1746143763.052037:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13372 00000100:00100000:0.0:1746143763.052042:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143763.052047:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354048 00000100:00100000:1.0:1746143763.052049:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354048 00000100:00100000:0.0:1746143763.052056:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594354560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143763.052061:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13373 00000100:00100000:1.0:1746143763.052064:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3294:x1830963594354944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143763.052159:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594354944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (1354us total) trans 17179873091 rc 0/0 00000100:00100000:1.0:1746143763.052164:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13373 00000100:00100000:1.0:1746143763.052174:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13374 00000100:00100000:1.0:1746143763.052178:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3294:x1830963594355456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.052263:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13375 00000100:00100000:3.0:1746143763.052268:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3294:x1830963594355584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.052280:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13376 00000100:00100000:3.0:1746143763.052284:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963594354048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143763.052284:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963594354816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1342us (1616us total) trans 17179873092 rc 0/0 00000100:00100000:2.0:1746143763.052289:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13367 00000100:00100000:3.0:1746143763.052363:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963594354048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (320us total) trans 17179873093 rc 0/0 00000100:00100000:3.0:1746143763.052368:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13376 00000100:00100000:3.0:1746143763.052401:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.052417:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.052428:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143763.052428:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355328 00000100:00100000:2.0:1746143763.052430:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355328 00000100:00100000:3.0:1746143763.052442:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143763.052443:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13377 00000100:00100000:2.0:1746143763.052447:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3293:x1830963594355328:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143763.052468:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f533100/2, rc 0, transno 17179873090 00000004:00080000:3.0:1746143763.052496:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531180/2, rc 0, transno 17179873088 00000100:00100000:3.0:1746143763.052501:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143763.052511:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691a680/2, rc 0, transno 17179873089 00000100:00100000:3.0:1746143763.052513:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354688:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143763.052518:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cf100/2, rc 0, transno 17179873092 00000100:00100000:3.0:1746143763.052521:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354816:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143763.052686:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530e00/2, rc 0, transno 17179873087 00000100:00100000:3.0:1746143763.052689:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594354304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143763.052696:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143763.052700:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.052719:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143763.052728:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.052736:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355840 00000100:00100000:3.0:1746143763.052739:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355840 00000100:00100000:0.0:1746143763.052740:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594355072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.052751:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355712 00000100:00100000:3.0:1746143763.052753:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355712 00000100:00100000:0.0:1746143763.052753:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.052759:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354560 00000100:00100000:3.0:1746143763.052760:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354560 00000100:00100000:3.0:1746143763.052766:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355072 00000100:00100000:3.0:1746143763.052767:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355072 00000004:00080000:0.0:1746143763.052768:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094760380/2, rc 0, transno 17179873093 00000100:00100000:0.0:1746143763.052771:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594354048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143763.052774:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13378 00000100:00100000:3.0:1746143763.052777:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3293:x1830963594355840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.052787:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13379 00000100:00100000:0.0:1746143763.052790:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13380 00000100:00100000:3.0:1746143763.052791:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3293:x1830963594355712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143763.052795:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3295:x1830963594354560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143763.052798:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13381 00000100:00100000:3.0:1746143763.052802:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3295:x1830963594355072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143763.052882:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3295:x1830963594354560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (152us total) trans 17179873094 rc 0/0 00000100:00100000:0.0:1746143763.052887:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13380 00000004:00080000:0.0:1746143763.052906:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530700/2, rc 0, transno 17179873094 00000100:00100000:0.0:1746143763.052909:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594354560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143763.053059:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594354432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143763.053072:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cdc00/2, rc 0, transno 17179873091 00000100:00100000:2.0:1746143763.053074:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594354944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143763.053187:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3295:x1830963594353920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2012us (2420us total) trans 21474840406 rc 0/0 00000100:00100000:2.0:1746143763.053192:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13370 00000004:00080000:0.0:1746143763.053221:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c22680/2, rc 0, transno 21474840406 00000100:00100000:0.0:1746143763.053228:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594353920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143763.053345:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3294:x1830963594355456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1166us (2274us total) trans 21474840408 rc 0/0 00000100:00100000:1.0:1746143763.053351:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13374 00000100:00100000:3.0:1746143763.053458:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.053512:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594355200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2257us (2762us total) trans 21474840407 rc 0/0 00000100:00100000:3.0:1746143763.053517:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13371 00000100:00100000:0.0:1746143763.053575:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594182912 00000100:00100000:0.0:1746143763.053579:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594182912 00000100:00100000:3.0:1746143763.053609:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594355584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1341us (2512us total) trans 21474840409 rc 0/0 00000100:00100000:3.0:1746143763.053614:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13375 00000100:00100000:0.0:1746143763.053624:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9180 00000100:00100000:0.0:1746143763.053629:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31323:x1830963594182912:12345-192.168.202.48@tcp:101:mirror_io.0 00000004:00080000:3.0:1746143763.053634:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c22d80/2, rc 0, transno 21474840407 00000100:00100000:3.0:1746143763.053637:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355200:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143763.053644:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.053659:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78a4 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.053724:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.053739:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143763.053749:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594355328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1301us (1330us total) trans 21474840410 rc 0/0 00000100:00100000:2.0:1746143763.053757:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13377 00010000:00010000:0.0:1746143763.053757:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143763.053760:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143763.053763:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181200, rc 0) 00000004:00080000:2.0:1746143763.053776:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c20700/2, rc 0, transno 21474840409 00000100:00100000:2.0:1746143763.053780:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594355584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143763.053786:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c21880/2, rc 0, transno 21474840408 00000100:00100000:2.0:1746143763.053788:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594355456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143763.053810:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31323:x1830963594182912:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 181us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.053815:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9180 00000100:00100000:2.0:1746143763.053829:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594355968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143763.053846:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143763.053861:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355968 00000100:00100000:2.0:1746143763.053864:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355968 00000100:00100000:2.0:1746143763.053876:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13382 00000100:00100000:2.0:1746143763.053880:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594355968:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143763.054097:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c20000/2, rc 0, transno 21474840410 00000100:00100000:3.0:1746143763.054101:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143763.054187:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3294:x1830963594355968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (339us total) trans 21474840411 rc 0/0 00000100:00100000:2.0:1746143763.054192:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13382 00000004:00080000:2.0:1746143763.054222:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094458000/2, rc 0, transno 21474840411 00000100:00100000:2.0:1746143763.054225:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594355968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143763.054274:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3293:x1830963594355840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1495us (1830us total) trans 21474840412 rc 0/0 00000100:00100000:3.0:1746143763.054279:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13378 00000100:00100000:3.0:1746143763.054372:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3293:x1830963594355712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1580us (1652us total) trans 21474840413 rc 0/0 00000100:00100000:3.0:1746143763.054378:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13379 00000004:00080000:2.0:1746143763.054435:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094458380/2, rc 0, transno 21474840413 00000100:00100000:2.0:1746143763.054439:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355712:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143763.054445:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459880/2, rc 0, transno 21474840412 00000100:00100000:2.0:1746143763.054448:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594355840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143763.054486:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3295:x1830963594355072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1683us (1730us total) trans 21474840414 rc 0/0 00000100:00100000:0.0:1746143763.054491:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13381 00000004:00080000:1.0:1746143763.054494:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5c22300/2, rc 0, transno 21474840414 00000100:00100000:1.0:1746143763.054497:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594355072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143763.057593:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143763.057660:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183040 00000100:00100000:1.0:1746143763.057669:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183040 00000100:00100000:1.0:1746143763.057774:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9181 00000100:00100000:1.0:1746143763.057782:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31323:x1830963594183040:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143763.057801:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143763.057819:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20200/0xe984082ccd72fc39 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78ab expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.057947:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143763.057960:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143763.057970:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143763.057992:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000004:00200000:1.0:1746143763.057995:0:14763:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143763.058007:0:14763:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143763.058029:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20200/0xe984082ccd72fc39 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.058052:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143763.058058:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143763.058060:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143763.058062:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac20600, rc 0) 00000100:00100000:1.0:1746143763.058106:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31323:x1830963594183040:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 324us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.058115:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9181 00000100:00100000:0.0:1746143763.060205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.060244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143763.060395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.060401:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183296 00000100:00100000:0.0:1746143763.060408:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.060410:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183296 00000100:00100000:0.0:1746143763.060433:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143763.060444:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183552 00000100:00100000:2.0:1746143763.060446:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183552 00000100:00100000:2.0:1746143763.060469:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183808 00000100:00100000:2.0:1746143763.060471:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183808 00000100:00100000:2.0:1746143763.060480:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183168 00000100:00100000:2.0:1746143763.060481:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183168 00000100:00100000:2.0:1746143763.060489:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183424 00000100:00100000:2.0:1746143763.060491:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183424 00000100:00100000:0.0:1746143763.060501:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13383 00000100:00100000:2.0:1746143763.060507:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13384 00000100:00100000:0.0:1746143763.060508:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594183296:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143763.060511:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594183552:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143763.060514:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13385 00000100:00100000:1.0:1746143763.060523:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594183808:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143763.060525:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.060525:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143763.060541:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78c7 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.060541:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78b9 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143763.060564:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a12, atime: 0x68140a10, ctime: 0x68140a12, blocks: 0x81f 00002000:00010000:0.0:1746143763.060564:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a0f, atime: 0x68140a0f, ctime: 0x68140a0f, blocks: 0x81d 00010000:00010000:2.0:1746143763.060580:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.060580:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.060580:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143763.060582:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.060582:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143763.060590:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.060590:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.060591:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78d5 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143763.060604:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746143763.060604:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a12, atime: 0x68140a12, ctime: 0x68140a12, blocks: 0x1029 00010000:00010000:0.0:1746143763.060604:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143763.060613:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090cecc00, rc 0) 00010000:00010000:1.0:1746143763.060613:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.060613:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181a00, rc 0) 00010000:00010000:1.0:1746143763.060614:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143763.060619:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.060629:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 12 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143763.060637:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac20000, rc 0) 00000100:00100000:0.0:1746143763.060652:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594183296:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 144us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.060658:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13383 00000100:00100000:0.0:1746143763.060673:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13386 00000100:00100000:0.0:1746143763.060679:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594183168:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143763.060685:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.060694:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78b2 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143763.060700:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13387 00002000:00010000:0.0:1746143763.060704:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a10, atime: 0x68140a0e, ctime: 0x68140a10, blocks: 0x7a7 00000100:00100000:3.0:1746143763.060708:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594183424:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143763.060711:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143763.060712:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143763.060714:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143763.060716:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143763.060724:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.060727:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78c0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143763.060731:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181c00, rc 0) 00002000:00010000:3.0:1746143763.060738:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a12, atime: 0x68140a11, ctime: 0x68140a12, blocks: 0x821 00010000:00010000:3.0:1746143763.060744:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143763.060745:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143763.060749:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.060756:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.060761:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1200, rc 0) 00000100:00100000:2.0:1746143763.061235:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594183552:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 722us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.061239:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13384 00000100:00100000:1.0:1746143763.061399:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594183808:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 732us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.061403:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13385 00000100:00100000:0.0:1746143763.061901:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594183168:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1221us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.061907:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13386 00000100:00100000:3.0:1746143763.062103:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594183424:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1396us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.062108:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13387 00000100:00100000:2.0:1746143763.062623:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143763.062717:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594183680 00000100:00100000:3.0:1746143763.062723:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594183680 00000100:00100000:3.0:1746143763.062764:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13388 00000100:00100000:3.0:1746143763.062770:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594183680:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143763.062781:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143763.062794:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78ce expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143763.062814:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a12, atime: 0x68140a12, ctime: 0x68140a12, blocks: 0x1487 00010000:00010000:3.0:1746143763.062828:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143763.062835:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143763.062842:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.062854:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143763.062864:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1000, rc 0) 00000100:00100000:3.0:1746143763.062906:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594183680:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.062912:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13388 00000001:00080000:2.0:1746143763.222669:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840414 is committed 00000001:00080000:2.0:1746143763.222690:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840372 is committed 00000001:00080000:2.0:1746143763.222714:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840405 is committed 00000001:00080000:2.0:1746143763.222722:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840399 is committed 00000001:00080000:2.0:1746143763.222774:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840401 is committed 00000001:00080000:2.0:1746143763.222867:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840404 is committed 00000100:00100000:1.0:1746143763.277382:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594356096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143763.277452:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143763.277636:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356096 00000100:00100000:2.0:1746143763.277644:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356096 00000100:00100000:2.0:1746143763.277694:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1746143763.277701:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963594356096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143763.277738:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 562495488 pending 0 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746143763.277784:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1830963594356096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143763.277789:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1746143763.277819:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840414 gen 2 00000004:00080000:1.0:1746143763.277825:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305c9c00, transno 21474840339 00000004:00080000:1.0:1746143763.277941:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a2300, transno 21474840340 00000004:00080000:1.0:1746143763.277946:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79e680, transno 21474840341 00000004:00080000:1.0:1746143763.277948:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3b80, transno 21474840342 00000004:00080000:1.0:1746143763.277951:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f480, transno 21474840343 00000004:00080000:1.0:1746143763.277953:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3800, transno 21474840344 00000004:00080000:1.0:1746143763.277956:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3100, transno 21474840345 00000004:00080000:1.0:1746143763.277958:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a1f80, transno 21474840346 00000004:00080000:1.0:1746143763.277961:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459180, transno 21474840347 00000004:00080000:1.0:1746143763.277964:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691a300, transno 21474840352 00000004:00080000:1.0:1746143763.277966:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919c00, transno 21474840353 00000004:00080000:1.0:1746143763.277968:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca6dc00, transno 21474840354 00000004:00080000:1.0:1746143763.277970:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136918a80, transno 21474840355 00000004:00080000:1.0:1746143763.277973:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca6f100, transno 21474840356 00000004:00080000:1.0:1746143763.277975:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919880, transno 21474840357 00000004:00080000:1.0:1746143763.277977:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691b480, transno 21474840358 00000004:00080000:1.0:1746143763.277980:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca6e680, transno 21474840359 00000004:00080000:1.0:1746143763.277982:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093804380, transno 21474840360 00000004:00080000:1.0:1746143763.277985:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c277480, transno 21474840361 00000004:00080000:1.0:1746143763.277987:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1edc00, transno 21474840362 00000004:00080000:1.0:1746143763.277989:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c274000, transno 21474840363 00000004:00080000:1.0:1746143763.277992:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1edf80, transno 21474840364 00000004:00080000:1.0:1746143763.277994:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3480, transno 21474840365 00000004:00080000:1.0:1746143763.277997:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1efb80, transno 21474840366 00000004:00080000:1.0:1746143763.277999:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ef100, transno 21474840367 00000004:00080000:1.0:1746143763.278001:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca6ce00, transno 21474840368 00000004:00080000:1.0:1746143763.278004:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c276300, transno 21474840369 00000004:00080000:1.0:1746143763.278007:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0a80, transno 21474840378 00000004:00080000:1.0:1746143763.278009:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0000, transno 21474840379 00000004:00080000:1.0:1746143763.278012:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0700, transno 21474840380 00000004:00080000:1.0:1746143763.278014:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d3100, transno 21474840381 00000004:00080000:1.0:1746143763.278016:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe1180, transno 21474840382 00000004:00080000:1.0:1746143763.278018:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe3b80, transno 21474840383 00000004:00080000:1.0:1746143763.278021:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2d80, transno 21474840384 00000004:00080000:1.0:1746143763.278023:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c12680, transno 21474840385 00000004:00080000:1.0:1746143763.278026:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d0000, transno 21474840386 00000004:00080000:1.0:1746143763.278028:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c10a80, transno 21474840387 00000004:00080000:1.0:1746143763.278030:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0f480, transno 21474840388 00000004:00080000:1.0:1746143763.278032:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f186300, transno 21474840389 00000004:00080000:1.0:1746143763.278034:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cea00, transno 21474840390 00000004:00080000:1.0:1746143763.278035:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0c700, transno 21474840391 00000004:00080000:1.0:1746143763.278037:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cdf80, transno 21474840392 00000004:00080000:1.0:1746143763.278039:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c0d880, transno 21474840393 00000004:00080000:1.0:1746143763.278040:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cd500, transno 21474840394 00000004:00080000:1.0:1746143763.278042:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767100, transno 21474840395 00000004:00080000:1.0:1746143763.278043:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c22680, transno 21474840406 00000004:00080000:1.0:1746143763.278045:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c22d80, transno 21474840407 00000004:00080000:1.0:1746143763.278046:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c21880, transno 21474840408 00000004:00080000:1.0:1746143763.278047:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c20700, transno 21474840409 00000004:00080000:1.0:1746143763.278048:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c20000, transno 21474840410 00000004:00080000:1.0:1746143763.278050:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094458000, transno 21474840411 00000004:00080000:1.0:1746143763.278051:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459880, transno 21474840412 00000004:00080000:1.0:1746143763.278052:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094458380, transno 21474840413 00000004:00080000:1.0:1746143763.278054:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5c22300, transno 21474840414 00000100:00100000:1.0:1746143763.278066:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594356096:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1746143763.278701:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 54 done 00000100:00100000:3.0:1746143763.295337:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963594356480:0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295403:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.295464:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143763.295469:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830963594356608:0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295486:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.295515:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963594356224:0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295539:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.295563:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746143763.295567:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963594356352:0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295583:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143763.295607:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356224 00000100:00100000:3.0:1746143763.295615:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356224 00000100:00100000:3.0:1746143763.295648:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746143763.295655:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3292:x1830963594356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295692:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3292:x1830963594356224:12345-0@lo:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.295698:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746143763.295723:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356480 00000100:00100000:3.0:1746143763.295725:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356480 00000100:00100000:3.0:1746143763.295750:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356608 00000100:00100000:3.0:1746143763.295752:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356608 00000100:00100000:3.0:1746143763.295762:0:21713:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356352 00000100:00100000:3.0:1746143763.295764:0:21713:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356352 00000100:00100000:3.0:1746143763.295775:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1746143763.295779:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963594356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143763.295794:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746143763.295803:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963594356480:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.295806:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963594356608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295808:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1746143763.295816:0:21713:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1746143763.295819:0:21713:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963594356352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143763.295830:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1830963594356608:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143763.295835:0:21713:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963594356352:12345-0@lo:400:kworker.0 Request processed in 15us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143763.295835:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1746143763.295839:0:21713:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1746143763.295868:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963594356352:0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295875:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963594356224:0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295899:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3294:1830963594356608:0@lo:400:kworker.0 00000100:00100000:3.0:1746143763.295907:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963594356480:0@lo:400:kworker.0 00000100:00080000:3.0:1746143763.295931:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143763.309381:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746143763.309403:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a050f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594356736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143763.309473:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143763.309573:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356736 00000100:00100000:0.0:1746143763.309581:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356736 00000100:00100000:0.0:1746143763.309624:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1746143763.309631:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963594356736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143763.309665:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 586219520 pending 39190528 free 3853516800 avail 3851419648 00000100:00100000:0.0:1746143763.309702:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963594356736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143763.309707:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1746143763.309905:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a050f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594356736:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1746143763.687355:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873094 is committed 00000001:00080000:3.0:1746143763.687369:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873074 is committed 00000001:00080000:3.0:1746143763.687428:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873048 is committed 00000001:00080000:3.0:1746143763.687445:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873081 is committed 00000001:00080000:3.0:1746143763.687452:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873079 is committed 00000001:00080000:3.0:1746143763.687490:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873086 is committed 00000001:00080000:3.0:1746143763.687498:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873082 is committed 00000001:00080000:3.0:1746143763.687560:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873085 is committed 00010000:00010000:2.0:1746143763.771354:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143764.072736:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.072825:0:8502:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594184064 00000100:00100000:1.0:1746143764.072835:0:8502:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594184064 00000100:00100000:1.0:1746143764.072926:0:8502:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6283 00000100:00100000:1.0:1746143764.072935:0:8502:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594184064:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143764.072969:0:8502:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.072980:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.072982:0:8502:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.072986:0:8502:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.072998:0:8502:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143764.073623:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143764.073757:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.074135:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594184320 00000100:00100000:2.0:1746143764.074183:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594184320 00000100:00080000:3.0:1746143764.074247:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143764.074257:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6284 00000100:00100000:2.0:1746143764.074265:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594184320:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143764.074296:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.074309:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.074310:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.074315:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.074327:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143764.075819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.075845:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594184704 00000100:00100000:0.0:1746143764.075850:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594184704 00000100:00100000:0.0:1746143764.075884:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6285 00000100:00100000:0.0:1746143764.075889:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594184704:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143764.075908:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.075919:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.075921:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.075924:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.075933:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.081282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.081316:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.081344:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.081412:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594184832 00000100:00100000:2.0:1746143764.081434:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594184832 00000100:00100000:2.0:1746143764.081509:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594185216 00000100:00100000:2.0:1746143764.081514:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594185216 00000100:00100000:2.0:1746143764.081540:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594185344 00000100:00100000:2.0:1746143764.081544:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594185344 00000100:00100000:2.0:1746143764.081575:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6286 00000100:00100000:2.0:1746143764.081586:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594184832:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143764.081633:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.081650:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.081652:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.081658:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.081672:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.082387:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6287 00000100:00100000:3.0:1746143764.082400:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594185216:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143764.082431:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.082444:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.082446:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.082450:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.082462:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.082639:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6288 00000100:00100000:3.0:1746143764.082646:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594185344:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143764.082663:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.082670:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.082672:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.082674:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.082682:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.083643:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.085951:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594185600 00000100:00100000:0.0:1746143764.085962:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594185600 00000100:00100000:0.0:1746143764.086008:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6289 00000100:00100000:0.0:1746143764.086015:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594185600:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143764.086039:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.086050:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.086051:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.086056:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.086066:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.086343:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.086411:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594185856 00000100:00100000:3.0:1746143764.086415:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594185856 00000100:00100000:3.0:1746143764.086441:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6290 00000100:00100000:3.0:1746143764.086446:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594185856:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143764.086461:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.086469:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.086471:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.086474:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.086487:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.104416:0:8502:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.104432:0:8502:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.104440:0:8502:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.104446:0:8502:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff25600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143764.104450:0:8502:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.104456:0:8502:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.104473:0:8502:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.104478:0:8502:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff25600/0xe984082ccd72fc71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.107163:0:8502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594184064:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 34222us (34433us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.107174:0:8502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6283 00010000:00010000:1.0:1746143764.111486:0:26145:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.111500:0:26145:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.111507:0:26145:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.111513:0:26145:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6346000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143764.111516:0:26145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.111522:0:26145:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.111536:0:26145:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.111546:0:26145:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd72fc7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.111611:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594184704:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 35717us (35877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.111618:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6285 00010000:00010000:2.0:1746143764.116675:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.116691:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.116699:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.116705:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf12c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143764.116709:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.116716:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.116732:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.116738:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd72fc78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.116829:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594184320:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 42557us (43066us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.116837:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6284 00010000:00010000:0.0:1746143764.133830:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.133844:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.133851:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.133857:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf13e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143764.133860:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.133866:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.133881:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.133886:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13e00/0xe984082ccd72fc86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143764.133978:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594184832:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 52389us (52704us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143764.133987:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6286 00010000:00010000:3.0:1746143764.136743:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.136756:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.136762:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.136767:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c34a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143764.136770:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.136776:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.136790:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.136795:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c34a00/0xe984082ccd72fc8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.136858:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594185216:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 54460us (55538us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.136870:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6287 00010000:00010000:3.0:1746143764.145034:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.145049:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.145056:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.145061:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c35600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143764.145065:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.145072:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.145087:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.145093:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c35600/0xe984082ccd72fca2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.145176:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594185856:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 58725us (58829us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.145184:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6290 00010000:00010000:2.0:1746143764.149587:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.149603:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.149610:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.149617:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c34800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143764.149621:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.149627:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.149641:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.149646:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c34800/0xe984082ccd72fc94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.149716:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594185344:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 67067us (68368us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.149724:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6288 00010000:00010000:1.0:1746143764.151969:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.151982:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.151990:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.151996:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6346800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143764.151999:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.152006:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.152021:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.152026:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd72fc9b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.152112:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a050c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594185600:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 66094us (68468us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.152120:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6289 00000100:00100000:0.0:1746143764.160931:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.161044:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594185984 00000100:00100000:2.0:1746143764.161052:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594185984 00000100:00100000:2.0:1746143764.161903:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 731 00000100:00100000:2.0:1746143764.161912:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31323:x1830963594185984:12345-192.168.202.48@tcp:103:mirror_io.0 00010000:00010000:2.0:1746143764.161925:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.161947:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181800/0xe984082ccd72fbec lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7896 expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.162651:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143764.162657:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.162704:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31323:x1830963594185984:12345-192.168.202.48@tcp:103:mirror_io.0 Request processed in 793us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.162710:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 731 00000100:00080000:3.0:1746143764.162807:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143764.165659:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.165830:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594186240 00000100:00100000:2.0:1746143764.165838:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594186240 00000100:00100000:1.0:1746143764.166432:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3937 00000100:00100000:1.0:1746143764.166446:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31323:x1830963594186240:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143764.166667:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31323:x1830963594186240:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 226us (1013us total) trans 8589943503 rc 0/0 00000100:00100000:1.0:1746143764.166673:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3937 00000100:00100000:0.0:1746143764.167909:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.167981:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594186496 00000100:00100000:1.0:1746143764.167986:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594186496 00000100:00100000:1.0:1746143764.168022:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3938 00000100:00100000:1.0:1746143764.168028:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31323:x1830963594186496:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143764.168277:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31323:x1830963594186496:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 248us (369us total) trans 8589943504 rc 0/0 00000100:00100000:1.0:1746143764.168284:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3938 00000100:00100000:0.0:1746143764.186520:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.186574:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.187000:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594186752 00000100:00100000:3.0:1746143764.187008:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594186752 00000100:00100000:2.0:1746143764.187216:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594187008 00000100:00100000:2.0:1746143764.187220:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594187008 00000100:00100000:3.0:1746143764.187301:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9182 00000100:00100000:3.0:1746143764.187308:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31332:x1830963594186752:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143764.187327:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.187341:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35c00/0xe984082ccd72fca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78dc expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.187555:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187565:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187575:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187584:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187589:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187594:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187810:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34000/0xe984082ccd72fcbe lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187817:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34000/0xe984082ccd72fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187823:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34000/0xe984082ccd72fcbe lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143764.187835:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143764.187901:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187906:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187911:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187916:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c34800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143764.187919:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187925:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187933:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143764.187936:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143764.187939:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187943:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187977:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187982:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187987:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.187994:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c35600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143764.187997:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.188002:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.188008:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009066d200) 00010000:00010000:3.0:1746143764.188010:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143764.188012:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.188016:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35600/0xe984082ccd72fcb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.188047:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35c00/0xe984082ccd72fca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78dc expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.188056:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34000/0xe984082ccd72fcbe lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78dc expref: 242 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.188062:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.188064:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143764.188067:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c34000, rc 0) 00000100:00100000:2.0:1746143764.188250:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9183 00000100:00100000:2.0:1746143764.188256:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:31333:x1830963594187008:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143764.188266:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.188272:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12400/0xe984082ccd72fccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78e3 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.188309:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188315:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188321:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188329:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188333:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188337:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188381:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188387:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188393:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143764.188398:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:2.0:1746143764.188433:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188438:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188442:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188446:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf13a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143764.188449:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188453:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188459:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143764.188461:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143764.188463:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188467:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fcd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188476:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188484:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188488:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188492:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf13200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143764.188493:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188498:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188502:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cda00) 00010000:00010000:2.0:1746143764.188504:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143764.188506:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188510:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fcda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143764.188530:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12400/0xe984082ccd72fccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.188538:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.188542:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143764.188544:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143764.188546:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13600, rc 0) 00000100:00080000:0.0:1746143764.188701:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143764.190325:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31333:x1830963594187008:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2063us (3744us total) trans 8589943506 rc 0/0 00000100:00100000:2.0:1746143764.190335:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9183 00000100:00100000:3.0:1746143764.190393:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31332:x1830963594186752:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3085us (3879us total) trans 8589943505 rc 0/0 00000100:00100000:3.0:1746143764.190400:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9182 00000100:00100000:0.0:1746143764.200363:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.200427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.200489:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594187264 00000100:00100000:2.0:1746143764.200497:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594187264 00000100:00100000:3.0:1746143764.200506:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594187520 00000100:00100000:3.0:1746143764.200510:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594187520 00000100:00100000:3.0:1746143764.200535:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9184 00000100:00100000:3.0:1746143764.200542:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31336:x1830963594187520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.200564:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.200841:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35e00/0xe984082ccd72fcef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78f1 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.200925:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.200936:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.200945:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143764.200955:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00000100:00100000:2.0:1746143764.201074:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9185 00000100:00100000:2.0:1746143764.201081:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31335:x1830963594187264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.201089:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.201095:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fd04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78ea expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.201126:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fd0b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143764.201133:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fd0b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143764.201162:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fd0b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143764.201169:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143764.201188:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35e00/0xe984082ccd72fcef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.201217:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.201222:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13200/0xe984082ccd72fd04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ea expref: 245 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.201224:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.201226:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143764.201229:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c35200, rc 0) 00010000:00010000:2.0:1746143764.201234:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fd0b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ea expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.201238:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143764.201240:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143764.201241:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13a00, rc 0) 00000100:00100000:3.0:1746143764.201265:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31336:x1830963594187520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 724us (842us total) trans 8589943507 rc 0/0 00000100:00100000:2.0:1746143764.201265:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31335:x1830963594187264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 185us (910us total) trans 8589943508 rc 0/0 00000100:00100000:3.0:1746143764.201270:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9184 00000100:00100000:2.0:1746143764.201273:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9185 00000100:00100000:0.0:1746143764.209330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.209388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.209427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.209455:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.209457:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594187776 00000100:00100000:1.0:1746143764.209464:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594187776 00000100:00100000:0.0:1746143764.209467:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.209479:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188032 00000100:00100000:0.0:1746143764.209481:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188032 00000100:00100000:0.0:1746143764.209501:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188288 00000100:00100000:0.0:1746143764.209508:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188288 00000100:00100000:1.0:1746143764.209974:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594187648 00000100:00100000:0.0:1746143764.209975:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594187904 00000100:00100000:1.0:1746143764.209977:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594187648 00000100:00100000:0.0:1746143764.209978:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594187904 00000100:00100000:1.0:1746143764.209994:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13389 00000100:00100000:0.0:1746143764.209998:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13390 00000100:00100000:1.0:1746143764.210000:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+14:1964:x1830963594188032:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143764.210002:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594187776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.210014:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143764.210014:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.210028:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a790d expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.210028:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78ff expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.210045:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.210045:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.210047:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.210047:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.210053:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.210053:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.210066:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.210066:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.210074:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e45600, rc 0) 00010000:00010000:0.0:1746143764.210074:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092933c00, rc 0) 00000100:00100000:1.0:1746143764.210111:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594188032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.210113:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13391 00000100:00100000:1.0:1746143764.210117:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13389 00000100:00100000:2.0:1746143764.210119:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594188288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.210125:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143764.210128:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13392 00000100:00100000:1.0:1746143764.210131:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+14:1964:x1830963594187648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.210132:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a791b expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.210135:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.210161:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a78f8 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.210163:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.210164:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.210168:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.210170:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.210171:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.210174:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.210177:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.210182:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.210184:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12400, rc 0) 00010000:00010000:1.0:1746143764.210192:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e44600, rc 0) 00000100:00100000:3.0:1746143764.210246:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13393 00000100:00100000:3.0:1746143764.210252:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594187904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.210258:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.210264:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7906 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.210272:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.210273:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.210277:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 23 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.210284:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 23 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.210290:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c35000, rc 0) 00000100:00100000:2.0:1746143764.210614:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594188288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 495us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.210615:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594187648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 483us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.210619:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13391 00000100:00100000:3.0:1746143764.210636:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594187904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 384us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.210651:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13392 00000100:00080000:1.0:1746143764.210680:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143764.210683:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143764.210709:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13393 00000100:00100000:3.0:1746143764.210760:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.210808:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188160 00000100:00100000:2.0:1746143764.210811:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188160 00000100:00100000:3.0:1746143764.210813:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.210825:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188544 00000100:00100000:3.0:1746143764.210827:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13394 00000100:00100000:2.0:1746143764.210827:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188544 00000100:00100000:3.0:1746143764.210832:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594188160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.210838:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143764.210842:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13395 00010000:00010000:3.0:1746143764.210844:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7914 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.210845:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:1962:x1830963594188544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.210850:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.210853:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.210854:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.210855:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7929 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.210858:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 16 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.210864:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.210865:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.210866:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 16 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.210869:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 7 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.210873:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c34200, rc 0) 00010000:00010000:2.0:1746143764.210876:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 7 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.210881:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12600, rc 0) 00000100:00100000:3.0:1746143764.210885:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594188160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.210889:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13394 00000100:00100000:2.0:1746143764.210892:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1962:x1830963594188544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 46us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.210896:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13395 00000100:00100000:3.0:1746143764.210918:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.210930:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188800 00000100:00100000:2.0:1746143764.210933:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188800 00000100:00100000:3.0:1746143764.210940:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.210952:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594189056 00000100:00100000:2.0:1746143764.210954:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594189056 00000100:00100000:2.0:1746143764.210965:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13396 00000100:00100000:2.0:1746143764.210968:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+5:1962:x1830963594188800:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.210974:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.210979:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7937 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.210987:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.210989:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.210992:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.211004:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.211010:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12a00, rc 0) 00000100:00100000:2.0:1746143764.211024:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:1962:x1830963594188800:12345-192.168.202.48@tcp:101:cat.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.211029:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13396 00000100:00100000:2.0:1746143764.211038:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13397 00000100:00100000:2.0:1746143764.211042:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1962:x1830963594189056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.211047:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.211051:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7945 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.211060:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.211061:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.211064:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.211071:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.211076:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13800, rc 0) 00000100:00100000:2.0:1746143764.211089:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594189056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.211093:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13397 00000100:00080000:1.0:1746143764.211159:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143764.211161:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143764.211278:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.211342:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594187776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 593us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.211348:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13390 00000100:00100000:0.0:1746143764.214219:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188416 00000100:00100000:0.0:1746143764.214229:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188416 00000100:00100000:3.0:1746143764.214257:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.214277:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.214302:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188672 00000100:00100000:0.0:1746143764.214304:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188672 00000100:00100000:0.0:1746143764.214317:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594188928 00000100:00100000:0.0:1746143764.214319:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594188928 00000100:00100000:0.0:1746143764.214330:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13398 00000100:00100000:0.0:1746143764.214335:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1962:x1830963594188416:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143764.214336:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143764.214349:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143764.214362:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13399 00010000:00010000:0.0:1746143764.214363:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7922 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.214368:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594188672:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.214373:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.214380:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7930 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.214382:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.214383:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.214388:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.214389:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.214390:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.214392:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.214401:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 9 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.214401:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.214410:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c35e00, rc 0) 00010000:00010000:0.0:1746143764.214411:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092932a00, rc 0) 00000100:00100000:3.0:1746143764.214446:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594188672:12345-192.168.202.48@tcp:101:cat.0 Request processed in 79us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.214446:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13400 00000100:00100000:3.0:1746143764.214451:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13399 00000100:00100000:1.0:1746143764.214452:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594188928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.214457:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.214464:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a793e expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.214473:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.214474:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.214478:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.214486:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.214491:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8e45e00, rc 0) 00000100:00100000:0.0:1746143764.215043:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594188416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 706us (3764us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.215049:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13398 00000100:00100000:1.0:1746143764.215098:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0a96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594188928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 646us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.215103:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13400 00000100:00100000:1.0:1746143764.215119:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594189312 00000100:00100000:1.0:1746143764.215122:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594189312 00000100:00100000:1.0:1746143764.215159:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9186 00000100:00100000:1.0:1746143764.215164:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31332:x1830963594189312:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143764.215176:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.215178:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746143764.215193:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd72fd0b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ea expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215234:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34000/0xe984082ccd72fcbe lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78dc expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215244:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143764.215247:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143764.215254:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e45200/0xe984082ccd72fd6d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a794c expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215296:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.215306:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215313:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215319:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215325:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215331:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.215353:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215368:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 9 pid: 16090 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.215378:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a050fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594356864:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.215465:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215472:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.215480:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a050f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594356992:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.215501:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215509:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 9 pid: 14762 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.215515:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594357120:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.215534:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.215545:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 9 pid: 16090 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.215551:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594357248:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.215566:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.233240:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.233305:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594189440 00000100:00100000:2.0:1746143764.233313:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594189440 00000100:00100000:0.0:1746143764.233319:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.233351:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9187 00000100:00100000:0.0:1746143764.233352:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.233357:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31335:x1830963594189440:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143764.233365:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594189824 00000100:00100000:0.0:1746143764.233367:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594189824 00010000:00010000:2.0:1746143764.233376:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143764.233384:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 10 pid: 14762 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.233388:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7953 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143764.233400:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594189952 00000100:00100000:0.0:1746143764.233401:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594189952 00010000:00010000:0.0:1746143764.233407:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 10 pid: 16090 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143764.233522:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7173 00000100:00100000:1.0:1746143764.233538:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7174 00000100:00100000:1.0:1746143764.233545:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594189952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143764.233556:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143764.233560:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 10 pid: 16090 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.233569:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 10 pid: 16090 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.233584:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143764.233588:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.233595:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.233599:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143764.233635:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594189952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.233639:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7174 00000100:00100000:1.0:1746143764.233675:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a050fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594356864:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.233684:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a050f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594356992:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.233689:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594357120:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.233696:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181200/0xe984082ccd72fc32 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78a4 expref: 9 pid: 16090 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.233714:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594357248:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.233731:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143764.234848:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594189824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.235332:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.235342:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 10 pid: 14762 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.235351:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 10 pid: 14762 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.235366:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c35200/0xe984082ccd72fcf6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f1 expref: 10 pid: 14762 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.235386:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143764.235390:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143764.235395:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143764.235399:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.235418:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594189824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1891us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.235424:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7173 00000100:00100000:0.0:1746143764.235460:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.235497:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.235568:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.235596:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594189568 00000100:00100000:0.0:1746143764.235600:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594189568 00010000:00010000:0.0:1746143764.235613:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 9 pid: 16090 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143764.235627:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594189696 00000100:00100000:0.0:1746143764.235628:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594189696 00010000:00010000:0.0:1746143764.235635:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143764.236047:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7175 00000100:00100000:3.0:1746143764.236079:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594190080 00000100:00100000:3.0:1746143764.236082:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594190080 00000100:00100000:3.0:1746143764.236101:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9188 00000100:00100000:3.0:1746143764.236104:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31336:x1830963594190080:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.236108:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143764.236115:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 245 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.236119:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.236127:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a795a expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.236130:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143764.236150:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 245 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.236159:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143764.236161:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143764.236163:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143764.236168:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12000, rc 0) 00000100:00100000:2.0:1746143764.236191:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31335:x1830963594189440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2834us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.236206:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9187 00010000:00010000:3.0:1746143764.236256:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.236265:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.236275:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.236277:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143764.236279:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.236283:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c34800, rc 0) 00000100:00100000:3.0:1746143764.236303:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31336:x1830963594190080:12345-192.168.202.48@tcp:101:cat.0 Request processed in 198us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.236308:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9188 00000100:00100000:3.0:1746143764.236322:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594189568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.236330:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.236334:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 10 pid: 16090 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.236342:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 10 pid: 16090 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.236352:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd72fce1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78e3 expref: 10 pid: 16090 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.236376:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.236379:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.236384:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.236388:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.236402:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594189568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 336us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.236408:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7175 00000100:00100000:0.0:1746143764.238500:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7176 00000100:00100000:0.0:1746143764.238511:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594189696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.238522:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.238528:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.238538:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.238556:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac20600/0xe984082ccd72fc40 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ab expref: 9 pid: 14763 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.238568:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143764.238572:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143764.238579:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143764.238583:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143764.238590:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 244 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.239066:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.239107:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594189696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 600us (3608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.239113:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7176 00010000:00010000:1.0:1746143764.239300:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.239307:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00000040:00080000:1.0:1746143764.241109:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2668, 88 off225320 00000004:00080000:1.0:1746143764.241119:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843250978892ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.241896:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2686, 88 off227080 00000004:00080000:1.0:1746143764.241901:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251761625ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143764.241910:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2687, 88 off227168 00000004:00080000:1.0:1746143764.241913:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251773167ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143764.241919:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2669, 88 off225408 00000004:00080000:1.0:1746143764.241922:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251782083ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.241927:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2670, 88 off225496 00000004:00080000:1.0:1746143764.241930:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251789947ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.241935:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2688, 88 off227256 00000004:00080000:1.0:1746143764.241937:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251797400ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143764.241943:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2689, 88 off227344 00000004:00080000:1.0:1746143764.241946:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251806107ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143764.241952:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2690, 88 off227432 00000004:00080000:1.0:1746143764.241954:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251814295ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143764.241960:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2671, 88 off225584 00000004:00080000:1.0:1746143764.241962:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251822279ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.241967:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2691, 88 off227520 00000004:00080000:1.0:1746143764.241969:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251829485ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143764.241975:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2672, 88 off225672 00000004:00080000:1.0:1746143764.241977:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251837110ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.241982:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2692, 88 off227608 00000004:00080000:1.0:1746143764.241985:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251845634ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143764.241991:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2673, 88 off225760 00000004:00080000:1.0:1746143764.241993:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251853815ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.241999:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2674, 88 off225848 00000004:00080000:1.0:1746143764.242001:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251861643ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.242006:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2675, 88 off225936 00000004:00080000:1.0:1746143764.242009:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251869007ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.242014:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2676, 88 off226024 00000004:00080000:1.0:1746143764.242016:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 843251876543ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143764.242021:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2693, 88 off227696 00000004:00080000:1.0:1746143764.242025:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 843251885455ns, next at 833304778357ns, rc = 0 00000001:00080000:0.0:1746143764.270287:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943509 is committed 00000004:00080000:0.0:1746143764.270295:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2029 committed 00000004:00080000:0.0:1746143764.270302:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2012 committed 00000004:00080000:0.0:1746143764.270319:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2011 committed 00000004:00080000:0.0:1746143764.270320:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2010 committed 00000004:00080000:0.0:1746143764.270323:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2009 committed 00000004:00080000:0.0:1746143764.270324:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2028 committed 00000004:00080000:0.0:1746143764.270326:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2008 committed 00000004:00080000:0.0:1746143764.270327:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2027 committed 00000004:00080000:0.0:1746143764.270328:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2007 committed 00000004:00080000:0.0:1746143764.270329:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2026 committed 00000004:00080000:0.0:1746143764.270331:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2025 committed 00000004:00080000:0.0:1746143764.270332:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2024 committed 00000004:00080000:0.0:1746143764.270333:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2006 committed 00000004:00080000:0.0:1746143764.270334:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2005 committed 00000004:00080000:0.0:1746143764.270335:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2023 committed 00000004:00080000:0.0:1746143764.270336:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2022 committed 00000004:00080000:0.0:1746143764.270337:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2004 committed 00000001:00080000:0.0:1746143764.270343:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943504 is committed 00000001:00080000:0.0:1746143764.270353:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943506 is committed 00000001:00080000:0.0:1746143764.270358:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943507 is committed 00000100:00100000:2.0:1746143764.270700:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594357376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270753:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270806:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594357888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270824:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270840:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746143764.270844:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594357760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270858:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270869:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594358272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270881:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270895:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594357632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270908:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270918:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594358144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270929:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270939:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143764.270943:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594357504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270955:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270963:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594358016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143764.270978:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143764.270999:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357376 00000100:00100000:2.0:1746143764.271005:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357376 00000100:00100000:2.0:1746143764.271031:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357888 00000100:00100000:2.0:1746143764.271033:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357888 00000100:00100000:2.0:1746143764.271041:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357760 00000100:00100000:2.0:1746143764.271042:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357760 00000100:00100000:2.0:1746143764.271050:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358272 00000100:00100000:2.0:1746143764.271051:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358272 00000100:00100000:2.0:1746143764.271058:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357632 00000100:00100000:2.0:1746143764.271059:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357632 00000100:00100000:2.0:1746143764.271065:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358144 00000100:00100000:2.0:1746143764.271066:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358144 00000100:00100000:2.0:1746143764.271071:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357504 00000100:00100000:2.0:1746143764.271072:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357504 00000100:00100000:2.0:1746143764.271077:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358016 00010000:00010000:1.0:1746143764.271078:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.271079:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358016 00000100:00100000:2.0:1746143764.271087:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13401 00010000:00010000:1.0:1746143764.271090:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00000100:00100000:2.0:1746143764.271092:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594357376:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746143764.271092:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143764.271096:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.271106:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.271111:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.271117:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.271123:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.271128:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.271234:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.271243:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594358400:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143764.271302:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.271308:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594358528:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143764.271323:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143764.271356:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143764.271359:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143764.271361:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143764.271362:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143759 -> 1746143759 00002000:00010000:2.0:1746143764.271364:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2077 -> 2079 00000100:00100000:2.0:1746143764.271388:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594357376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 296us (635us total) trans 17179873095 rc 0/0 00000100:00100000:2.0:1746143764.271393:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13401 00000100:00100000:2.0:1746143764.271406:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13402 00000100:00100000:2.0:1746143764.271410:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594357888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143764.271567:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271590:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271602:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271615:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271623:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746143764.271627:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594358656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271638:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271645:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271654:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271667:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594358784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271679:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271684:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594359296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271693:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271699:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143764.271701:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594358912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271710:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271716:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594359424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.271726:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143764.271737:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359040 00000100:00100000:3.0:1746143764.271740:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359040 00000100:00100000:3.0:1746143764.271753:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359552 00000100:00100000:3.0:1746143764.271755:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359552 00000100:00100000:3.0:1746143764.271760:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358656 00000100:00100000:3.0:1746143764.271761:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358656 00000100:00100000:3.0:1746143764.271766:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359168 00000100:00100000:3.0:1746143764.271767:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359168 00000100:00100000:3.0:1746143764.271771:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358784 00000100:00100000:3.0:1746143764.271772:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358784 00000100:00100000:3.0:1746143764.271777:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359296 00000100:00100000:3.0:1746143764.271778:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359296 00000100:00100000:3.0:1746143764.271782:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358912 00000100:00100000:3.0:1746143764.271783:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358912 00000100:00100000:3.0:1746143764.271787:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359424 00000100:00100000:3.0:1746143764.271788:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359424 00000100:00100000:3.0:1746143764.271795:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13403 00000100:00100000:3.0:1746143764.271799:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594357760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143764.271870:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143764.271873:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143764.271875:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143764.271876:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143764.271878:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143764.271897:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594357760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (1037us total) trans 17179873096 rc 0/0 00000100:00100000:3.0:1746143764.271902:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13403 00000100:00100000:3.0:1746143764.271911:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13404 00000100:00100000:3.0:1746143764.271915:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594358272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143764.271986:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594358272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1103us total) trans 17179873097 rc 0/0 00000100:00100000:3.0:1746143764.271991:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13404 00000100:00100000:3.0:1746143764.271998:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13405 00000100:00100000:3.0:1746143764.272002:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594357632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143764.272080:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143764.272082:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143762 -> 1746143762 00002000:00010000:3.0:1746143764.272084:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143762 -> 1746143762 00002000:00010000:3.0:1746143764.272085:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143762 -> 1746143762 00002000:00010000:3.0:1746143764.272087:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143764.272105:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594357632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1195us total) trans 17179873098 rc 0/0 00000100:00100000:3.0:1746143764.272109:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13405 00000100:00100000:3.0:1746143764.272118:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13406 00000100:00100000:3.0:1746143764.272122:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594358144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143764.272153:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13407 00000100:00100000:0.0:1746143764.272159:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594357504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143764.272188:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13408 00000100:00100000:3.0:1746143764.272193:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594358016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143764.272238:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13409 00000100:00100000:0.0:1746143764.272243:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963594359040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.272387:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594359040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (795us total) trans 21474840415 rc 0/0 00000100:00100000:0.0:1746143764.272391:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13409 00000100:00100000:0.0:1746143764.272401:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13410 00000100:00100000:0.0:1746143764.272405:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963594359552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.272478:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594359552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (861us total) trans 21474840416 rc 0/0 00000100:00100000:0.0:1746143764.272483:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13410 00000100:00100000:0.0:1746143764.272493:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13411 00000100:00100000:0.0:1746143764.272496:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963594358656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143764.272589:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143764.272591:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143764.272593:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143758 -> 1746143758 00002000:00010000:0.0:1746143764.272595:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143764.272596:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 1959 -> 2065 00000100:00100000:0.0:1746143764.272614:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594358656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (975us total) trans 21474840417 rc 0/0 00000100:00100000:0.0:1746143764.272618:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13411 00000100:00100000:0.0:1746143764.272627:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13412 00000100:00100000:0.0:1746143764.272631:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963594359168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.272703:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594359168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1047us total) trans 21474840418 rc 0/0 00000100:00100000:0.0:1746143764.272707:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13412 00000100:00100000:0.0:1746143764.272715:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13413 00000100:00100000:0.0:1746143764.272719:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963594358784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143764.272801:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143764.272803:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143762 -> 1746143762 00002000:00010000:0.0:1746143764.272805:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143760 -> 1746143760 00002000:00010000:0.0:1746143764.272806:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143762 -> 1746143762 00002000:00010000:0.0:1746143764.272807:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2081 00000100:00100000:0.0:1746143764.272840:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963594358784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (1160us total) trans 21474840419 rc 0/0 00000100:00100000:0.0:1746143764.272844:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13413 00000100:00100000:0.0:1746143764.272857:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13414 00000100:00100000:0.0:1746143764.272860:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3294:x1830963594359296:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143764.272874:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b04a80/2, rc 0, transno 21474840419 00000100:00100000:1.0:1746143764.272883:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594358784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143764.272996:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13415 00000100:00100000:2.0:1746143764.273002:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963594358912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143764.273092:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:2.0:1746143764.273094:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143762 -> 1746143762 00002000:00010000:2.0:1746143764.273095:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143762 -> 1746143762 00002000:00010000:2.0:1746143764.273097:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143762 -> 1746143762 00002000:00010000:2.0:1746143764.273098:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5255 -> 5293 00000100:00100000:2.0:1746143764.273120:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1830963594358912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (1408us total) trans 21474840421 rc 0/0 00000100:00100000:2.0:1746143764.273127:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13415 00000100:00100000:2.0:1746143764.273136:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13416 00000100:00100000:2.0:1746143764.273155:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963594359424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143764.273238:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594358016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1044us (2258us total) trans 17179873099 rc 0/0 00000100:00100000:2.0:1746143764.273238:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1830963594359424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1510us total) trans 21474840422 rc 0/0 00000100:00100000:3.0:1746143764.273243:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13408 00000100:00100000:0.0:1746143764.273280:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3294:x1830963594359296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 419us (1585us total) trans 21474840420 rc 0/0 00000004:00080000:1.0:1746143764.273327:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b07800/2, rc 0, transno 21474840421 00000100:00100000:1.0:1746143764.273331:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594358912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143764.273336:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d1500/2, rc 0, transno 21474840422 00000100:00100000:1.0:1746143764.273338:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594359424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143764.273343:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d0000/2, rc 0, transno 21474840420 00000100:00100000:1.0:1746143764.273345:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594359296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143764.273386:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594358144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1264us (2456us total) trans 17179873100 rc 0/0 00000100:00100000:2.0:1746143764.273421:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13416 00000100:00100000:0.0:1746143764.273459:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13414 00000100:00100000:1.0:1746143764.273462:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13406 00000004:00080000:0.0:1746143764.273478:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b06300/2, rc 0, transno 21474840417 00000100:00100000:0.0:1746143764.273481:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594358656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143764.273487:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2d80/2, rc 0, transno 21474840418 00000100:00100000:0.0:1746143764.273490:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143764.273495:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d3100/2, rc 0, transno 21474840415 00000100:00100000:0.0:1746143764.273497:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143764.273502:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930d2680/2, rc 0, transno 21474840416 00000100:00100000:0.0:1746143764.273504:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.273509:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143764.273513:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.273534:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746143764.273544:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143764.273546:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143762 -> 1746143762 00002000:00010000:1.0:1746143764.273548:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143761 -> 1746143761 00002000:00010000:1.0:1746143764.273550:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143762 -> 1746143762 00002000:00010000:1.0:1746143764.273551:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143764.273568:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594357504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1410us (2612us total) trans 17179873101 rc 0/0 00000100:00100000:1.0:1746143764.273573:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13407 00000100:00100000:1.0:1746143764.273581:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359680 00000100:00100000:2.0:1746143764.273582:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873094 gen 2 00000004:00080000:2.0:1746143764.273585:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ac380, transno 17179873030 00000100:00100000:1.0:1746143764.273585:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359680 00000004:00080000:2.0:1746143764.273590:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0af800, transno 17179873031 00000004:00080000:2.0:1746143764.273593:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0adf80, transno 17179873032 00000004:00080000:2.0:1746143764.273595:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0aea00, transno 17179873033 00000004:00080000:2.0:1746143764.273597:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ac000, transno 17179873034 00000100:00100000:1.0:1746143764.273597:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13417 00000004:00080000:2.0:1746143764.273599:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0aed80, transno 17179873035 00000004:00080000:2.0:1746143764.273601:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0aca80, transno 17179873036 00000100:00100000:1.0:1746143764.273601:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3292:x1830963594359680:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143764.273603:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f0ae680, transno 17179873037 00000004:00080000:2.0:1746143764.273605:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094762300, transno 17179873038 00000004:00080000:2.0:1746143764.273607:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094762680, transno 17179873039 00000004:00080000:2.0:1746143764.273609:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094763b80, transno 17179873040 00000004:00080000:2.0:1746143764.273611:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc12680, transno 17179873041 00000004:00080000:2.0:1746143764.273613:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094760700, transno 17179873042 00000004:00080000:2.0:1746143764.273615:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc13100, transno 17179873043 00000004:00080000:2.0:1746143764.273617:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094762d80, transno 17179873044 00000004:00080000:2.0:1746143764.273618:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc12300, transno 17179873045 00000004:00080000:2.0:1746143764.273621:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e17ca80, transno 17179873056 00000004:00080000:2.0:1746143764.273623:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878700, transno 17179873057 00000004:00080000:2.0:1746143764.273625:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cdc2d80, transno 17179873058 00000004:00080000:2.0:1746143764.273627:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e17df80, transno 17179873059 00000004:00080000:2.0:1746143764.273630:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cdc3100, transno 17179873060 00000004:00080000:2.0:1746143764.273632:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e17e300, transno 17179873061 00000004:00080000:2.0:1746143764.273633:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e17c700, transno 17179873062 00000004:00080000:2.0:1746143764.273635:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e17d500, transno 17179873063 00000004:00080000:2.0:1746143764.273637:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878a80, transno 17179873064 00000004:00080000:2.0:1746143764.273640:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093cea300, transno 17179873065 00000004:00080000:2.0:1746143764.273642:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085f80, transno 17179873066 00000004:00080000:2.0:1746143764.273644:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f533480, transno 17179873067 00000004:00080000:2.0:1746143764.273646:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878380, transno 17179873068 00000004:00080000:2.0:1746143764.273648:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ce9180, transno 17179873069 00000004:00080000:2.0:1746143764.273650:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0085c00, transno 17179873070 00000004:00080000:2.0:1746143764.273652:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e17d180, transno 17179873071 00000004:00080000:2.0:1746143764.273654:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530e00, transno 17179873087 00000004:00080000:2.0:1746143764.273656:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531180, transno 17179873088 00000004:00080000:2.0:1746143764.273658:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691a680, transno 17179873089 00000004:00080000:2.0:1746143764.273660:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f533100, transno 17179873090 00000004:00080000:2.0:1746143764.273663:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cdc00, transno 17179873091 00000004:00080000:2.0:1746143764.273665:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cf100, transno 17179873092 00000004:00080000:2.0:1746143764.273667:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094760380, transno 17179873093 00000004:00080000:2.0:1746143764.273669:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530700, transno 17179873094 00000100:00100000:2.0:1746143764.273674:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009c275c00 x1830963594357504/t17179873101(17179873101) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143780 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:1.0:1746143764.273679:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963594359680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (145us total) trans 21474840423 rc 0/0 00000004:00080000:2.0:1746143764.273682:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c275c00/2, rc 0, transno 17179873101 00000100:00100000:2.0:1746143764.273684:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594357504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143764.273684:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13417 00000004:00080000:2.0:1746143764.273693:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0000/2, rc 0, transno 17179873099 00000100:00100000:2.0:1746143764.273696:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594358016:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143764.273702:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79e680/2, rc 0, transno 17179873098 00000100:00100000:2.0:1746143764.273704:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594357632:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143764.273710:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0700/2, rc 0, transno 17179873100 00000100:00100000:2.0:1746143764.273712:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594358144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143764.273724:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594357888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2314us (2899us total) trans 17179873102 rc 0/0 00000004:00080000:2.0:1746143764.273727:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f480/2, rc 0, transno 17179873096 00000100:00100000:2.0:1746143764.273729:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594357760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143764.273729:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13402 00000004:00080000:2.0:1746143764.273735:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe1180/2, rc 0, transno 17179873097 00000100:00100000:2.0:1746143764.273737:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594358272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143764.273743:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c276300/2, rc 0, transno 17179873095 00000100:00100000:2.0:1746143764.273745:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594357376:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143764.273749:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0a80/2, rc 0, transno 17179873102 00000100:00100000:2.0:1746143764.273752:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594357888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143764.273964:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 40 done 00000004:00080000:0.0:1746143764.274004:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a04cf100/2, rc 0, transno 21474840423 00000100:00100000:0.0:1746143764.274007:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594359680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143764.275620:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.275680:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594358400:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143764.275695:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594358528:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143764.275695:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143764.275730:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8e45200/0xe984082ccd72fd6d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 243 pid: 20509 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746143764.275762:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.275764:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594190208 00000100:00100000:2.0:1746143764.275768:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594190208 00010000:00010000:1.0:1746143764.275789:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346800, rc 0) 00000100:00100000:2.0:1746143764.275791:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594190336 00000100:00100000:2.0:1746143764.275793:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594190336 00000100:00100000:2.0:1746143764.275806:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3939 00000100:00100000:2.0:1746143764.275811:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31335:x1830963594190208:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143764.275835:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31332:x1830963594189312:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 60669us (61496us total) trans 8589943509 rc 0/0 00000100:00100000:1.0:1746143764.275842:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9186 00000100:00100000:2.0:1746143764.275869:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31335:x1830963594190208:12345-192.168.202.48@tcp:49:cat.0 Request processed in 58us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.275874:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3939 00000100:00100000:2.0:1746143764.275884:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3940 00000100:00100000:2.0:1746143764.275888:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6442450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31336:x1830963594190336:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143764.275917:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6442450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31336:x1830963594190336:12345-192.168.202.48@tcp:49:cat.0 Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.275922:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3940 00000100:00100000:0.0:1746143764.287761:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.288282:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594190464 00000100:00100000:3.0:1746143764.288290:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594190464 00000100:00100000:3.0:1746143764.288337:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3941 00000100:00100000:3.0:1746143764.288344:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31332:x1830963594190464:12345-192.168.202.48@tcp:49:multiop.0 00000100:00100000:3.0:1746143764.288457:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31332:x1830963594190464:12345-192.168.202.48@tcp:49:multiop.0 Request processed in 114us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.288464:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3941 00000100:00100000:0.0:1746143764.300548:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.300621:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594190592 00000100:00100000:2.0:1746143764.300629:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594190592 00000100:00100000:0.0:1746143764.300833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.300972:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13418 00000100:00100000:2.0:1746143764.300980:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31332:x1830963594190592:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143764.300995:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.301008:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7961 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.301031:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 7 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.301038:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.301044:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.301049:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.301050:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.301053:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.301075:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.301084:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.301095:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594359808:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.301178:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594190848 00000100:00100000:1.0:1746143764.301182:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594190848 00002000:00100000:1.0:1746143764.301212:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012fc13480 x1830963594190848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.301220:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13480 with x1830963594190848 ext(0->1048575) 00002000:00010000:1.0:1746143764.301223:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13480 00000100:00100000:1.0:1746143764.301248:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6291 00000100:00100000:1.0:1746143764.301254:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594190848:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143764.302278:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.302292:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 8 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.302302:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594359936:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.302335:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 7 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.302342:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 7 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.302350:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360064:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.302365:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.302813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.303415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.303556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.303789:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594191232 00000100:00100000:2.0:1746143764.303793:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594191360 00000100:00100000:3.0:1746143764.303794:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594191232 00000100:00100000:2.0:1746143764.303797:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594191360 00002000:00100000:3.0:1746143764.303819:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012fc10a80 x1830963594191232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.303819:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc13800 x1830963594191360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.303827:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10a80 with x1830963594191232 ext(1048576->2097151) 00002000:00100000:2.0:1746143764.303827:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13800 with x1830963594191360 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.303830:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13800 00010000:00010000:3.0:1746143764.303833:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 24 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.303841:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 24 pid: 21542 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.303843:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594191616 00000100:00100000:2.0:1746143764.303846:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594191616 00002000:00010000:3.0:1746143764.303847:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc10a80 00002000:00100000:2.0:1746143764.303857:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc11500 x1830963594191616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143764.303862:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1785 00002000:00100000:2.0:1746143764.303864:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11500 with x1830963594191616 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.303866:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc11500 00000100:00100000:3.0:1746143764.303872:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594191232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.303883:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6292 00000100:00100000:2.0:1746143764.303888:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594191360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.304053:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6293 00000100:00100000:2.0:1746143764.304059:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594191616:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.307897:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.307936:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594359808:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.307947:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594359936:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.307956:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360064:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.307979:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [2002944->2097151] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.307994:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c18c400, rc 0) 00000100:00100000:2.0:1746143764.308019:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31332:x1830963594190592:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7040us (7479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.308026:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13418 00000100:00100000:1.0:1746143764.313957:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594191744 00000100:00100000:1.0:1746143764.313967:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594191744 00010000:00010000:1.0:1746143764.314002:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 8 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.314048:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7177 00000100:00100000:1.0:1746143764.314055:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594191744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143764.314066:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143764.314082:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 8 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.314091:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 8 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.314110:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135181a00/0xe984082ccd72fc47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b9 expref: 8 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.314128:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143764.315076:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594191744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1018us (7181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.315083:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7177 00000100:00100000:3.0:1746143764.315329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.315357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.316619:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.316720:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594192128 00000100:00100000:1.0:1746143764.316727:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594192128 00000100:00100000:3.0:1746143764.316743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:1.0:1746143764.316757:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a0815880 x1830963594192128/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.316765:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0815880 with x1830963594192128 ext(0->1048575) 00002000:00010000:1.0:1746143764.316770:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0815880 00000100:00100000:2.0:1746143764.316798:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594192256 00000100:00100000:2.0:1746143764.316804:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594192256 00002000:00100000:2.0:1746143764.316817:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0815500 x1830963594192256/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.316829:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0815500 with x1830963594192256 ext(1048576->2097151) 00010000:00010000:2.0:1746143764.316835:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.316844:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00002000:00010000:2.0:1746143764.316849:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0815500 00000100:00100000:2.0:1746143764.316871:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594192512 00000100:00100000:2.0:1746143764.316873:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594192512 00002000:00100000:2.0:1746143764.316881:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0816300 x1830963594192512/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.316886:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816300 with x1830963594192512 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.316888:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0816300 00000100:00100000:3.0:1746143764.316890:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594192768 00000100:00100000:3.0:1746143764.316894:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594192768 00000100:00100000:2.0:1746143764.316897:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1786 00000100:00100000:2.0:1746143764.316901:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594192256:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:3.0:1746143764.316910:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a0817800 x1830963594192768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.316917:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0817800 with x1830963594192768 ext(1048576->2097151) 00002000:00010000:3.0:1746143764.316920:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0817800 00000100:00100000:3.0:1746143764.316932:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6294 00000100:00100000:3.0:1746143764.316937:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594192512:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143764.318015:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6295 00000100:00100000:1.0:1746143764.318023:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594192768:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143764.318536:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6296 00000100:00100000:3.0:1746143764.318542:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594192128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.322194:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594191616:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18127us (18631us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.322215:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6293 00002000:00100000:2.0:1746143764.322225:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc11500 x1830963594191616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.322235:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11500 with x1830963594191616 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.322240:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc11500 00000100:00100000:2.0:1746143764.330505:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594191360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26608us (27082us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.330514:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6292 00002000:00100000:2.0:1746143764.330524:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc13800 x1830963594191360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.330533:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13800 with x1830963594191360 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.330538:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13800 00000100:00100000:3.0:1746143764.343902:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594191232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40026us (41081us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.343912:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1785 00002000:00100000:3.0:1746143764.343921:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012fc10a80 x1830963594191232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.343930:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10a80 with x1830963594191232 ext(1048576->2097151) 00010000:00010000:3.0:1746143764.343939:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.343955:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 943 lvb_type: 1 00002000:00010000:3.0:1746143764.343962:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc10a80 00000100:00100000:1.0:1746143764.345979:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594190848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 44720us (45140us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.345987:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6291 00002000:00100000:1.0:1746143764.345993:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012fc13480 x1830963594190848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.346001:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13480 with x1830963594190848 ext(0->1048575) 00002000:00010000:1.0:1746143764.346005:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13480 00000100:00100000:3.0:1746143764.351987:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594192512:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35039us (35360us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.351998:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6294 00002000:00100000:3.0:1746143764.352008:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0816300 x1830963594192512/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.352016:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816300 with x1830963594192512 ext(1048576->2097151) 00002000:00010000:3.0:1746143764.352021:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0816300 00000100:00100000:0.0:1746143764.355057:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.355165:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594192896 00000100:00100000:1.0:1746143764.355172:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594192896 00010000:00010000:1.0:1746143764.355206:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.355237:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7178 00000100:00100000:1.0:1746143764.355243:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594192896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143764.355254:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143764.355268:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.355277:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.355293:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092933c00/0xe984082ccd72fd19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ff expref: 22 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.355309:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143764.355339:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594192896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 97us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.355345:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7178 00000100:00100000:2.0:1746143764.355998:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594192256:12345-192.168.202.48@tcp:3:cat.0 Request processed in 39094us (40638us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.356006:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1786 00002000:00100000:2.0:1746143764.356014:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0815500 x1830963594192256/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.356022:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0815500 with x1830963594192256 ext(1048576->2097151) 00010000:00010000:2.0:1746143764.356028:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.356039:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00002000:00010000:2.0:1746143764.356046:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0815500 00000100:00100000:3.0:1746143764.363265:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594192128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 44715us (47928us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.363275:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6296 00002000:00100000:3.0:1746143764.363284:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a0815880 x1830963594192128/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.363293:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0815880 with x1830963594192128 ext(0->1048575) 00002000:00010000:3.0:1746143764.363297:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0815880 00000100:00100000:0.0:1746143764.365459:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.365496:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.365590:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594193152 00000100:00100000:3.0:1746143764.365597:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594193152 00010000:00010000:3.0:1746143764.365622:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.365645:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7179 00000100:00100000:3.0:1746143764.365652:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594193152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.365662:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.365678:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.365688:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.365705:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12600/0xe984082ccd72fd43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7929 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.365719:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.365721:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.365726:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.365734:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.365760:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.365770:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594360192:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143764.365830:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.365940:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594193024 00000100:00100000:2.0:1746143764.365944:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594193024 00000100:00100000:2.0:1746143764.365965:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13419 00000100:00100000:2.0:1746143764.365969:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31335:x1830963594193024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.365979:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.365987:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7968 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.366001:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.366007:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143764.366008:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143764.366011:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.366026:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.366035:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 22 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.366044:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360320:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.366066:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.369754:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594192768:12345-192.168.202.48@tcp:3:cat.0 Request processed in 51725us (53003us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.369765:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6295 00002000:00100000:1.0:1746143764.369775:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a0817800 x1830963594192768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.369783:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0817800 with x1830963594192768 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.369788:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0817800 00000100:00100000:0.0:1746143764.371781:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.371821:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.371887:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594193536 00000100:00100000:1.0:1746143764.371892:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594193408 00000100:00100000:3.0:1746143764.371893:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594193536 00000100:00100000:1.0:1746143764.371897:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594193408 00002000:00100000:1.0:1746143764.371923:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (2002944->2007039) req@ffff88012fc12680 x1830963594193408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.371930:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963594193408 ext(2002944->2007039) 00000100:00100000:3.0:1746143764.371933:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13420 00010000:00010000:1.0:1746143764.371937:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 23 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143764.371940:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31336:x1830963594193536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.371949:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 23 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.371950:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746143764.371954:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc12680 00010000:00010000:3.0:1746143764.371962:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a796f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.371968:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1787 00000100:00100000:1.0:1746143764.371973:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594193408:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143764.371980:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143764.371985:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.371996:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.372004:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c905c00, rc 0) 00000100:00100000:3.0:1746143764.372030:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31336:x1830963594193536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 91us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.372036:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13420 00000100:00100000:1.0:1746143764.372273:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594193408:12345-192.168.202.48@tcp:3:cat.0 Request processed in 106us (303us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143764.372281:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1787 00002000:00100000:1.0:1746143764.372286:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (2002944->2007039) req@ffff88012fc12680 x1830963594193408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.372292:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963594193408 ext(2002944->2007039) 00010000:00010000:1.0:1746143764.372296:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 23 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.372304:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 23 pid: 21542 timeout: 943 lvb_type: 0 00002000:00010000:1.0:1746143764.372309:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc12680 00000100:00100000:0.0:1746143764.372944:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360320:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143764.372962:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.372971:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba200, rc 0) 00000100:00100000:0.0:1746143764.373884:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31335:x1830963594193024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7912us (8426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.373891:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13419 00000100:00100000:2.0:1746143764.374222:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594360192:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.374232:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.374784:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594193152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9131us (9285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.374791:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7179 00000100:00100000:0.0:1746143764.381264:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.381954:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.382006:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594193920 00000100:00100000:1.0:1746143764.382016:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594193920 00002000:00100000:1.0:1746143764.382052:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (2002944->2097151) req@ffff880099c11450 x1830963594193920/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.382060:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c11450 with x1830963594193920 ext(2002944->2097151) 00010000:00010000:1.0:1746143764.382068:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 22 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.382079:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 22 pid: 21542 timeout: 943 lvb_type: 0 00002000:00010000:1.0:1746143764.382086:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099c11450 00000100:00100000:1.0:1746143764.382111:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1788 00000100:00100000:1.0:1746143764.382117:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594193920:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143764.382344:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594193792 00000100:00100000:2.0:1746143764.382348:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594193792 00000100:00100000:2.0:1746143764.382384:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13421 00000100:00100000:2.0:1746143764.382390:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31332:x1830963594193792:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143764.382399:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.382411:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7976 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.382429:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 6 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.382437:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.382448:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.382453:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.382455:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.382457:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->1138687] (req 1048576->1138687) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.382481:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.382494:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 25 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.382506:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360448:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.383069:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.383082:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 8 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.383089:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360576:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.383114:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 6 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.383121:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 6 pid: 8496 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.383208:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360704:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.383420:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143764.385099:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360448:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.385113:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360576:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.385121:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594360704:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.385159:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->1138687] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.385172:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938baa00, rc 0) 00000100:00100000:3.0:1746143764.385210:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31332:x1830963594193792:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2819us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.385220:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13421 00000100:00100000:1.0:1746143764.385925:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594193920:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3805us (3969us total) trans 17179873103 rc 0/0 00000100:00100000:1.0:1746143764.385933:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1788 00002000:00100000:1.0:1746143764.385940:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (2002944->2097151) req@ffff880099c11450 x1830963594193920/t17179873103(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/448 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.385947:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c11450 with x1830963594193920 ext(2002944->2097151) 00010000:00010000:1.0:1746143764.385953:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.385963:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00002000:00010000:1.0:1746143764.385968:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099c11450 00000100:00100000:2.0:1746143764.386501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.386532:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.386554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.386608:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594194048 00000100:00100000:3.0:1746143764.386613:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594194048 00010000:00010000:3.0:1746143764.386634:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 7 pid: 8496 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.386657:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594194176 00000100:00100000:3.0:1746143764.386659:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594194176 00010000:00010000:3.0:1746143764.386668:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 25 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.386678:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594194304 00000100:00100000:3.0:1746143764.386680:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594194304 00010000:00010000:3.0:1746143764.386687:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.386698:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7180 00000100:00100000:3.0:1746143764.386703:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963594194048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.386712:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.386727:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 7 pid: 8496 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386735:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 7 pid: 8496 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386752:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0e1200/0xe984082ccd72fc63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c0 expref: 7 pid: 8496 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386769:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.386787:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1963:x1830963594194048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.386792:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7180 00000100:00100000:3.0:1746143764.386809:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7181 00000100:00100000:3.0:1746143764.386813:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594194176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.386818:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.386824:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 25 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386832:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 25 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386842:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c35000/0xe984082ccd72fd35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7906 expref: 25 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386849:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.386859:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594194176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.386864:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7181 00000100:00100000:3.0:1746143764.386873:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7182 00000100:00100000:3.0:1746143764.386877:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594194304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.386881:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.386888:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386895:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386905:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130c35e00/0xe984082ccd72fd5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7930 expref: 9 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.386911:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.386913:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.386918:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.386926:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.386947:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.386956:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594360832:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143764.386987:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.388848:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.388889:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594194432 00000100:00100000:1.0:1746143764.388894:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594194432 00010000:00010000:1.0:1746143764.388915:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 24 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.388945:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7183 00000100:00100000:0.0:1746143764.388949:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.388951:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594194432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143764.388959:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143764.388969:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143759 -> 1746143764 00002000:00010000:1.0:1746143764.388972:0:11106:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143759 -> 1746143764 00010000:00010000:1.0:1746143764.389065:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 24 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.389080:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 24 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.389095:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c18c400/0xe984082ccd72fd89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2002944->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7961 expref: 24 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.389108:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.389110:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.389115:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.389122:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.389128:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.389129:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.389132:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 8 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.389158:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 8 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.389179:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 8 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.389217:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594194688 00000100:00100000:2.0:1746143764.389220:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594194688 00002000:00100000:2.0:1746143764.389241:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1134592->1138687) req@ffff8800930de300 x1830963594194688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.389249:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930de300 with x1830963594194688 ext(1134592->1138687) 00002000:00010000:2.0:1746143764.389253:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930de300 00000100:00100000:3.0:1746143764.389304:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594360832:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143764.389315:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.389343:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594194304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2466us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.389349:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7182 00000100:00100000:1.0:1746143764.389392:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594360960:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143764.389446:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.389454:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594361088:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143764.389589:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6297 00000100:00100000:0.0:1746143764.389595:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594194688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.389720:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594194688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 125us (771us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143764.389726:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6297 00002000:00100000:0.0:1746143764.389731:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1134592->1138687) req@ffff8800930de300 x1830963594194688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.389742:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930de300 with x1830963594194688 ext(1134592->1138687) 00002000:00010000:0.0:1746143764.389745:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930de300 00000100:00100000:1.0:1746143764.389782:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.392008:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594360960:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143764.392019:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594361088:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143764.392034:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143764.392104:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594194432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3152us (3259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.392112:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7183 00000100:00100000:0.0:1746143764.393184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.393212:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594194944 00000100:00100000:2.0:1746143764.393218:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594194944 00000100:00100000:0.0:1746143764.393381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.393451:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3942 00000100:00100000:2.0:1746143764.393456:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31332:x1830963594194944:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143764.393690:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31332:x1830963594194944:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 234us (507us total) trans 8589943510 rc 0/0 00000100:00100000:2.0:1746143764.393696:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3942 00000100:00100000:2.0:1746143764.393714:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594195200 00000100:00100000:2.0:1746143764.393717:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594195200 00002000:00100000:2.0:1746143764.393734:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930dc700 x1830963594195200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.393743:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc700 with x1830963594195200 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.393746:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc700 00000100:00100000:2.0:1746143764.393757:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6298 00000100:00100000:2.0:1746143764.393761:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594195200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.399702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.399751:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594195584 00000100:00100000:2.0:1746143764.399759:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594195584 00002000:00100000:2.0:1746143764.399794:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1138688->2097151) req@ffff8800930dfb80 x1830963594195584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.399804:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dfb80 with x1830963594195584 ext(1138688->2097151) 00002000:00010000:2.0:1746143764.399808:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dfb80 00000100:00100000:0.0:1746143764.399973:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.400569:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594195456 00000100:00100000:2.0:1746143764.400573:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594195456 00002000:00100000:2.0:1746143764.400588:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930df100 x1830963594195456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.400596:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df100 with x1830963594195456 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.400600:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930df100 00000100:00100000:0.0:1746143764.400619:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.400656:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6299 00000100:00100000:2.0:1746143764.400662:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594195584:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143764.401906:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6300 00000100:00100000:3.0:1746143764.401917:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594195456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.403265:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594195840 00000100:00100000:0.0:1746143764.403273:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594195840 00000100:00100000:1.0:1746143764.404465:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13422 00000100:00100000:1.0:1746143764.404477:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31333:x1830963594195840:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143764.404490:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.404504:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a797d expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.404526:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.404533:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143764.404535:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143764.404538:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1204224->2097151] (req 1204224->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.404562:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.404573:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 26 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.404584:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594361216:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.404796:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.410773:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594195200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17003us (17384us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.410784:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6298 00002000:00100000:2.0:1746143764.410794:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930dc700 x1830963594195200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.410803:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc700 with x1830963594195200 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.410807:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dc700 00000100:00100000:3.0:1746143764.411884:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594195584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11220us (12187us total) trans 0 rc 958464/958464 00000100:00100000:3.0:1746143764.411891:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6299 00002000:00100000:3.0:1746143764.411897:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1138688->2097151) req@ffff8800930dfb80 x1830963594195584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 958464/958464 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.411904:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dfb80 with x1830963594195584 ext(1138688->2097151) 00010000:00010000:3.0:1746143764.411912:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.411925:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.411930:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dfb80 00000100:00100000:1.0:1746143764.412002:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594361216:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.412023:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1204224->2097151] (req 1204224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.412036:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805000, rc 0) 00000100:00100000:0.0:1746143764.412276:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.412312:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31333:x1830963594195840:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7838us (11692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.412318:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13422 00000100:00100000:3.0:1746143764.414538:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594195968 00000100:00100000:3.0:1746143764.414548:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594195968 00002000:00100000:3.0:1746143764.414585:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1138687) req@ffff8800930dc380 x1830963594195968/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.414593:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc380 with x1830963594195968 ext(1048576->1138687) 00010000:00010000:3.0:1746143764.414600:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.414612:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.414619:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dc380 00000100:00100000:3.0:1746143764.414654:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1789 00000100:00100000:3.0:1746143764.414660:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594195968:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143764.415393:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594195456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13476us (15418us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.415399:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6300 00002000:00100000:3.0:1746143764.415405:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800930df100 x1830963594195456/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.415412:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df100 with x1830963594195456 ext(1048576->2097151) 00002000:00010000:3.0:1746143764.415415:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930df100 00000100:00100000:0.0:1746143764.417950:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.418089:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594196096 00000100:00100000:1.0:1746143764.418096:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594196096 00000100:00100000:1.0:1746143764.418128:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13423 00000100:00100000:1.0:1746143764.418135:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31336:x1830963594196096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.418166:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.418180:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7984 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.418211:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143764.418215:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1204224->2097151] (req 1204224->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.418226:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143764.418229:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.418259:0:8497:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1204224->2097151] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.418270:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.418278:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5804000, rc 0) 00000100:00100000:1.0:1746143764.418307:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31336:x1830963594196096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.418312:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13423 00000100:00100000:3.0:1746143764.418827:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594195968:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4165us (6550us total) trans 17179873104 rc 0/0 00000100:00100000:3.0:1746143764.418835:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1789 00002000:00100000:3.0:1746143764.418842:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1138687) req@ffff8800930dc380 x1830963594195968/t17179873104(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/448 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.418850:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc380 with x1830963594195968 ext(1048576->1138687) 00010000:00010000:3.0:1746143764.418856:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.418866:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.418872:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dc380 00000100:00100000:0.0:1746143764.424335:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.425532:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594196224 00000100:00100000:2.0:1746143764.425541:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594196224 00000100:00100000:2.0:1746143764.425596:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13424 00000100:00100000:2.0:1746143764.425603:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31335:x1830963594196224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.425620:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.425634:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a798b expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.425656:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143764.425661:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.425670:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.425680:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095386e00, rc 0) 00000100:00100000:2.0:1746143764.425736:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31335:x1830963594196224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 133us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.425742:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13424 00000100:00100000:0.0:1746143764.427268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.427340:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594196352 00000100:00100000:1.0:1746143764.427346:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594196352 00010000:00010000:1.0:1746143764.427370:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 26 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.427404:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7184 00000100:00100000:1.0:1746143764.427410:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594196352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143764.427420:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143764.427434:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143762 -> 1746143764 00002000:00010000:1.0:1746143764.427437:0:11106:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143762 -> 1746143764 00010000:00010000:1.0:1746143764.427440:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 26 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.427450:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 26 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.427467:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938baa00/0xe984082ccd72fd9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7976 expref: 26 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.427494:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.427496:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.427503:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.427510:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.427538:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.427549:0:11106:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 9 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.427558:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594361472:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143764.428063:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.431597:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594361472:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143764.431616:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143764.431664:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594196352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4252us (4399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.431674:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7184 00000100:00100000:0.0:1746143764.432452:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.432501:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594196608 00000100:00100000:3.0:1746143764.432507:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594196608 00002000:00100000:3.0:1746143764.432536:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1204224->1208319) req@ffff8800930dd500 x1830963594196608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.432545:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd500 with x1830963594196608 ext(1204224->1208319) 00010000:00010000:3.0:1746143764.432552:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.432562:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.432568:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dd500 00000100:00100000:3.0:1746143764.432594:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1790 00000100:00100000:3.0:1746143764.432599:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594196608:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143764.432982:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594196608:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 382us (530us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143764.432988:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1790 00002000:00100000:3.0:1746143764.432993:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1204224->1208319) req@ffff8800930dd500 x1830963594196608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.432999:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd500 with x1830963594196608 ext(1204224->1208319) 00010000:00010000:3.0:1746143764.433003:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.433012:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.433017:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dd500 00000100:00100000:0.0:1746143764.446114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.446190:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594196864 00000100:00100000:2.0:1746143764.446206:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594196864 00002000:00100000:2.0:1746143764.446243:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1204224->2097151) req@ffff8800930dce00 x1830963594196864/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.446253:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dce00 with x1830963594196864 ext(1204224->2097151) 00010000:00010000:2.0:1746143764.446261:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.446272:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:2.0:1746143764.446278:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dce00 00000100:00100000:2.0:1746143764.446304:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1791 00000100:00100000:2.0:1746143764.446311:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594196864:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143764.448217:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.448264:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594196992 00000100:00100000:1.0:1746143764.448270:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594196992 00000100:00100000:1.0:1746143764.448309:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13425 00000100:00100000:1.0:1746143764.448314:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31333:x1830963594196992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143764.448325:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.448337:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7992 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.448363:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.448371:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.448378:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.448384:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.448385:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.448389:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1138687] (req 1048576->1138687) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.448414:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.448422:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 15 pid: 12618 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.448433:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594361600:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.448512:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.448519:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 9 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.448527:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594361728:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.448550:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.448556:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 7 pid: 8497 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.448563:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594361856:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.448580:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.450995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.451838:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594197120 00000100:00100000:1.0:1746143764.451846:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594197120 00010000:00010000:1.0:1746143764.451880:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 8 pid: 8497 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.451918:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7185 00000100:00100000:1.0:1746143764.451925:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594197120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143764.451938:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143764.451955:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 8 pid: 8497 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.451964:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 8 pid: 8497 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.451983:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.451994:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594361600:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.452004:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594361728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.452016:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090cecc00/0xe984082ccd72fc4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78c7 expref: 8 pid: 8497 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.452018:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594197120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.452024:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7185 00000100:00100000:3.0:1746143764.452034:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594361856:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.452060:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->1138687] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.452071:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805800, rc 0) 00000100:00100000:3.0:1746143764.452093:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31333:x1830963594196992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3779us (3883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.452099:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13425 00000100:00100000:2.0:1746143764.455043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.455084:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.455156:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594197248 00000100:00100000:0.0:1746143764.455162:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594197248 00010000:00010000:0.0:1746143764.455187:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 9 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143764.455216:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594197376 00000100:00100000:0.0:1746143764.455218:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594197376 00010000:00010000:0.0:1746143764.455228:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 16 pid: 12618 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143764.455253:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7186 00000100:00100000:0.0:1746143764.455259:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594197248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.455268:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.455289:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 9 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.455298:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 9 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.455315:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf12a00/0xe984082ccd72fd4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7937 expref: 9 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.455323:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7187 00010000:00010000:0.0:1746143764.455331:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.455332:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594197376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.455340:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.455350:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 16 pid: 12618 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.455359:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 16 pid: 12618 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143764.455359:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594197248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.455365:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7186 00010000:00010000:3.0:1746143764.455370:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45600/0xe984082ccd72fd20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a790d expref: 16 pid: 12618 timeout: 943 lvb_type: 1 00010000:00010000:3.0:1746143764.455380:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.455382:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.455387:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 7 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.455395:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 7 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.455421:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 7 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.455432:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594361984:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143764.455474:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143764.459319:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594361984:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.459327:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143764.459338:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.459349:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594197632 00000100:00100000:0.0:1746143764.459355:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594197632 00000100:00100000:3.0:1746143764.459371:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1965:x1830963594197376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4040us (4286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.459379:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7187 00002000:00100000:0.0:1746143764.459386:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1134592->1138687) req@ffff88012b7cf100 x1830963594197632/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.459395:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf100 with x1830963594197632 ext(1134592->1138687) 00002000:00010000:0.0:1746143764.459399:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cf100 00000100:00100000:0.0:1746143764.459413:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6301 00000100:00100000:0.0:1746143764.459418:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594197632:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143764.459544:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594197632:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 125us (217us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143764.459549:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6301 00002000:00100000:0.0:1746143764.459553:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1134592->1138687) req@ffff88012b7cf100 x1830963594197632/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.459560:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf100 with x1830963594197632 ext(1134592->1138687) 00002000:00010000:0.0:1746143764.459562:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cf100 00000100:00100000:0.0:1746143764.461034:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.462263:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594197888 00000100:00100000:3.0:1746143764.462271:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594197888 00000100:00100000:3.0:1746143764.462304:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3943 00000100:00100000:3.0:1746143764.462310:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31333:x1830963594197888:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143764.462545:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31333:x1830963594197888:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 235us (1513us total) trans 8589943511 rc 0/0 00000100:00100000:3.0:1746143764.462552:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3943 00000100:00100000:3.0:1746143764.468314:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594196864:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 21996us (22201us total) trans 17179873105 rc 0/0 00000100:00100000:3.0:1746143764.468328:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1791 00002000:00100000:3.0:1746143764.468337:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1204224->2097151) req@ffff8800930dce00 x1830963594196864/t17179873105(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/448 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.468346:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dce00 with x1830963594196864 ext(1204224->2097151) 00010000:00010000:3.0:1746143764.468355:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.468367:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.468374:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800930dce00 00000100:00100000:0.0:1746143764.473481:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.475356:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594198016 00000100:00100000:3.0:1746143764.475366:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594198016 00010000:00010000:3.0:1746143764.475401:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143764.475439:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7188 00000100:00100000:3.0:1746143764.475446:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594198016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.475458:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.475475:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.475485:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.475509:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5805000/0xe984082ccd72fda5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a797d expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.475522:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.475524:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.475529:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.475537:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.475544:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.475545:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.475549:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.475555:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.475580:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.475590:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594362112:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143764.475680:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.475692:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594362240:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143764.475707:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143764.478038:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594362112:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143764.478050:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594362240:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143764.478068:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.478104:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594198016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2658us (4631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.478113:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7188 00000100:00100000:0.0:1746143764.482407:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.482806:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594198272 00000100:00100000:3.0:1746143764.482814:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594198272 00002000:00100000:3.0:1746143764.482849:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136b9ca80 x1830963594198272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.482859:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ca80 with x1830963594198272 ext(1048576->2097151) 00002000:00010000:3.0:1746143764.482863:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ca80 00000100:00100000:3.0:1746143764.483320:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6302 00000100:00100000:3.0:1746143764.483328:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594198272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.490665:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.491223:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.491334:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594198784 00000100:00100000:1.0:1746143764.491341:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594198784 00002000:00100000:1.0:1746143764.491375:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1138688->2097151) req@ffff880136b9ed80 x1830963594198784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.491384:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ed80 with x1830963594198784 ext(1138688->2097151) 00002000:00010000:1.0:1746143764.491388:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9ed80 00000100:00100000:1.0:1746143764.491411:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594198528 00000100:00100000:1.0:1746143764.491413:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594198528 00002000:00100000:1.0:1746143764.491424:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136b9f480 x1830963594198528/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.491430:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9f480 with x1830963594198528 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.491433:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9f480 00000100:00100000:1.0:1746143764.491445:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6303 00000100:00100000:1.0:1746143764.491451:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594198784:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143764.491925:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6304 00000100:00100000:3.0:1746143764.491934:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594198528:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143764.492621:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594198272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9292us (10217us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.492628:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6302 00002000:00100000:2.0:1746143764.492635:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136b9ca80 x1830963594198272/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.492642:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ca80 with x1830963594198272 ext(1048576->2097151) 00002000:00010000:2.0:1746143764.492646:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ca80 00000100:00100000:0.0:1746143764.499431:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.499715:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594198912 00000100:00100000:3.0:1746143764.499722:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594198912 00000100:00100000:3.0:1746143764.499769:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13426 00000100:00100000:3.0:1746143764.499776:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:31335:x1830963594198912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.499792:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.499804:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7999 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.499828:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.499835:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143764.499837:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143764.499840:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.499862:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.499872:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 9 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143764.499883:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594362368:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.499958:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.507425:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594198784:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15965us (16760us total) trans 0 rc 958464/958464 00000100:00100000:0.0:1746143764.507437:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6303 00002000:00100000:0.0:1746143764.507448:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1138688->2097151) req@ffff880136b9ed80 x1830963594198784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 958464/958464 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.507457:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ed80 with x1830963594198784 ext(1138688->2097151) 00010000:00010000:0.0:1746143764.507466:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 8 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.507479:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 8 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:0.0:1746143764.507491:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136b9ed80 00000100:00100000:3.0:1746143764.507870:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594362368:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.507894:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.507909:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5805200, rc 0) 00000100:00100000:3.0:1746143764.507928:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31335:x1830963594198912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8153us (8504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.507935:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13426 00000100:00100000:1.0:1746143764.508098:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.508620:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594199040 00000100:00100000:0.0:1746143764.508626:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594199040 00002000:00100000:0.0:1746143764.508651:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1138687) req@ffff8800a04cc700 x1830963594199040/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.508657:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc700 with x1830963594199040 ext(1048576->1138687) 00010000:00010000:0.0:1746143764.508662:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 8 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.508679:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 8 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:0.0:1746143764.508687:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a04cc700 00000100:00100000:0.0:1746143764.508715:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1792 00000100:00100000:0.0:1746143764.508722:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594199040:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143764.509942:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594198528:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 18007us (18716us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.509950:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6304 00002000:00100000:3.0:1746143764.509957:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136b9f480 x1830963594198528/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.509964:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9f480 with x1830963594198528 ext(1048576->2097151) 00002000:00010000:3.0:1746143764.509967:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9f480 00000100:00100000:0.0:1746143764.513946:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594199040:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5215us (5839us total) trans 21474840424 rc 0/0 00000100:00100000:0.0:1746143764.513957:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1792 00002000:00100000:0.0:1746143764.513967:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1138687) req@ffff8800a04cc700 x1830963594199040/t21474840424(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/448 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.513976:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc700 with x1830963594199040 ext(1048576->1138687) 00010000:00010000:0.0:1746143764.513985:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.514004:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:0.0:1746143764.514010:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a04cc700 00000100:00100000:0.0:1746143764.518747:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.518858:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594199168 00000100:00100000:3.0:1746143764.518865:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594199168 00010000:00010000:3.0:1746143764.518897:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143764.518964:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7189 00000100:00100000:3.0:1746143764.518971:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594199168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.518982:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143764.518997:0:7149:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143762 -> 1746143764 00002000:00010000:3.0:1746143764.519000:0:7149:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143762 -> 1746143764 00010000:00010000:3.0:1746143764.519004:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.519015:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.519032:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805800/0xe984082ccd72fdba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1138687) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7992 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.519407:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.519409:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.519416:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.519424:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.519451:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.519462:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594362496:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143764.519693:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.523501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.523759:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594362496:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143764.523778:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.523828:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1963:x1830963594199168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4857us (5089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.523838:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7189 00000100:00100000:0.0:1746143764.523916:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594199296 00000100:00100000:0.0:1746143764.523921:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594199296 00000100:00100000:0.0:1746143764.523949:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13427 00000100:00100000:0.0:1746143764.523955:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31336:x1830963594199296:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143764.523969:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143764.523982:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79a0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.524002:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.524004:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.524010:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.524022:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.524031:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba27800, rc 0) 00000100:00100000:0.0:1746143764.524048:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31336:x1830963594199296:12345-192.168.202.48@tcp:101:cat.0 Request processed in 93us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.524053:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13427 00000100:00100000:0.0:1746143764.527042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.527406:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594199552 00000100:00100000:1.0:1746143764.527413:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594199552 00002000:00100000:1.0:1746143764.527448:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880136b9df80 x1830963594199552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.527457:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9df80 with x1830963594199552 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.527461:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9df80 00000100:00100000:1.0:1746143764.527484:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6305 00000100:00100000:1.0:1746143764.527489:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594199552:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.535783:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.535960:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594199808 00000100:00100000:3.0:1746143764.535969:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594199808 00002000:00100000:3.0:1746143764.536005:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880136b9d180 x1830963594199808/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.536014:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d180 with x1830963594199808 ext(1048576->2097151) 00002000:00010000:3.0:1746143764.536019:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9d180 00000100:00100000:3.0:1746143764.536051:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6306 00000100:00100000:3.0:1746143764.536058:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594199808:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143764.539276:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594199552:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11778us (12230us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.539286:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6305 00002000:00100000:1.0:1746143764.539295:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880136b9df80 x1830963594199552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.539304:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9df80 with x1830963594199552 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.539308:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9df80 00000100:00100000:3.0:1746143764.549830:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594199808:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 13765us (14047us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.549840:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6306 00002000:00100000:3.0:1746143764.549850:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880136b9d180 x1830963594199808/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.549858:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d180 with x1830963594199808 ext(1048576->2097151) 00002000:00010000:3.0:1746143764.549863:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9d180 00000100:00100000:0.0:1746143764.554391:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.554659:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594200064 00000100:00100000:3.0:1746143764.554666:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594200064 00002000:00100000:3.0:1746143764.554708:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880136b9c000 x1830963594200064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.554716:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9c000 with x1830963594200064 ext(2097152->3145727) 00002000:00010000:3.0:1746143764.554721:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9c000 00000100:00100000:3.0:1746143764.554754:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6307 00000100:00100000:3.0:1746143764.554761:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594200064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143764.555342:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.555370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.555404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.555431:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594200320 00000100:00100000:2.0:1746143764.555436:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594200320 00000100:00100000:0.0:1746143764.555445:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594200704 00000100:00100000:0.0:1746143764.555448:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594200704 00002000:00100000:2.0:1746143764.555454:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a04cc000 x1830963594200320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.555462:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc000 with x1830963594200320 ext(3145728->4194303) 00002000:00010000:2.0:1746143764.555465:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cc000 00002000:00100000:0.0:1746143764.555465:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a04cca80 x1830963594200704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.555473:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cca80 with x1830963594200704 ext(3145728->4194303) 00000100:00100000:2.0:1746143764.555476:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594200576 00002000:00010000:0.0:1746143764.555476:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cca80 00000100:00100000:2.0:1746143764.555478:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594200576 00002000:00100000:2.0:1746143764.555488:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a04cf800 x1830963594200576/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.555493:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf800 with x1830963594200576 ext(2097152->3145727) 00000100:00100000:0.0:1746143764.555493:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6308 00002000:00010000:2.0:1746143764.555496:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cf800 00000100:00100000:0.0:1746143764.555498:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594200320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143764.555501:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6309 00000100:00100000:3.0:1746143764.555507:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594200704:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.555513:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6310 00000100:00100000:2.0:1746143764.555518:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594200576:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.577744:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.577776:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.577803:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.577829:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.578383:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594200320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22882us (23040us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143764.578392:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6308 00002000:00100000:0.0:1746143764.578401:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a04cc000 x1830963594200320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.578410:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc000 with x1830963594200320 ext(3145728->4194303) 00002000:00010000:0.0:1746143764.578416:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cc000 00000100:00100000:0.0:1746143764.578472:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594201088 00000100:00100000:0.0:1746143764.578477:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594201088 00002000:00100000:0.0:1746143764.578504:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880136b9e300 x1830963594201088/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.578515:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9e300 with x1830963594201088 ext(2097152->3145727) 00002000:00010000:0.0:1746143764.578518:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9e300 00000100:00100000:0.0:1746143764.578529:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594201344 00000100:00100000:0.0:1746143764.578531:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594201344 00002000:00100000:0.0:1746143764.578538:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9f800 x1830963594201344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.578544:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9f800 with x1830963594201344 ext(3145728->4194303) 00002000:00010000:0.0:1746143764.578545:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9f800 00000100:00100000:0.0:1746143764.578556:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594201600 00000100:00100000:0.0:1746143764.578558:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594201600 00002000:00100000:0.0:1746143764.578567:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880136b9e680 x1830963594201600/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.578572:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9e680 with x1830963594201600 ext(2097152->3145727) 00002000:00010000:0.0:1746143764.578575:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9e680 00000100:00100000:0.0:1746143764.578582:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594201856 00000100:00100000:0.0:1746143764.578583:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594201856 00002000:00100000:0.0:1746143764.578590:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136b9ea00 x1830963594201856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.578595:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ea00 with x1830963594201856 ext(3145728->4194303) 00002000:00010000:0.0:1746143764.578597:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ea00 00000100:00100000:0.0:1746143764.578601:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6311 00000100:00100000:0.0:1746143764.578606:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594201088:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143764.578672:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6312 00000100:00100000:3.0:1746143764.578680:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594201344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.579031:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6313 00000100:00100000:2.0:1746143764.579038:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594201600:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.580092:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6314 00000100:00100000:2.0:1746143764.580099:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594201856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.588311:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594200064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33541us (33917us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.588322:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6307 00002000:00100000:2.0:1746143764.588334:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880136b9c000 x1830963594200064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.588343:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9c000 with x1830963594200064 ext(2097152->3145727) 00002000:00010000:2.0:1746143764.588349:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9c000 00000100:00100000:2.0:1746143764.590671:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594200576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35147us (35260us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.590681:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6310 00002000:00100000:2.0:1746143764.590688:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a04cf800 x1830963594200576/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.590697:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf800 with x1830963594200576 ext(2097152->3145727) 00002000:00010000:2.0:1746143764.590701:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cf800 00000100:00100000:0.0:1746143764.597778:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.598109:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594200704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 42601us (42737us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.598121:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6309 00002000:00100000:3.0:1746143764.598131:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800a04cca80 x1830963594200704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.598163:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cca80 with x1830963594200704 ext(3145728->4194303) 00002000:00010000:3.0:1746143764.598168:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cca80 00000100:00100000:1.0:1746143764.600125:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594202112 00000100:00100000:1.0:1746143764.600135:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594202112 00000100:00100000:1.0:1746143764.600210:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9189 00000100:00100000:1.0:1746143764.600217:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31340:x1830963594202112:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143764.600238:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.600254:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b200/0xe984082ccd72fdcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79a7 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.600345:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600355:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600364:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600374:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600378:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600383:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600467:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600473:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600478:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143764.600485:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:1.0:1746143764.600554:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600559:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600564:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600569:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009336a400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143764.600572:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600577:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600586:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143764.600589:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143764.600591:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600596:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336a400/0xe984082ccd72fdd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600622:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600626:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600630:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600634:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009336ac00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143764.600636:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600640:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600648:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03cb00) 00010000:00010000:1.0:1746143764.600650:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143764.600651:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600655:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336ac00/0xe984082ccd72fddd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143764.600685:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336b200/0xe984082ccd72fdcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.600696:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.600701:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143764.600703:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143764.600704:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336aa00, rc 0) 00000100:00100000:1.0:1746143764.600749:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31340:x1830963594202112:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 532us (2978us total) trans 8589943512 rc 0/0 00000100:00100000:1.0:1746143764.600755:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9189 00000100:00100000:3.0:1746143764.607127:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594201344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28439us (29341us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.607136:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6312 00002000:00100000:3.0:1746143764.607166:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9f800 x1830963594201344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.607175:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9f800 with x1830963594201344 ext(3145728->4194303) 00002000:00010000:3.0:1746143764.607180:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9f800 00000100:00100000:2.0:1746143764.612684:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594201600:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33639us (34872us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.612694:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6313 00002000:00100000:2.0:1746143764.612704:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880136b9e680 x1830963594201600/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.612712:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9e680 with x1830963594201600 ext(2097152->3145727) 00002000:00010000:2.0:1746143764.612717:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9e680 00000100:00100000:1.0:1746143764.619212:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.619826:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594201856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 39725us (41993us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.619837:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6314 00002000:00100000:2.0:1746143764.619847:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136b9ea00 x1830963594201856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.619855:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ea00 with x1830963594201856 ext(3145728->4194303) 00002000:00010000:2.0:1746143764.619860:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ea00 00000100:00100000:2.0:1746143764.619882:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594202368 00000100:00100000:2.0:1746143764.619888:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594202368 00002000:00100000:2.0:1746143764.619913:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a04ce300 x1830963594202368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.619920:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04ce300 with x1830963594202368 ext(4194304->4771839) 00002000:00010000:2.0:1746143764.619924:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04ce300 00000100:00100000:2.0:1746143764.619937:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6315 00000100:00100000:2.0:1746143764.619942:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594202368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.624371:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594201088:12345-192.168.202.48@tcp:3:cat.0 Request processed in 45757us (46628us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143764.624380:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6311 00002000:00100000:0.0:1746143764.624390:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880136b9e300 x1830963594201088/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143764.624398:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9e300 with x1830963594201088 ext(2097152->3145727) 00002000:00010000:0.0:1746143764.624402:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9e300 00000100:00100000:1.0:1746143764.626640:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.627014:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594202624 00000100:00100000:2.0:1746143764.627022:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594202624 00000100:00100000:3.0:1746143764.628206:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9190 00000100:00100000:3.0:1746143764.628218:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31343:x1830963594202624:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143764.628236:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.628250:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef9000/0xe984082ccd72fdf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79ae expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.628341:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628353:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628362:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628375:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628380:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628385:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628471:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628478:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628484:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143764.628491:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8949696 00010000:00010000:3.0:1746143764.628562:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628568:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628573:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628577:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ef8c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143764.628580:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628586:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628595:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143764.628598:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143764.628601:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.628605:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef8c00/0xe984082ccd72fdf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629853:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629860:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629865:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629870:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cde7800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143764.629872:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629878:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629886:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009066df00) 00010000:00010000:3.0:1746143764.629888:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143764.629890:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629895:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.629946:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ef9000/0xe984082ccd72fdf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.629958:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.629964:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.629966:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143764.629968:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde7400, rc 0) 00000100:00100000:3.0:1746143764.630629:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31343:x1830963594202624:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2412us (3992us total) trans 8589943513 rc 0/0 00000100:00100000:3.0:1746143764.630637:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9190 00000100:00100000:2.0:1746143764.633391:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594202368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13438us (14176us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143764.633403:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6315 00002000:00100000:2.0:1746143764.633416:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a04ce300 x1830963594202368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.633424:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04ce300 with x1830963594202368 ext(4194304->4771839) 00002000:00010000:2.0:1746143764.633430:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04ce300 00000100:00100000:0.0:1746143764.634858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.634930:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594202880 00000100:00100000:2.0:1746143764.634936:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594202880 00002000:00100000:2.0:1746143764.634965:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880136b9d880 x1830963594202880/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.634972:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d880 with x1830963594202880 ext(4194304->4771839) 00002000:00010000:2.0:1746143764.634976:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9d880 00000100:00100000:2.0:1746143764.635000:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6316 00000100:00100000:2.0:1746143764.635005:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594202880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.639615:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594202880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4598us (4748us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143764.639626:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6316 00002000:00100000:2.0:1746143764.639639:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880136b9d880 x1830963594202880/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.639648:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d880 with x1830963594202880 ext(4194304->4771839) 00002000:00010000:2.0:1746143764.639653:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9d880 00000100:00100000:0.0:1746143764.640685:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.640809:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594203136 00000100:00100000:2.0:1746143764.640817:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594203136 00000100:00100000:2.0:1746143764.641054:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3944 00000100:00100000:2.0:1746143764.641064:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31335:x1830963594203136:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143764.642667:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31335:x1830963594203136:12345-192.168.202.48@tcp:35:cat.0 Request processed in 1603us (1984us total) trans 8589943514 rc 0/0 00000100:00100000:2.0:1746143764.642674:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3944 00000100:00100000:0.0:1746143764.648222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.650489:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594203392 00000100:00100000:2.0:1746143764.650501:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594203392 00000100:00100000:2.0:1746143764.651398:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3945 00000100:00100000:2.0:1746143764.651406:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31336:x1830963594203392:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143764.652752:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31336:x1830963594203392:12345-192.168.202.48@tcp:35:cat.0 Request processed in 1344us (4534us total) trans 8589943515 rc 0/0 00000100:00100000:2.0:1746143764.652760:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3945 00000100:00100000:0.0:1746143764.689723:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.689907:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594203520 00000100:00100000:2.0:1746143764.689914:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594203520 00000100:00100000:0.0:1746143764.689979:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13428 00000100:00100000:0.0:1746143764.689988:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31343:x1830963594203520:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143764.690005:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143764.690018:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79b5 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.690041:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.690049:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.690054:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.690055:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.690058:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1269760->1908735] (req 1269760->1908735) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.690084:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.690094:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 9 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143764.690103:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594362624:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143764.690225:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.690232:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 17 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143764.690240:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594362752:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143764.690256:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.695098:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.695177:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.695233:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594203776 00000100:00100000:1.0:1746143764.695240:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594203776 00000100:00100000:3.0:1746143764.695264:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594203648 00000100:00100000:3.0:1746143764.695268:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594203648 00010000:00010000:1.0:1746143764.695269:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.695283:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.695292:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7190 00000100:00100000:3.0:1746143764.695308:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7191 00000100:00100000:3.0:1746143764.695313:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594203648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.695324:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.695342:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.695349:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594203776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.695353:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.695355:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143764.695449:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143764.695449:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.695458:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.695469:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.695471:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.695476:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.695483:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.695484:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594203648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 170us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.695492:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7191 00010000:00010000:1.0:1746143764.695508:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.695517:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594362880:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.695548:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd72fdc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a0 expref: 9 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.695568:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594362624:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.695580:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5805200/0xe984082ccd72fdc1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7999 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.695587:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594362752:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.695608:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.695616:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369eb600, rc 0) 00000100:00100000:2.0:1746143764.695635:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31343:x1830963594203520:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5649us (5919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.695640:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13428 00000100:00100000:1.0:1746143764.695769:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.697210:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594362880:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143764.697223:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143764.697259:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594203776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1961us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.697267:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7190 00000100:00100000:0.0:1746143764.697777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.697956:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594203904 00000100:00100000:2.0:1746143764.697961:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594203904 00000100:00100000:2.0:1746143764.698798:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13429 00000100:00100000:2.0:1746143764.698807:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31340:x1830963594203904:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143764.698819:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.698832:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79bc expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.698855:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 5 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.698863:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.698869:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.698875:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.698877:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.698880:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2494464->3145727] (req 2494464->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.698903:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 24 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.698914:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 24 pid: 9527 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.698924:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594363008:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.701119:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.701131:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 12 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.701162:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594363136:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.701814:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 5 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.701823:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 5 pid: 15784 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.701830:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594363264:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.701850:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.702362:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.702425:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594204160 00000100:00100000:3.0:1746143764.702431:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594204160 00002000:00100000:3.0:1746143764.702465:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x353:0x0] (1269760->1273855) req@ffff88012b7cf480 x1830963594204160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.702473:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf480 with x1830963594204160 ext(1269760->1273855) 00002000:00010000:3.0:1746143764.702477:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cf480 00000100:00100000:3.0:1746143764.703447:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6317 00000100:00100000:3.0:1746143764.703455:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594204160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143764.703925:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594204160:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 469us (1564us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143764.703932:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6317 00002000:00100000:3.0:1746143764.703938:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x353:0x0] (1269760->1273855) req@ffff88012b7cf480 x1830963594204160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.703944:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cf480 with x1830963594204160 ext(1269760->1273855) 00002000:00010000:3.0:1746143764.703948:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7cf480 00000100:00100000:0.0:1746143764.710171:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.710213:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594204288 00000100:00100000:1.0:1746143764.710221:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594204288 00010000:00010000:1.0:1746143764.710249:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 6 pid: 15784 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143764.710259:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.710428:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594363008:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.710439:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594363136:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.710446:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594363264:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.710473:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2494464->3145727] (req 2494464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.710487:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a6200, rc 0) 00000100:00100000:3.0:1746143764.710530:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31340:x1830963594203904:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11724us (12753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.710537:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13429 00000100:00100000:1.0:1746143764.710539:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594204416 00000100:00100000:1.0:1746143764.710541:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594204416 00010000:00010000:1.0:1746143764.710552:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 25 pid: 9527 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.710652:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7192 00000100:00100000:1.0:1746143764.710658:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594204288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143764.710668:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143764.710685:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 6 pid: 15784 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.710693:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 6 pid: 15784 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143764.710793:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7193 00000100:00100000:0.0:1746143764.710800:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594204416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.710807:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143764.710831:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac20000/0xe984082ccd72fc55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78d5 expref: 6 pid: 15784 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.710981:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 25 pid: 9527 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.710990:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 25 pid: 9527 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.710996:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143764.711001:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12400/0xe984082ccd72fd27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a791b expref: 25 pid: 9527 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.711012:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.711027:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594204416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 228us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.711032:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7193 00000100:00100000:0.0:1746143764.711042:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594204544 00000100:00100000:0.0:1746143764.711044:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594204544 00010000:00010000:0.0:1746143764.711054:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 12 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143764.711067:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7194 00000100:00100000:0.0:1746143764.711071:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594204544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.711077:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.711084:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 12 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.711092:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 12 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.711103:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fd51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7945 expref: 12 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:0.0:1746143764.711111:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.711112:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.711117:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.711124:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.711163:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143764.711174:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594363392:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143764.711244:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143764.711400:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143764.711430:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1965:x1830963594204288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 772us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.711436:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7192 00000100:00100000:0.0:1746143764.711740:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.711801:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594204800 00000100:00100000:3.0:1746143764.711805:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594204800 00002000:00100000:3.0:1746143764.711831:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x353:0x0] (1904640->1908735) req@ffff8800a63a3480 x1830963594204800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.711839:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3480 with x1830963594204800 ext(1904640->1908735) 00002000:00010000:3.0:1746143764.711843:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a3480 00000100:00100000:3.0:1746143764.711856:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6318 00000100:00100000:3.0:1746143764.711860:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594204800:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143764.711998:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594204800:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 136us (257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143764.712004:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6318 00002000:00100000:3.0:1746143764.712009:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x353:0x0] (1904640->1908735) req@ffff8800a63a3480 x1830963594204800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.712016:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a3480 with x1830963594204800 ext(1904640->1908735) 00002000:00010000:3.0:1746143764.712019:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a3480 00000100:00100000:2.0:1746143764.713616:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594363392:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.713639:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.713653:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.713918:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594204544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2845us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.713926:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7194 00000100:00100000:1.0:1746143764.713994:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594205056 00000100:00100000:1.0:1746143764.714002:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594205056 00002000:00100000:1.0:1746143764.714027:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2494464->2498559) req@ffff8800a63a2a00 x1830963594205056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.714034:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2a00 with x1830963594205056 ext(2494464->2498559) 00002000:00010000:1.0:1746143764.714038:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a2a00 00000100:00100000:1.0:1746143764.714059:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6319 00000100:00100000:1.0:1746143764.714065:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594205056:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143764.714109:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.714206:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594205056:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 140us (552us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143764.714212:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6319 00002000:00100000:1.0:1746143764.714216:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2494464->2498559) req@ffff8800a63a2a00 x1830963594205056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.714223:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2a00 with x1830963594205056 ext(2494464->2498559) 00002000:00010000:1.0:1746143764.714226:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a63a2a00 00000100:00100000:2.0:1746143764.714443:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594205312 00000100:00100000:2.0:1746143764.714447:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594205312 00000100:00100000:2.0:1746143764.714479:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3946 00000100:00100000:2.0:1746143764.714484:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094438850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31343:x1830963594205312:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143764.714803:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094438850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31343:x1830963594205312:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 318us (693us total) trans 8589943516 rc 0/0 00000100:00100000:2.0:1746143764.714809:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3946 00000100:00100000:2.0:1746143764.719795:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.720001:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594205440 00000100:00100000:3.0:1746143764.720008:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594205440 00000100:00100000:3.0:1746143764.720042:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13430 00000100:00100000:3.0:1746143764.720049:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31340:x1830963594205440:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143764.720064:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.720078:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79c3 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.720100:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.720107:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.720113:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 15 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.720124:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.720125:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143764.720128:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.720170:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 15 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.720180:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 15 pid: 8496 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.720189:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594363520:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.720280:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.720288:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 10 pid: 15784 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.720295:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594363648:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.720320:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 6 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.720327:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 6 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:3.0:1746143764.720338:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594363776:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.720352:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143764.721431:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594363520:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.721439:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594363648:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.721446:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594363776:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.721465:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.721476:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bde00, rc 0) 00000100:00100000:3.0:1746143764.721546:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31340:x1830963594205440:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1497us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.721552:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13430 00000100:00100000:0.0:1746143764.724191:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.724497:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594205568 00000100:00100000:2.0:1746143764.724505:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594205568 00000100:00100000:0.0:1746143764.724508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143764.724533:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 16 pid: 8496 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.724609:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594205696 00000100:00100000:2.0:1746143764.724612:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594205696 00000100:00100000:1.0:1746143764.724619:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7195 00010000:00010000:2.0:1746143764.724622:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 7 pid: 4581 timeout: 943 lvb_type: 1 00000100:00100000:1.0:1746143764.724627:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594205568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143764.724636:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7196 00010000:00010000:1.0:1746143764.724637:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143764.724639:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594205696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.724644:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.724655:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 7 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.724655:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 16 pid: 8496 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.724664:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 16 pid: 8496 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.724718:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 7 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:1.0:1746143764.724736:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130c34200/0xe984082ccd72fd3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7914 expref: 16 pid: 8496 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.724740:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1000/0xe984082ccd72fc6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78ce expref: 7 pid: 4581 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.724779:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143764.724779:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.724911:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594205696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 270us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.724911:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1963:x1830963594205568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 284us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.724917:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7195 00000100:00100000:2.0:1746143764.724971:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7196 00000100:00100000:0.0:1746143764.726802:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.726864:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594205824 00000100:00100000:2.0:1746143764.726869:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594205824 00010000:00010000:2.0:1746143764.726887:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 10 pid: 15784 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.726910:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7197 00000100:00100000:2.0:1746143764.726914:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594205824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.726922:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.726935:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 10 pid: 15784 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.726941:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 10 pid: 15784 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.726953:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e45e00/0xe984082ccd72fd66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a793e expref: 10 pid: 15784 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.726962:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.726963:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.726968:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.726972:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.726991:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.726999:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594363904:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.727055:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.728672:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.728750:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594363904:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.728763:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.728786:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594205824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1871us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.728794:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7197 00000100:00100000:1.0:1746143764.728799:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594206080 00000100:00100000:1.0:1746143764.728803:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594206080 00002000:00100000:1.0:1746143764.728833:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3186688->3190783) req@ffff8800a63a2d80 x1830963594206080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.728841:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2d80 with x1830963594206080 ext(3186688->3190783) 00002000:00010000:1.0:1746143764.728845:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a2d80 00000100:00100000:1.0:1746143764.728874:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6320 00000100:00100000:1.0:1746143764.728880:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1963:x1830963594206080:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143764.729011:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1963:x1830963594206080:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 131us (342us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143764.729017:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6320 00002000:00100000:1.0:1746143764.729021:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3186688->3190783) req@ffff8800a63a2d80 x1830963594206080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.729027:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2d80 with x1830963594206080 ext(3186688->3190783) 00002000:00010000:1.0:1746143764.729030:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a63a2d80 00000100:00100000:0.0:1746143764.730784:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.730940:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594206336 00000100:00100000:2.0:1746143764.730945:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594206336 00000100:00100000:2.0:1746143764.730979:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3947 00000100:00100000:2.0:1746143764.730985:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31340:x1830963594206336:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143764.731319:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31340:x1830963594206336:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 332us (535us total) trans 8589943517 rc 0/0 00000100:00100000:2.0:1746143764.731325:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3947 00010000:00010000:3.0:1746143764.773377:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143764.773723:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.774610:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594206592 00000100:00100000:3.0:1746143764.774618:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594206592 00000100:00100000:3.0:1746143764.774663:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9191 00000100:00100000:3.0:1746143764.774670:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31352:x1830963594206592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.774686:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.774700:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949b6400/0xe984082ccd72fe2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79ca expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.774777:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.774791:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.774799:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143764.774807:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:3.0:1746143764.774891:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949b6400/0xe984082ccd72fe2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 250 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.774917:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.774924:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.774926:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143764.774928:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde7800, rc 0) 00000100:00100000:3.0:1746143764.774963:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31352:x1830963594206592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 293us (1247us total) trans 8589943518 rc 0/0 00000100:00100000:3.0:1746143764.774968:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9191 00000100:00100000:0.0:1746143764.777464:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.777496:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.777524:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594206720 00000100:00100000:3.0:1746143764.777530:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594206720 00000100:00100000:3.0:1746143764.777564:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594206848 00000100:00100000:3.0:1746143764.777566:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594206848 00000100:00100000:3.0:1746143764.777579:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13431 00000100:00100000:1.0:1746143764.777587:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13432 00000100:00100000:1.0:1746143764.777594:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594206848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.777606:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.777620:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090486400/0xe984082ccd72fe3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79d8 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.777636:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1965:x1830963594206720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.777643:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.777651:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd400/0xe984082ccd72fe46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79d1 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.777668:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594364032:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143764.777674:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594364160:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143764.777899:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.778063:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.779808:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143764.779926:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143762 -> 1746143764 00002000:00010000:1.0:1746143764.779929:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143762 -> 1746143764 00002000:00010000:1.0:1746143764.779930:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143762 -> 1746143764 00000100:00100000:1.0:1746143764.779944:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594364032:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143764.779963:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090486400/0xe984082ccd72fe3f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79d8 expref: 25 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.779971:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090486400/0xe984082ccd72fe3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79d8 expref: 25 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.779984:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486400, rc 0) 00000100:00100000:1.0:1746143764.780016:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594206848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2422us (2518us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143764.780023:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13432 00002000:00010000:2.0:1746143764.780325:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143762 -> 1746143764 00002000:00010000:2.0:1746143764.780329:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143762 -> 1746143764 00002000:00010000:2.0:1746143764.780331:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143762 -> 1746143764 00000100:00100000:2.0:1746143764.780341:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594364160:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143764.780357:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd400/0xe984082ccd72fe46 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79d1 expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143764.780360:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594207104 00000100:00100000:3.0:1746143764.780365:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594207104 00010000:00010000:2.0:1746143764.780367:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd400/0xe984082ccd72fe46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79d1 expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.780382:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bd400, rc 0) 00000100:00100000:3.0:1746143764.780404:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9192 00000100:00100000:3.0:1746143764.780410:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31353:x1830963594207104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.780424:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.780435:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bd800/0xe984082ccd72fe4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79df expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.780508:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.780520:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143764.780528:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143764.780538:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:3.0:1746143764.780629:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bd800/0xe984082ccd72fe4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.780642:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.780649:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.780651:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143764.780654:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bdc00, rc 0) 00000100:00100000:3.0:1746143764.780673:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31353:x1830963594207104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 263us (870us total) trans 8589943519 rc 0/0 00000100:00100000:3.0:1746143764.780678:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9192 00000100:00100000:2.0:1746143764.781277:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1965:x1830963594206720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3690us (3816us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143764.781282:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13431 00000100:00100000:0.0:1746143764.784336:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.784904:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594207232 00000100:00100000:2.0:1746143764.784911:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594207232 00000100:00100000:2.0:1746143764.784959:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13433 00000100:00100000:2.0:1746143764.784967:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594207232:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.784982:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.784996:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a7400/0xe984082ccd72fe62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79e6 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.785039:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594364288:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143764.785122:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00002000:00010000:0.0:1746143764.787480:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143760 -> 1746143764 00000100:00100000:0.0:1746143764.787502:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594364288:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143764.787529:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a7400/0xe984082ccd72fe62 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79e6 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.787540:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a7400/0xe984082ccd72fe62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79e6 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.788115:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a7400, rc 0) 00000100:00100000:1.0:1746143764.789452:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594207232:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4480us (5116us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143764.789461:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13433 00000100:00100000:0.0:1746143764.791776:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.791853:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594207488 00000100:00100000:1.0:1746143764.791860:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594207488 00002000:00100000:1.0:1746143764.791902:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009cdc0e00 x1830963594207488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 504/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.791917:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0e00 with x1830963594207488 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.791922:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0e00 00000100:00100000:1.0:1746143764.791953:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6321 00000100:00100000:1.0:1746143764.791960:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594207488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143764.795984:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594207488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4016us (4206us total) trans 0 rc 409600/409600 00000100:00100000:1.0:1746143764.795994:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6321 00002000:00100000:1.0:1746143764.796004:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009cdc0e00 x1830963594207488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 504/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 409600/409600 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.796012:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0e00 with x1830963594207488 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.796017:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0e00 00000100:00100000:0.0:1746143764.797393:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.797498:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594207616 00000100:00100000:1.0:1746143764.797506:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594207616 00000100:00100000:1.0:1746143764.797550:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13434 00000100:00100000:1.0:1746143764.797557:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31353:x1830963594207616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.797570:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.797584:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79ed expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.797607:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.797613:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143764.797615:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143764.797619:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.797643:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.797654:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 14 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.797664:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594364416:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.798703:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.800405:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.800554:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.800559:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594364416:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143764.800580:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143764.800581:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.800597:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486200, rc 0) 00000100:00100000:0.0:1746143764.800608:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.800617:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594207872 00000100:00100000:1.0:1746143764.800621:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594207872 00000100:00100000:2.0:1746143764.800664:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594208128 00000100:00100000:2.0:1746143764.800667:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594208128 00000100:00100000:3.0:1746143764.800669:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594208000 00000100:00100000:3.0:1746143764.800671:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594208000 00000100:00100000:2.0:1746143764.800695:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13435 00000100:00100000:2.0:1746143764.800705:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594208128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.800720:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.800736:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fe70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a02 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.800775:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594364544:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143764.800833:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.800871:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13436 00000100:00100000:3.0:1746143764.800875:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13437 00000100:00100000:1.0:1746143764.800876:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594207872:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143764.800879:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594208000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.800882:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.800883:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.800890:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72fe7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79fb expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.800890:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090487200/0xe984082ccd72fe77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a79f4 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.800908:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594364800:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143764.800908:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594364672:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143764.800926:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.800926:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51399c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.800936:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594207744 00000100:00100000:1.0:1746143764.800939:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594207744 00002000:00100000:1.0:1746143764.800958:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1269760->1908735) req@ffff88009cdc3480 x1830963594207744/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.801120:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3480 with x1830963594207744 ext(1269760->1908735) 00010000:00010000:1.0:1746143764.801127:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 19 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.801136:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 19 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:1.0:1746143764.801167:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc3480 00000100:00100000:1.0:1746143764.801202:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1793 00000100:00100000:1.0:1746143764.801208:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594207744:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143764.801656:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31353:x1830963594207616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4098us (4267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143764.801663:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13434 00000100:00100000:2.0:1746143764.802358:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594364544:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143764.802378:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fe70 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a02 expref: 25 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.802388:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf13800/0xe984082ccd72fe70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a02 expref: 25 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.802405:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13800, rc 0) 00000100:00100000:3.0:1746143764.802425:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594364800:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143764.802427:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594208128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1726us (1873us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143764.802433:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13435 00010000:00010000:3.0:1746143764.802441:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72fe7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79fb expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.802449:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bd000/0xe984082ccd72fe7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79fb expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.802460:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7bd000, rc 0) 00000100:00100000:3.0:1746143764.802476:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594208000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1597us (1895us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143764.802481:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13437 00000100:00100000:1.0:1746143764.803303:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594364672:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143764.803319:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090487200/0xe984082ccd72fe77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79f4 expref: 18 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.803327:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090487200/0xe984082ccd72fe77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79f4 expref: 18 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143764.803348:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487200, rc 0) 00000100:00100000:1.0:1746143764.803380:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594207872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2503us (2980us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143764.803387:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13436 00000100:00100000:0.0:1746143764.806536:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.806634:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594208256 00000100:00100000:1.0:1746143764.806641:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594208256 00000100:00100000:1.0:1746143764.806689:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13438 00000100:00100000:1.0:1746143764.806696:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31352:x1830963594208256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.806710:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.806723:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a09 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.806751:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.806758:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143764.806759:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143764.806762:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.806786:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 9 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.806796:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 9 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.806805:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594364928:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.806883:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.810038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.810125:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594364928:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.810163:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.810177:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486a00, rc 0) 00000100:00100000:2.0:1746143764.810223:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31352:x1830963594208256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3527us (3693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.810230:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13438 00000100:00100000:3.0:1746143764.810422:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594208384 00000100:00100000:3.0:1746143764.810429:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594208384 00002000:00100000:3.0:1746143764.810454:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3190783) req@ffff88009cdc1500 x1830963594208384/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.810462:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1500 with x1830963594208384 ext(3145728->3190783) 00010000:00010000:3.0:1746143764.810467:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.810476:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.810481:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc1500 00000100:00100000:3.0:1746143764.810493:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1794 00000100:00100000:3.0:1746143764.810498:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594208384:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143764.811936:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594207744:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10725us (11323us total) trans 21474840425 rc 0/0 00000100:00100000:1.0:1746143764.811944:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1793 00002000:00100000:1.0:1746143764.811951:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1269760->1908735) req@ffff88009cdc3480 x1830963594207744/t21474840425(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/448 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.811958:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3480 with x1830963594207744 ext(1269760->1908735) 00010000:00010000:1.0:1746143764.811965:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:1.0:1746143764.811972:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:1.0:1746143764.811978:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc3480 00000100:00100000:2.0:1746143764.813090:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594208384:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2588us (3054us total) trans 21474840426 rc 0/0 00000100:00100000:2.0:1746143764.813097:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1794 00002000:00100000:2.0:1746143764.813103:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3190783) req@ffff88009cdc1500 x1830963594208384/t21474840426(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/448 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.813110:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1500 with x1830963594208384 ext(3145728->3190783) 00010000:00010000:2.0:1746143764.813117:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.813124:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:2.0:1746143764.813130:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc1500 00000100:00100000:0.0:1746143764.814755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.814922:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594208512 00000100:00100000:2.0:1746143764.814929:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594208512 00010000:00010000:2.0:1746143764.814952:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.814980:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7198 00000100:00100000:2.0:1746143764.814986:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594208512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.814995:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.815010:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.815018:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.815034:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7bde00/0xe984082ccd72fe23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79c3 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.815060:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.815062:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.815068:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.815080:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.815109:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.815381:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594365056:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.815746:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.816919:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594365056:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.816935:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.816966:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1962:x1830963594208512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1980us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.816974:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7198 00000100:00100000:0.0:1746143764.817119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.817155:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594208640 00000100:00100000:2.0:1746143764.817159:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594208640 00010000:00010000:2.0:1746143764.817175:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.817201:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7199 00000100:00100000:2.0:1746143764.817207:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594208640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.817215:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.817230:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.817243:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.817256:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801369eb600/0xe984082ccd72fe15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->1908735) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79b5 expref: 18 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.817266:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.817268:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.817272:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.817279:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.817295:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.817303:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594365184:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.818083:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.818822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.818865:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594208896 00000100:00100000:2.0:1746143764.818869:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594208896 00002000:00100000:2.0:1746143764.818895:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009cdc0a80 x1830963594208896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.818903:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0a80 with x1830963594208896 ext(2097152->3145727) 00002000:00010000:2.0:1746143764.818906:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0a80 00000100:00100000:2.0:1746143764.818925:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6322 00000100:00100000:2.0:1746143764.818930:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594208896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143764.818989:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594365184:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143764.819002:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.819038:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594208640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1831us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.819044:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7199 00000100:00100000:0.0:1746143764.825038:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.825103:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594209152 00000100:00100000:1.0:1746143764.825110:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594209152 00002000:00100000:1.0:1746143764.825181:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009cdc0380 x1830963594209152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.825201:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0380 with x1830963594209152 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.825206:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0380 00000100:00100000:1.0:1746143764.825287:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6323 00000100:00100000:1.0:1746143764.825295:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594209152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.829875:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594208896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10936us (11045us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.829886:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6322 00002000:00100000:2.0:1746143764.829900:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009cdc0a80 x1830963594208896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.829908:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0a80 with x1830963594208896 ext(2097152->3145727) 00002000:00010000:2.0:1746143764.829913:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0a80 00000100:00100000:1.0:1746143764.835256:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594209152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9954us (10218us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.835269:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6323 00002000:00100000:1.0:1746143764.835279:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009cdc0380 x1830963594209152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.835293:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0380 with x1830963594209152 ext(1048576->2097151) 00002000:00010000:1.0:1746143764.835298:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0380 00000100:00100000:0.0:1746143764.840698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.841553:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594209280 00000100:00100000:2.0:1746143764.841562:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594209280 00000100:00100000:0.0:1746143764.843959:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.844247:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594209408 00000100:00100000:2.0:1746143764.844255:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594209408 00000100:00100000:2.0:1746143764.844295:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13439 00000100:00100000:2.0:1746143764.844302:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31352:x1830963594209280:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143764.844320:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13440 00000100:00100000:1.0:1746143764.844327:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31353:x1830963594209408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143764.844339:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.844353:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a17 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.844371:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.844372:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.844377:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.844378:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844386:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a10 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.844390:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.844398:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffba00, rc 0) 00010000:00010000:2.0:1746143764.844403:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844409:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143764.844410:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143764.844413:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 25 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844438:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143764.844441:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31353:x1830963594209408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (488us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143764.844449:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 10 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.844459:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594365312:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.844472:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13440 00000100:00100000:2.0:1746143764.844507:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143764.844545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.844590:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594209664 00000100:00100000:2.0:1746143764.844593:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594209664 00000100:00100000:2.0:1746143764.844617:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9193 00000100:00100000:2.0:1746143764.844622:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31355:x1830963594209664:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143764.844633:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.844642:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09800/0xe984082ccd72fe9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a1e expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844713:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143764.844722:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 13 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844728:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 250 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844733:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143764.844748:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 250 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844801:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 250 pid: 14762 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.844810:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594365440:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.844851:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 13 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.844858:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 13 pid: 20509 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.844865:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594365568:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.847130:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.847316:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594365312:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.847337:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 25 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.847349:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f09600, rc 0) 00000100:00100000:2.0:1746143764.848706:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31352:x1830963594209280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4402us (8013us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.848715:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13439 00000100:00100000:3.0:1746143764.848784:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594365440:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.848957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.849056:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594209792 00000100:00100000:2.0:1746143764.849061:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594209792 00002000:00100000:2.0:1746143764.849091:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2494464->3145727) req@ffff8800a04cc380 x1830963594209792/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.849099:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc380 with x1830963594209792 ext(2494464->3145727) 00010000:00010000:2.0:1746143764.849106:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 11 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.849116:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 11 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:2.0:1746143764.849122:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cc380 00000100:00100000:2.0:1746143764.849135:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1795 00000100:00100000:2.0:1746143764.849157:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594209792:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143764.849779:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.850012:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.850232:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594365568:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.850252:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143764.850527:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594209920 00000100:00100000:0.0:1746143764.850531:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594209920 00010000:00010000:0.0:1746143764.850550:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 251 pid: 14762 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143764.850568:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594210048 00000100:00100000:0.0:1746143764.850570:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594210048 00010000:00010000:0.0:1746143764.850577:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 14 pid: 20509 timeout: 943 lvb_type: 0 00000100:00100000:0.0:1746143764.850598:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7200 00000100:00100000:0.0:1746143764.850603:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1964:x1830963594209920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143764.850611:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.850616:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 251 pid: 14762 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.850623:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 251 pid: 14762 timeout: 943 lvb_type: 0 00000100:00100000:3.0:1746143764.850625:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7201 00000100:00100000:3.0:1746143764.850631:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594210048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143764.850639:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143764.850639:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7400/0xe984082ccd72fe07 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ae expref: 251 pid: 14762 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.850644:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 14 pid: 20509 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.850652:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 14 pid: 20509 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.850662:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.850663:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009336aa00/0xe984082ccd72fde4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79a7 expref: 14 pid: 20509 timeout: 943 lvb_type: 0 00010000:00010000:0.0:1746143764.850666:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143764.850673:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143764.850678:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.850689:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.850691:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143764.850713:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594210048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 82us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.850718:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7201 00000100:00100000:1.0:1746143764.850877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.850917:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594210304 00000100:00100000:2.0:1746143764.850920:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594210304 00002000:00100000:2.0:1746143764.850939:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a04cfb80 x1830963594210304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.850947:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cfb80 with x1830963594210304 ext(2097152->3145727) 00002000:00010000:2.0:1746143764.850950:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cfb80 00000100:00100000:2.0:1746143764.850972:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6324 00000100:00100000:2.0:1746143764.850977:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594210304:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:0.0:1746143764.852616:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.852650:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1964:x1830963594209920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2044us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.852658:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7200 00010000:00010000:3.0:1746143764.852737:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.852744:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143764.852765:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:3.0:1746143764.852874:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09800/0xe984082ccd72fe9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 251 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.852887:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 250 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.852893:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.852896:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143764.852898:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f09a00, rc 0) 00000100:00100000:3.0:1746143764.852926:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31355:x1830963594209664:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8304us (8382us total) trans 8589943520 rc 0/0 00000100:00100000:3.0:1746143764.852932:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9193 00000100:00100000:3.0:1746143764.859467:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594210304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8481us (8581us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.859476:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6324 00002000:00100000:3.0:1746143764.859485:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a04cfb80 x1830963594210304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.859493:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cfb80 with x1830963594210304 ext(2097152->3145727) 00002000:00010000:3.0:1746143764.859498:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cfb80 00000100:00100000:3.0:1746143764.865901:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594209792:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16736us (16935us total) trans 17179873106 rc 0/0 00000100:00100000:3.0:1746143764.865914:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1795 00002000:00100000:3.0:1746143764.865925:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2494464->3145727) req@ffff8800a04cc380 x1830963594209792/t17179873106(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/448 e 0 to 0 dl 1746143775 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.865934:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cc380 with x1830963594209792 ext(2494464->3145727) 00010000:00010000:3.0:1746143764.865943:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 13 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:3.0:1746143764.865957:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 13 pid: 8497 timeout: 943 lvb_type: 0 00002000:00010000:3.0:1746143764.865962:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a04cc380 00000100:00100000:0.0:1746143764.868232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.868437:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594210432 00000100:00100000:2.0:1746143764.868444:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594210432 00000100:00100000:2.0:1746143764.868483:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13441 00000100:00100000:2.0:1746143764.868489:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31353:x1830963594210432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.868505:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.868520:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a25 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.868548:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143764.868553:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.868564:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 14 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.868574:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075f600, rc 0) 00000100:00100000:2.0:1746143764.868625:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31353:x1830963594210432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 135us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.868630:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13441 00000100:00100000:0.0:1746143764.870306:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.870457:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594210560 00000100:00100000:2.0:1746143764.870462:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594210560 00010000:00010000:2.0:1746143764.870484:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 14 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.870515:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7202 00000100:00100000:2.0:1746143764.870525:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594210560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.870534:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.870552:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 14 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.870562:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 14 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.870583:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6200/0xe984082ccd72fe1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2494464->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79bc expref: 14 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.870612:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.870613:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.870619:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.870627:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.870634:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.870636:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.870638:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.870644:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.870667:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.870678:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594365696:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.870738:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 24 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.870750:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594365824:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.870767:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.874889:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594365696:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.874902:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594365824:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.874920:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.874966:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594210560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4445us (4662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.874976:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7202 00000100:00100000:0.0:1746143764.878414:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.878456:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.878647:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594210944 00000100:00100000:3.0:1746143764.878655:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594210944 00000100:00100000:0.0:1746143764.878672:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143764.878692:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc3800 x1830963594210944/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.878700:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3800 with x1830963594210944 ext(2097152->3145727) 00002000:00010000:3.0:1746143764.878705:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3800 00000100:00100000:3.0:1746143764.878871:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594211072 00000100:00100000:2.0:1746143764.878871:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594211328 00000100:00100000:3.0:1746143764.878874:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594211072 00000100:00100000:2.0:1746143764.878876:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594211328 00002000:00100000:3.0:1746143764.878888:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f03b80 x1830963594211072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.878895:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03b80 with x1830963594211072 ext(3145728->4194303) 00002000:00100000:2.0:1746143764.878895:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093f00e00 x1830963594211328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143764.878897:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03b80 00002000:00100000:2.0:1746143764.878901:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00e00 with x1830963594211328 ext(3145728->4194303) 00002000:00010000:2.0:1746143764.878904:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00e00 00000100:00100000:3.0:1746143764.878911:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6325 00000100:00100000:3.0:1746143764.878917:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594210944:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.878921:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6326 00000100:00100000:2.0:1746143764.878926:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594211072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.878930:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.878966:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6327 00000100:00100000:2.0:1746143764.878970:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594211328:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143764.880013:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594211584 00000100:00100000:3.0:1746143764.880017:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594211584 00000100:00100000:3.0:1746143764.880041:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9194 00000100:00100000:3.0:1746143764.880047:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31357:x1830963594211584:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143764.880059:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.880074:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09800/0xe984082ccd72feb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a2c expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.880164:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.880174:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.880186:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.880210:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.880215:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.880220:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143764.880837:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.880859:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.881011:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594211840 00000100:00100000:2.0:1746143764.881015:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594211840 00002000:00100000:2.0:1746143764.881032:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f00000 x1830963594211840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.881050:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00000 with x1830963594211840 ext(2097152->3145727) 00002000:00010000:2.0:1746143764.881054:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f00000 00000100:00100000:2.0:1746143764.881069:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594211968 00000100:00100000:2.0:1746143764.881071:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594211968 00000100:00100000:0.0:1746143764.881075:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143764.881082:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f03800 x1830963594211968/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.881088:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03800 with x1830963594211968 ext(3145728->4194303) 00002000:00010000:2.0:1746143764.881090:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03800 00000100:00100000:2.0:1746143764.881100:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594212352 00000100:00100000:2.0:1746143764.881101:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594212352 00002000:00100000:2.0:1746143764.881112:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093f00380 x1830963594212352/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143764.881113:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6328 00002000:00100000:2.0:1746143764.881117:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00380 with x1830963594212352 ext(3145728->4194303) 00000100:00100000:0.0:1746143764.881119:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594211840:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:2.0:1746143764.881120:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00380 00000100:00100000:2.0:1746143764.881130:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6329 00000100:00100000:2.0:1746143764.881135:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594211968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.881255:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6330 00000100:00100000:2.0:1746143764.881261:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594212352:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143764.881747:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.881758:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.881766:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143764.881774:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:3.0:1746143764.881844:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.881850:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.881855:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.881859:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a95e2e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143764.884499:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884510:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884524:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143764.884526:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143764.884530:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884535:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a95e2e00/0xe984082ccd72febd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884554:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884562:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884567:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884571:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bc9a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143764.884572:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884576:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884580:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009066df00) 00010000:00010000:3.0:1746143764.884582:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143764.884584:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884587:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9a00/0xe984082ccd72fec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.884634:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09800/0xe984082ccd72feb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.884644:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.884650:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143764.884651:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143764.884653:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bc9800, rc 0) 00000100:00100000:3.0:1746143764.884696:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31357:x1830963594211584:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4648us (5766us total) trans 8589943521 rc 0/0 00000100:00100000:3.0:1746143764.884703:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9194 00000100:00100000:1.0:1746143764.896470:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594211840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15343us (15626us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.896480:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6328 00002000:00100000:1.0:1746143764.896489:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880093f00000 x1830963594211840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.896498:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00000 with x1830963594211840 ext(2097152->3145727) 00002000:00010000:1.0:1746143764.896503:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f00000 00000100:00100000:2.0:1746143764.909455:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594211072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30520us (30990us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.909465:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6326 00002000:00100000:2.0:1746143764.909475:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f03b80 x1830963594211072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.909489:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03b80 with x1830963594211072 ext(3145728->4194303) 00002000:00010000:2.0:1746143764.909494:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03b80 00000100:00100000:3.0:1746143764.909798:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594212352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28535us (28721us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.909804:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6330 00002000:00100000:3.0:1746143764.909810:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093f00380 x1830963594212352/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.909815:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00380 with x1830963594212352 ext(3145728->4194303) 00002000:00010000:3.0:1746143764.909819:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00380 00000100:00100000:1.0:1746143764.910112:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594210944:12345-192.168.202.48@tcp:3:cat.0 Request processed in 31194us (31705us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143764.910118:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6325 00002000:00100000:1.0:1746143764.910124:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc3800 x1830963594210944/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143764.910130:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3800 with x1830963594210944 ext(2097152->3145727) 00002000:00010000:1.0:1746143764.910133:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3800 00000100:00100000:2.0:1746143764.919087:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594211968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 37935us (38210us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143764.919099:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6329 00002000:00100000:2.0:1746143764.919110:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f03800 x1830963594211968/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.919119:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03800 with x1830963594211968 ext(3145728->4194303) 00002000:00010000:2.0:1746143764.919124:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f03800 00000100:00100000:3.0:1746143764.920117:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594211328:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41141us (41440us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143764.920125:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6327 00002000:00100000:3.0:1746143764.920131:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880093f00e00 x1830963594211328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.920163:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00e00 with x1830963594211328 ext(3145728->4194303) 00002000:00010000:3.0:1746143764.920167:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00e00 00000100:00100000:2.0:1746143764.925326:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.925391:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594212608 00000100:00100000:3.0:1746143764.925400:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594212608 00000100:00100000:2.0:1746143764.925415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143764.925440:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012b7ce300 x1830963594212608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.925449:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ce300 with x1830963594212608 ext(4194304->4771839) 00002000:00010000:3.0:1746143764.925453:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ce300 00000100:00100000:0.0:1746143764.925668:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594212736 00000100:00100000:0.0:1746143764.925672:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594212736 00000100:00100000:0.0:1746143764.925704:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13442 00000100:00100000:0.0:1746143764.925711:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594212736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143764.925723:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143764.925735:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a33 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143764.925753:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.925755:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143764.925762:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 18 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.925774:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 18 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143764.925783:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336b600, rc 0) 00000100:00100000:3.0:1746143764.925927:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6331 00000100:00100000:3.0:1746143764.925933:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594212608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143764.927060:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594212736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1347us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.927066:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13442 00000100:00100000:0.0:1746143764.933681:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.934961:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594212992 00000100:00100000:2.0:1746143764.934970:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594212992 00002000:00100000:2.0:1746143764.935009:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880093f00700 x1830963594212992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.935017:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00700 with x1830963594212992 ext(4194304->4771839) 00002000:00010000:2.0:1746143764.935021:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00700 00000100:00100000:2.0:1746143764.935051:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6332 00000100:00100000:2.0:1746143764.935058:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594212992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143764.935159:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594212608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9224us (9839us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143764.935166:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6331 00002000:00100000:3.0:1746143764.935172:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012b7ce300 x1830963594212608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143764.935179:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7ce300 with x1830963594212608 ext(4194304->4771839) 00002000:00010000:3.0:1746143764.935182:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7ce300 00000100:00100000:0.0:1746143764.951406:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.951494:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594213120 00000100:00100000:2.0:1746143764.951503:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594213120 00000100:00100000:2.0:1746143764.951589:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13443 00000100:00100000:2.0:1746143764.951597:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31357:x1830963594213120:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143764.951615:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.951629:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a3a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.951652:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 5 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.951659:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.951666:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.951671:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.951672:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.951676:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [745472->1048575] (req 745472->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.951700:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.951711:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 19 pid: 12618 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.951727:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594365952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.952909:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 13 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.952924:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 13 pid: 21542 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.952933:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594366080:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.952963:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 5 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.952970:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 5 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.952977:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594366208:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.952993:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.954008:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594212992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18948us (20331us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143764.954016:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6332 00002000:00100000:2.0:1746143764.954024:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880093f00700 x1830963594212992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/440 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.954032:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00700 with x1830963594212992 ext(4194304->4771839) 00002000:00010000:2.0:1746143764.954036:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f00700 00000100:00100000:0.0:1746143764.957388:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143764.957635:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594213248 00000100:00100000:1.0:1746143764.957642:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594213248 00000100:00100000:3.0:1746143764.957993:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594365952:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.958005:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594366080:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.958100:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13444 00000100:00100000:1.0:1746143764.958107:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31355:x1830963594213248:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143764.958120:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143764.958133:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a41 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.958180:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.958188:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.958203:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.958205:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143764.958208:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1097728->1855487] (req 1097728->1855487) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.958231:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.958240:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 26 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.958250:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594366336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143764.958319:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143764.958327:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.958334:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594366464:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143764.958350:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143764.958639:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594366208:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.958659:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [745472->1048575] (req 745472->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.958674:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075ee00, rc 0) 00000100:00100000:3.0:1746143764.958703:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31357:x1830963594213120:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7107us (7305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.958709:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13443 00000100:00100000:0.0:1746143764.962585:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.962629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143764.962657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.962708:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594213376 00000100:00100000:2.0:1746143764.962715:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594213376 00000100:00100000:0.0:1746143764.962734:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143764.962744:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 13 pid: 21542 timeout: 943 lvb_type: 1 00000100:00100000:0.0:1746143764.962758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.962773:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594213504 00000100:00100000:2.0:1746143764.962775:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594213504 00010000:00010000:2.0:1746143764.962782:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 6 pid: 25369 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.962790:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594213632 00000100:00100000:2.0:1746143764.962791:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594213632 00010000:00010000:2.0:1746143764.962799:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 18 pid: 12618 timeout: 943 lvb_type: 1 00000100:00100000:2.0:1746143764.962807:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594213888 00000100:00100000:2.0:1746143764.962808:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594213888 00010000:00010000:2.0:1746143764.962818:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 13 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.962824:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594213760 00000100:00100000:2.0:1746143764.962826:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594213760 00010000:00010000:2.0:1746143764.962834:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 27 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.962843:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7203 00000100:00100000:2.0:1746143764.962848:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594213376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.962859:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.962876:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 13 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.962883:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 13 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.962901:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092932a00/0xe984082ccd72fd58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7922 expref: 13 pid: 21542 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.962918:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.962965:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594213376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.962971:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7203 00000100:00100000:2.0:1746143764.962984:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7204 00000100:00100000:2.0:1746143764.962988:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1963:x1830963594213504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.962993:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.963001:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 6 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.963007:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 6 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.963018:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135181c00/0xe984082ccd72fc5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78b2 expref: 6 pid: 25369 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.963025:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.963038:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1963:x1830963594213504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.963043:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7204 00000100:00100000:2.0:1746143764.963073:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7205 00000100:00100000:2.0:1746143764.963078:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594213632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.963084:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.963091:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 18 pid: 12618 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.963098:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 18 pid: 12618 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.963107:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8e44600/0xe984082ccd72fd2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a78f8 expref: 18 pid: 12618 timeout: 943 lvb_type: 1 00010000:00010000:2.0:1746143764.963115:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.963117:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.963122:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.963128:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.963178:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.963197:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594366592:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.963243:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.963259:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7206 00000100:00100000:2.0:1746143764.963264:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594213888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.963270:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.963283:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 13 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.963290:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 13 pid: 8497 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.963300:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.963318:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594213888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.963322:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7206 00000100:00100000:2.0:1746143764.963332:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7207 00000100:00100000:2.0:1746143764.963336:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594213760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.963340:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.963346:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 27 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.963353:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 27 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.963361:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.963363:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.963366:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.963373:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.963387:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 27 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.963395:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594366720:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.963412:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746143764.963474:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095386e00/0xe984082ccd72fdb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a798b expref: 27 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.963483:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594366336:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.963492:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5804000/0xe984082ccd72fdac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7984 expref: 12 pid: 8497 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.963505:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594366464:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.963523:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.963530:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25ac00, rc 0) 00000100:00100000:2.0:1746143764.963547:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31355:x1830963594213248:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5441us (6167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.963553:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13444 00000100:00100000:0.0:1746143764.964915:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.965032:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594214016 00000100:00100000:3.0:1746143764.965037:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594214016 00000100:00100000:3.0:1746143764.965064:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13445 00000100:00100000:3.0:1746143764.965069:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594214016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.965081:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.965093:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72feee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a48 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.965124:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594366848:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143764.965580:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.966098:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.966172:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594214144 00000100:00100000:2.0:1746143764.966176:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594214144 00000100:00100000:2.0:1746143764.966218:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13446 00000100:00100000:2.0:1746143764.966226:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594214144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143764.966233:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.966242:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075f000/0xe984082ccd72fef5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a4f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.966270:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594366976:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143764.966873:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143764.967276:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.967305:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594366720:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143764.967317:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.967321:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594214400 00000100:00100000:2.0:1746143764.967325:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594214400 00002000:00100000:2.0:1746143764.967375:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1097728->1101823) req@ffff8800a04cd180 x1830963594214400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.967383:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd180 with x1830963594214400 ext(1097728->1101823) 00002000:00010000:2.0:1746143764.967387:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cd180 00000100:00100000:2.0:1746143764.967481:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6333 00000100:00100000:2.0:1746143764.967487:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594214400:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143764.967683:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594213760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4345us (4923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143764.967691:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7207 00002000:00010000:3.0:1746143764.967724:0:9527:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime: 1746143760 -> 1746143764 00002000:00010000:3.0:1746143764.967726:0:9527:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143758 -> 1746143764 00002000:00010000:3.0:1746143764.967728:0:9527:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime: 1746143760 -> 1746143764 00000100:00100000:3.0:1746143764.967738:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594366848:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143764.967755:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72feee lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a48 expref: 19 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.967765:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72feee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a48 expref: 19 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.967778:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dc000, rc 0) 00000100:00100000:3.0:1746143764.967795:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594214016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2725us (2884us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143764.967800:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13445 00000100:00100000:0.0:1746143764.967822:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594366592:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143764.967831:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143764.967846:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594213632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4766us (5188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143764.967852:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7205 00000100:00100000:2.0:1746143764.968014:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594214400:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 526us (738us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143764.968020:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6333 00002000:00100000:2.0:1746143764.968025:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1097728->1101823) req@ffff8800a04cd180 x1830963594214400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.968033:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd180 with x1830963594214400 ext(1097728->1101823) 00002000:00010000:2.0:1746143764.968035:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cd180 00000100:00100000:0.0:1746143764.968279:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.968315:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594214656 00000100:00100000:2.0:1746143764.968318:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594214656 00002000:00100000:2.0:1746143764.968334:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (745472->749567) req@ffff880093f01180 x1830963594214656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.968341:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01180 with x1830963594214656 ext(745472->749567) 00002000:00010000:2.0:1746143764.968343:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01180 00000100:00100000:2.0:1746143764.968354:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6334 00000100:00100000:2.0:1746143764.968358:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594214656:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143764.968473:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594214656:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 113us (193us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143764.968478:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6334 00002000:00100000:2.0:1746143764.968483:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (745472->749567) req@ffff880093f01180 x1830963594214656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.968490:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01180 with x1830963594214656 ext(745472->749567) 00002000:00010000:2.0:1746143764.968492:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f01180 00002000:00010000:2.0:1746143764.970726:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143761 -> 1746143764 00000100:00100000:2.0:1746143764.970746:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594366976:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143764.970769:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009075f000/0xe984082ccd72fef5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a4f expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.970780:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075f000/0xe984082ccd72fef5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a4f expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143764.970790:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075f000, rc 0) 00000100:00100000:2.0:1746143764.970823:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594214144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4599us (4724us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143764.970829:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13446 00000100:00100000:0.0:1746143764.974178:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.974283:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594214912 00000100:00100000:2.0:1746143764.974291:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594214912 00000100:00100000:2.0:1746143764.974346:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13447 00000100:00100000:2.0:1746143764.974354:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31357:x1830963594214912:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143764.974369:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143764.974383:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a5d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.974405:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.974411:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.974417:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.974418:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.974421:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 5/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->1208319] (req 1048576->1208319) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.974445:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.974456:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 13 pid: 12618 timeout: 943 lvb_type: 0 00000100:00100000:1.0:1746143764.974461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.974466:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594367104:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.974534:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594214784 00000100:00100000:3.0:1746143764.974538:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594214784 00000100:00100000:3.0:1746143764.974568:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13448 00000100:00100000:3.0:1746143764.974573:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594214784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143764.974581:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.974588:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a07dd000/0xe984082ccd72ff03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a56 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143764.974613:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594367232:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143764.974855:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.974863:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 24 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.974878:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594367360:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.974901:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.975260:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143764.976305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.976374:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594215168 00000100:00100000:2.0:1746143764.976379:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594215168 00002000:00100000:2.0:1746143764.976408:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1851392->1855487) req@ffff880093f01880 x1830963594215168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.976416:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01880 with x1830963594215168 ext(1851392->1855487) 00002000:00010000:2.0:1746143764.976420:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01880 00000100:00100000:2.0:1746143764.976435:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6335 00000100:00100000:2.0:1746143764.976440:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594215168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143764.976940:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594215168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 499us (637us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143764.976946:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6335 00002000:00100000:2.0:1746143764.976952:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1851392->1855487) req@ffff880093f01880 x1830963594215168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.976958:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01880 with x1830963594215168 ext(1851392->1855487) 00002000:00010000:2.0:1746143764.976961:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01880 00000100:00100000:3.0:1746143764.978016:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:9527:1830963594367232:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143764.978040:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a07dd000/0xe984082ccd72ff03 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a56 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.978050:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dd000/0xe984082ccd72ff03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a56 expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143764.978063:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dd000, rc 0) 00000100:00100000:3.0:1746143764.978097:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594214784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3523us (3635us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143764.978104:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13448 00000100:00100000:2.0:1746143764.978500:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594367104:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143764.978508:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594367360:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143764.978523:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->1208319] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.978539:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075fa00, rc 0) 00000100:00100000:2.0:1746143764.978554:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31357:x1830963594214912:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4202us (4382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.978559:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13447 00000100:00100000:0.0:1746143764.979289:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.979770:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594215424 00000100:00100000:2.0:1746143764.979775:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594215424 00010000:00010000:2.0:1746143764.979795:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 13 pid: 12618 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.979828:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7208 00000100:00100000:2.0:1746143764.979834:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594215424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.979844:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.979858:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 13 pid: 12618 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.979867:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 13 pid: 12618 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.979883:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c905c00/0xe984082ccd72fd97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a796f expref: 13 pid: 12618 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.979893:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.979927:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594215424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.979932:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7208 00000100:00100000:0.0:1746143764.979976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.980174:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594215296 00000100:00100000:2.0:1746143764.980177:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594215296 00010000:00010000:2.0:1746143764.980188:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00000100:00100000:2.0:1746143764.980411:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7209 00000100:00100000:2.0:1746143764.980417:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594215296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143764.980424:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143764.980430:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.980438:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.980447:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938ba200/0xe984082ccd72fd90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7968 expref: 25 pid: 21542 timeout: 943 lvb_type: 0 00010000:00010000:2.0:1746143764.980454:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.980456:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143764.980461:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.980467:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143764.980487:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143764.980499:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594367488:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143764.980873:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143764.981976:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594367488:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143764.981990:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143764.982023:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594215296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1605us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143764.982030:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7209 00000100:00100000:0.0:1746143764.984335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.985218:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594215680 00000100:00100000:2.0:1746143764.985225:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594215680 00002000:00100000:2.0:1746143764.985259:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1204224->1208319) req@ffff8800a087b100 x1830963594215680/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/0 e 0 to 0 dl 1746143775 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.985268:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b100 with x1830963594215680 ext(1204224->1208319) 00002000:00010000:2.0:1746143764.985272:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b100 00000100:00100000:2.0:1746143764.985298:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6336 00000100:00100000:2.0:1746143764.985303:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594215680:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143764.985444:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594215680:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 139us (1114us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143764.985451:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6336 00002000:00100000:2.0:1746143764.985456:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1204224->1208319) req@ffff8800a087b100 x1830963594215680/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746143775 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143764.985462:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087b100 with x1830963594215680 ext(1204224->1208319) 00002000:00010000:2.0:1746143764.985464:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a087b100 00000100:00100000:0.0:1746143764.988479:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.988554:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594215936 00000100:00100000:2.0:1746143764.988560:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594215936 00000100:00100000:2.0:1746143764.988596:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3948 00000100:00100000:2.0:1746143764.988602:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31357:x1830963594215936:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143764.988842:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31357:x1830963594215936:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 239us (369us total) trans 8589943522 rc 0/0 00000100:00100000:2.0:1746143764.988848:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3948 00000100:00100000:0.0:1746143764.996468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143764.996540:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594216064 00000100:00100000:3.0:1746143764.996548:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594216064 00000100:00100000:3.0:1746143764.996599:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9195 00000100:00100000:3.0:1746143764.996606:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31363:x1830963594216064:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143764.996634:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143764.996650:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd000/0xe984082ccd72ff0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a64 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.996701:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996711:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996722:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996733:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996739:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996744:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996836:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996844:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 249 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.996851:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143764.996875:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 249 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143764.996885:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 249 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143764.996895:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594367616:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143764.996980:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143764.998404:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594367616:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143764.998420:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143764.998626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.998679:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594216320 00000100:00100000:2.0:1746143764.998683:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594216320 00000100:00100000:2.0:1746143764.998724:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3949 00000100:00100000:2.0:1746143764.998729:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:15421:x1830963594216320:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143764.998909:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:15421:x1830963594216320:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 179us (284us total) trans 8589943523 rc 0/0 00000100:00100000:2.0:1746143764.998915:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3949 00000100:00100000:0.0:1746143764.999805:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143764.999975:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594216448 00000100:00100000:2.0:1746143764.999979:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594216448 00010000:00010000:2.0:1746143765.000000:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 251 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.000017:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7210 00000100:00100000:2.0:1746143765.000022:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1964:x1830963594216448:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.000030:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.000038:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 251 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.000047:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 251 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.000063:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f09a00/0xe984082ccd72fea1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a1e expref: 251 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.000079:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143765.000083:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.000091:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.000096:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.000121:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.000169:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1964:x1830963594216448:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 146us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.000175:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7210 00010000:00010000:3.0:1746143765.000281:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000289:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143765.000314:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00000004:00200000:3.0:1746143765.000318:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143765.000326:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000333:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000339:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000343:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000347:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000349:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a07dc000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.000352:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000355:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000361:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143765.000362:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.000364:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000366:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000383:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000387:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000391:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000395:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a07dca00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.000398:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000406:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000412:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009066d200) 00010000:00010000:3.0:1746143765.000414:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.000415:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000420:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dca00/0xe984082ccd72ff18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.000447:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a07dd000/0xe984082ccd72ff0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.000455:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.000461:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.000462:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143765.000464:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7bce00, rc 0) 00000100:00100000:3.0:1746143765.000498:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31363:x1830963594216064:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3892us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.000504:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9195 00000100:00100000:0.0:1746143765.002637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.002667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.002702:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594216576 00000100:00100000:2.0:1746143765.002708:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594216576 00000100:00100000:0.0:1746143765.002728:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.002741:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13449 00000100:00100000:2.0:1746143765.002748:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1965:x1830963594216576:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143765.002759:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.002771:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009075fe00/0xe984082ccd72ff26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a6b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.002807:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594367744:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143765.002881:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.003691:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.003728:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.003752:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.003816:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594216704 00000100:00100000:1.0:1746143765.003821:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594216704 00000100:00100000:1.0:1746143765.003841:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594216832 00000100:00100000:1.0:1746143765.003844:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594216832 00000100:00100000:1.0:1746143765.003854:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594216960 00000100:00100000:1.0:1746143765.003856:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594216960 00000100:00100000:1.0:1746143765.003865:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594217088 00000100:00100000:1.0:1746143765.003866:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594217088 00000100:00100000:1.0:1746143765.003874:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594217216 00000100:00100000:1.0:1746143765.003876:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594217216 00000100:00100000:1.0:1746143765.003887:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13450 00000100:00100000:1.0:1746143765.003892:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594216704:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.003900:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.003910:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c25a400/0xe984082ccd72ff2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a72 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.003928:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13451 00000100:00100000:2.0:1746143765.003935:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594216832:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:1.0:1746143765.003939:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594367872:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143765.003942:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.003949:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075f800/0xe984082ccd72ff34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a79 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.003971:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594368000:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143765.003978:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.003992:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.003993:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13452 00000100:00100000:1.0:1746143765.003998:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594216960:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.004004:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143765.004006:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13453 00000100:00100000:2.0:1746143765.004011:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594217088:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.004011:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a80 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.004016:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.004022:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.004023:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a87 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.004023:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.004030:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.004033:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.004035:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.004039:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.004042:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.004048:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.004053:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c905c00, rc 0) 00010000:00010000:2.0:1746143765.004055:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075e800, rc 0) 00000100:00100000:2.0:1746143765.004071:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594217088:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.004074:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594216960:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 76us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.004076:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13453 00000100:00100000:1.0:1746143765.004079:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13452 00000100:00100000:2.0:1746143765.004090:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13454 00000100:00100000:2.0:1746143765.004095:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594217216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143765.004100:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.004106:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a8e expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.004114:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.004116:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.004119:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.004129:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.004135:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075e200, rc 0) 00000100:00100000:2.0:1746143765.004502:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594217216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 405us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.004514:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594367744:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143765.004532:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009075fe00/0xe984082ccd72ff26 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a6b expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.004541:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009075fe00/0xe984082ccd72ff26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a6b expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.004555:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075fe00, rc 0) 00000100:00100000:3.0:1746143765.004582:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594216576:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1833us (1948us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143765.004721:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13454 00000100:00100000:3.0:1746143765.004762:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13449 00002000:00010000:1.0:1746143765.006172:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143759 -> 1746143764 00000100:00100000:2.0:1746143765.006182:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594368000:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143765.006183:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594367872:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143765.006210:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c25a400/0xe984082ccd72ff2d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a72 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.006211:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009075f800/0xe984082ccd72ff34 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a79 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.006220:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c25a400/0xe984082ccd72ff2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a72 expref: 9 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.006221:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075f800/0xe984082ccd72ff34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a79 expref: 9 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.006228:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075f800, rc 0) 00000100:00100000:2.0:1746143765.006251:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594216832:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2316us (3523us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143765.006260:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13451 00010000:00010000:1.0:1746143765.006648:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25a400, rc 0) 00000100:00100000:1.0:1746143765.006676:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963594216704:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2783us (4007us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143765.006682:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13450 00000100:00100000:0.0:1746143765.008480:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.008603:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594217472 00000100:00100000:3.0:1746143765.008611:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594217472 00000100:00100000:3.0:1746143765.008656:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9196 00000100:00100000:3.0:1746143765.008663:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31363:x1830963594217472:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143765.008676:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.008688:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd600/0xe984082ccd72ff50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a95 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.008765:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.008777:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.008782:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.008805:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.008815:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 8 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.008824:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594368128:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.009634:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.010603:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594368128:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.010619:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143765.010972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.011045:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594217600 00000100:00100000:2.0:1746143765.011050:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594217600 00010000:00010000:2.0:1746143765.011071:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 9 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.011091:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7211 00000100:00100000:2.0:1746143765.011097:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594217600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.011105:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.011110:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 9 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.011118:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 9 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.011132:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ff1f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a64 expref: 9 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.011171:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143765.011175:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.011181:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.011186:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.011216:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.011256:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594217600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 159us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.011262:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7211 00010000:00010000:3.0:1746143765.011332:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.011338:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143765.011356:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:3.0:1746143765.011471:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd600/0xe984082ccd72ff50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.011484:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.011490:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.011492:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143765.011494:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7bc000, rc 0) 00000100:00100000:3.0:1746143765.011928:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31363:x1830963594217472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3265us (3452us total) trans 8589943524 rc 0/0 00000100:00100000:3.0:1746143765.011934:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9196 00000100:00100000:0.0:1746143765.013998:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.014094:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594217728 00000100:00100000:3.0:1746143765.014101:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594217728 00000100:00100000:3.0:1746143765.014137:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9197 00000100:00100000:3.0:1746143765.014163:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31363:x1830963594217728:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143765.014180:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.014206:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bde00/0xe984082ccd72ff65 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7a9c expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.014272:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.014283:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.014288:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.014312:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.014322:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 9 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.014331:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594368256:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.014734:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.018063:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.018344:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594368256:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.018366:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143765.018441:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594217856 00000100:00100000:1.0:1746143765.018446:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594217856 00010000:00010000:1.0:1746143765.018474:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.018514:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7212 00000100:00100000:1.0:1746143765.018520:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594217856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.018530:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.018536:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.018544:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.018561:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bc000/0xe984082ccd72ff57 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a95 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.018596:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143765.018600:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143765.018607:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143765.018612:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143765.018626:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.018666:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594217856:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 145us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.018672:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7212 00010000:00010000:3.0:1746143765.018731:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.018738:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143765.018776:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00000004:00200000:3.0:1746143765.018781:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143765.018795:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.018820:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bde00/0xe984082ccd72ff65 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a9c expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.018832:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a9c expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.018838:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.018840:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143765.018842:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7bd200, rc 0) 00000100:00100000:3.0:1746143765.018865:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31363:x1830963594217728:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4702us (4872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.018871:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9197 00000100:00100000:0.0:1746143765.020537:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.020680:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594217984 00000100:00100000:1.0:1746143765.020686:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594217984 00000100:00100000:1.0:1746143765.020806:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13455 00000100:00100000:1.0:1746143765.020811:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594217984:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.020824:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.020836:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7aa3 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.020877:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594368384:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143765.020944:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.022233:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.022264:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.022384:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594218112 00000100:00100000:3.0:1746143765.022393:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594218112 00000100:00100000:3.0:1746143765.022417:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594218240 00000100:00100000:3.0:1746143765.022419:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594218240 00000100:00100000:3.0:1746143765.022439:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13456 00000100:00100000:3.0:1746143765.022445:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594218112:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143765.022454:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.022465:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7bca00/0xe984082ccd72ff7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7aaa expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.022495:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594368512:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143765.022549:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.022562:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13457 00000100:00100000:3.0:1746143765.022568:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594218240:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143765.022573:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.022579:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ff81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ab1 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.022599:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594368640:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143765.022628:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.022640:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594368384:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143765.022659:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff73 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7aa3 expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.022668:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a07dc000/0xe984082ccd72ff73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7aa3 expref: 8 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.022677:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07dc000, rc 0) 00000100:00100000:1.0:1746143765.022707:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594217984:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1896us (2174us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143765.022712:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13455 00000100:00100000:3.0:1746143765.023820:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594368512:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143765.023824:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594368640:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143765.023836:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7bca00/0xe984082ccd72ff7a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7aaa expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.023842:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ff81 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ab1 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.023844:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7bca00/0xe984082ccd72ff7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7aaa expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.023851:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ff81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ab1 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.023852:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7bca00, rc 0) 00010000:00010000:2.0:1746143765.023858:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652a800, rc 0) 00000100:00100000:3.0:1746143765.023872:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594218112:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1427us (1642us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143765.023875:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594218240:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1307us (1611us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143765.023878:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13456 00000100:00100000:2.0:1746143765.023881:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13457 00000100:00100000:0.0:1746143765.027858:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.027952:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594218496 00000100:00100000:3.0:1746143765.027959:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594218496 00000100:00100000:3.0:1746143765.028028:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9198 00000100:00100000:3.0:1746143765.028035:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31363:x1830963594218496:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143765.028049:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.028063:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652ac00/0xe984082ccd72ff88 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ab8 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.028165:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd72ff8f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.028177:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd72ff8f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.028186:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd72ff8f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143765.028207:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00010000:00010000:3.0:1746143765.028305:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652ac00/0xe984082ccd72ff88 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ab8 expref: 11 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.028316:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd72ff8f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ab8 expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.028323:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.028326:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143765.028328:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652bc00, rc 0) 00000100:00100000:3.0:1746143765.028742:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31363:x1830963594218496:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 706us (889us total) trans 8589943525 rc 0/0 00000100:00100000:3.0:1746143765.028748:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9198 00000100:00100000:0.0:1746143765.031500:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.031533:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.031558:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.031581:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.031594:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.031617:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.031764:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594218624 00000100:00100000:2.0:1746143765.031771:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594218624 00000100:00100000:2.0:1746143765.031799:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594218880 00000100:00100000:2.0:1746143765.031800:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594218880 00000100:00100000:2.0:1746143765.031810:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219136 00000100:00100000:2.0:1746143765.031812:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219136 00000100:00100000:2.0:1746143765.031819:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594218752 00000100:00100000:2.0:1746143765.031821:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594218752 00000100:00100000:2.0:1746143765.031827:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219008 00000100:00100000:2.0:1746143765.031829:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219008 00000100:00100000:2.0:1746143765.031836:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219264 00000100:00100000:2.0:1746143765.031837:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219264 00000100:00100000:2.0:1746143765.031850:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13458 00000100:00100000:2.0:1746143765.031856:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594218624:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143765.031886:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.031901:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.031908:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143765.031909:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143765.031912:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.031935:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.031946:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 11 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.031958:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594368768:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.032017:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.032033:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13459 00000100:00100000:2.0:1746143765.032039:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594218880:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143765.032055:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032064:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032069:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143765.032070:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143765.032073:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032087:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 23 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032095:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 23 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.032103:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594368896:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.032119:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.032133:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13460 00000100:00100000:2.0:1746143765.032157:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594219136:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143765.032170:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032180:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032187:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.032207:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032212:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.032213:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.032216:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 6/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032230:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032237:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 11 pid: 8497 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.032244:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594369024:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.032278:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.032285:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.032292:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594369152:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.032309:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 16 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032316:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.032323:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594369280:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.032334:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.032341:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13461 00000100:00100000:2.0:1746143765.032347:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13462 00000100:00100000:3.0:1746143765.032349:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594218752:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:2.0:1746143765.032353:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594219008:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143765.032366:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032376:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032383:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.032384:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.032386:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032401:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032408:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 11 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.032415:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594369408:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.032437:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.032452:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13463 00000100:00100000:3.0:1746143765.032457:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594219264:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143765.032471:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032479:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032485:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.032491:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032496:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.032497:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.032498:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032511:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 11 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032517:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 11 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.032524:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594369536:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.032549:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.032555:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 8 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143765.032562:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594369664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.032582:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.032589:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 23 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.032600:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594369792:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.032610:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143765.032837:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032847:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032854:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.032861:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.032866:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.032868:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.032870:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032883:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.032891:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 16 pid: 4581 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.032899:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594369920:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.032940:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 9 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.032952:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 9 pid: 15784 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.032959:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594370048:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.032979:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.032987:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 11 pid: 8497 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.032993:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594370176:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.033005:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.037006:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.037064:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219392 00000100:00100000:1.0:1746143765.037070:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219392 00000100:00100000:0.0:1746143765.037089:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:1.0:1746143765.037104:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (745472->1048575) req@ffff880090765880 x1830963594219392/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.037112:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765880 with x1830963594219392 ext(745472->1048575) 00010000:00010000:1.0:1746143765.037119:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.037130:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143765.037165:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090765880 00000100:00100000:1.0:1746143765.037179:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219776 00000100:00100000:1.0:1746143765.037181:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219776 00002000:00100000:1.0:1746143765.037202:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1208319) req@ffff880090766680 x1830963594219776/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.037208:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766680 with x1830963594219776 ext(1048576->1208319) 00010000:00010000:1.0:1746143765.037213:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.037219:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143765.037224:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090766680 00000100:00100000:1.0:1746143765.037234:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1796 00000100:00100000:1.0:1746143765.037240:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594219392:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143765.037249:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594369536:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.037258:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594369664:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.037266:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594369792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.037292:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.037314:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594369408:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.037322:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.037340:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594368896:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.037349:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.037387:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594369024:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.037395:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594369152:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.037402:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594369280:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.037419:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.037435:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594368768:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.037443:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.037463:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594369920:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.037470:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594370048:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.037476:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594370176:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.037490:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.037505:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1797 00000100:00100000:2.0:1746143765.037511:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594219776:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143765.044561:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.044598:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.044626:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.044645:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.044650:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220160 00000100:00100000:2.0:1746143765.044658:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.044658:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220160 00000100:00100000:2.0:1746143765.044669:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.044684:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220416 00000100:00100000:2.0:1746143765.044686:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220416 00010000:00010000:1.0:1746143765.044688:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 14 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.044698:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 10 pid: 15784 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.044707:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220288 00000100:00100000:1.0:1746143765.044708:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219904 00000100:00100000:2.0:1746143765.044709:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220288 00000100:00100000:1.0:1746143765.044709:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219904 00010000:00010000:2.0:1746143765.044716:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 17 pid: 4581 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.044716:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 14 pid: 8497 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.044728:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220544 00000100:00100000:2.0:1746143765.044729:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220544 00000100:00100000:1.0:1746143765.044730:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7213 00010000:00010000:2.0:1746143765.044736:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 18 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.044736:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594220160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143765.044744:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7214 00000100:00100000:2.0:1746143765.044747:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594220416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.044747:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.044753:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.044764:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 10 pid: 15784 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.044764:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 14 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.044772:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 14 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.044773:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 10 pid: 15784 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.044788:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c905c00/0xe984082ccd72ff3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a80 expref: 10 pid: 15784 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.044788:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075f600/0xe984082ccd72feaf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a25 expref: 14 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.044803:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143765.044803:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.044832:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594220416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.044837:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7214 00000100:00100000:2.0:1746143765.045042:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7215 00000100:00100000:2.0:1746143765.045048:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594220288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.045056:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.045066:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 18 pid: 4581 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.045088:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 18 pid: 4581 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.045099:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009336b600/0xe984082ccd72fed9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a33 expref: 18 pid: 4581 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.045108:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.045536:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594220288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 487us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.045536:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594220160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 798us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.045541:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7215 00000100:00100000:1.0:1746143765.045602:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7213 00000100:00100000:1.0:1746143765.045615:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7216 00000100:00100000:1.0:1746143765.045619:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594219904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143765.045623:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7217 00010000:00010000:1.0:1746143765.045626:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143765.045632:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594220544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.045635:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 14 pid: 8497 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.045640:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.045643:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 14 pid: 8497 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.045879:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219520 00000100:00100000:0.0:1746143765.045884:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219520 00010000:00010000:3.0:1746143765.045892:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.045906:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00002000:00100000:0.0:1746143765.045909:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1097728->1855487) req@ffff88012b7cc000 x1830963594219520/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143765.045917:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc000 with x1830963594219520 ext(1097728->1855487) 00010000:00010000:3.0:1746143765.045918:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0xe984082ccd72fe85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a09 expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.045923:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 24 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.045932:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 24 pid: 9527 timeout: 944 lvb_type: 0 00002000:00010000:0.0:1746143765.045937:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7cc000 00010000:00010000:3.0:1746143765.045939:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.045955:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1798 00000100:00100000:0.0:1746143765.045959:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594219520:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143765.045960:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594220544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 329us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.045966:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7217 00010000:00010000:1.0:1746143765.046012:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fffba00/0xe984082ccd72fe8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a17 expref: 14 pid: 8497 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.046021:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.046036:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594219904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 417us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.046040:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7216 00000100:00100000:2.0:1746143765.047343:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.047375:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.047387:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.047419:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.047649:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594219648 00000100:00100000:1.0:1746143765.047654:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594219648 00010000:00010000:1.0:1746143765.047672:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143765.047686:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220032 00000100:00100000:1.0:1746143765.047687:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220032 00010000:00010000:1.0:1746143765.047696:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143765.047705:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220800 00000100:00100000:1.0:1746143765.047706:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220800 00010000:00010000:1.0:1746143765.047712:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 13 pid: 8497 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.047719:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220672 00000100:00100000:1.0:1746143765.047721:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220672 00010000:00010000:1.0:1746143765.047727:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 26 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.047740:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7218 00000100:00100000:1.0:1746143765.047745:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594219648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.047752:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.047762:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.047769:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.047780:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009075e800/0xe984082ccd72ff42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a87 expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.047789:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.047790:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.047794:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.047800:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.047818:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.047835:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594219648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.047840:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7218 00000100:00100000:1.0:1746143765.047869:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7219 00000100:00100000:1.0:1746143765.047873:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594220032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.047879:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.047888:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.047895:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.047905:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075e200/0xe984082ccd72ff49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a8e expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143765.047908:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7220 00010000:00010000:1.0:1746143765.047913:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.047915:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594220800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.047923:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143765.047924:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594220032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.047929:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7219 00010000:00010000:3.0:1746143765.047933:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 13 pid: 8497 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.047936:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7221 00000100:00100000:1.0:1746143765.047940:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594220672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.047942:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 13 pid: 8497 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.047945:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143765.047952:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090486200/0xe984082ccd72fe69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ed expref: 13 pid: 8497 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.047952:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 26 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.047959:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 26 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.047960:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.047962:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.047964:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.047969:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f09600/0xe984082ccd72fe93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a10 expref: 26 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.047970:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.047980:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.047982:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.047984:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143765.047984:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.047989:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.048000:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594220800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (611us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143765.048001:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.048006:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7220 00000100:00100000:1.0:1746143765.048014:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594220672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 73us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.048019:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7221 00010000:00010000:3.0:1746143765.048023:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048030:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048035:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048041:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048047:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048052:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048052:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048056:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048058:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048061:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048064:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652a800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143765.048067:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048069:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7bce00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143765.048071:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048076:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048076:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048084:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048085:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.048089:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a800/0xe984082ccd72ffb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.048090:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7bce00/0xe984082ccd72ffab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.048119:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594219264:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 15663us (16502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.048124:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594219136:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 15986us (16565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.048125:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13463 00000100:00100000:1.0:1746143765.048130:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13460 00010000:00010000:2.0:1746143765.048224:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048230:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048243:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048249:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048259:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048264:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c25aa00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143765.048266:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048271:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048279:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.048284:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c25aa00/0xe984082ccd72ffc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.048310:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594219008:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 15957us (16714us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.048316:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13462 00000100:00100000:2.0:1746143765.049888:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594219776:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 12373us (12794us total) trans 17179873107 rc 0/0 00000100:00100000:2.0:1746143765.049896:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1797 00002000:00100000:2.0:1746143765.049904:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1208319) req@ffff880090766680 x1830963594219776/t17179873107(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.049912:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766680 with x1830963594219776 ext(1048576->1208319) 00010000:00010000:2.0:1746143765.049920:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.049929:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:2.0:1746143765.049934:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090766680 00000100:00100000:1.0:1746143765.054020:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594219392:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 16772us (17019us total) trans 21474840427 rc 0/0 00000100:00100000:1.0:1746143765.054029:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1796 00002000:00100000:1.0:1746143765.054038:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (745472->1048575) req@ffff880090765880 x1830963594219392/t21474840427(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.054047:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765880 with x1830963594219392 ext(745472->1048575) 00010000:00010000:1.0:1746143765.054055:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.054070:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143765.054075:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090765880 00000100:00100000:3.0:1746143765.055217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.055346:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594220928 00000100:00100000:1.0:1746143765.055352:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594220928 00010000:00010000:1.0:1746143765.055374:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.055397:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7222 00000100:00100000:1.0:1746143765.055401:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1962:x1830963594220928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.055410:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.055430:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.055437:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.055454:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075fa00/0xe984082ccd72fefc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1208319) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a5d expref: 13 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.055463:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.055465:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.055468:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.055480:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.055503:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.055522:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594220928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.055527:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7222 00010000:00010000:3.0:1746143765.055707:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.055715:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.055732:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.055981:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.055987:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.056235:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652aa00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143765.056239:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.056246:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.056256:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.056260:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652aa00/0xe984082ccd72ffb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.056300:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594218752:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 23952us (24716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.056306:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13461 00000100:00100000:0.0:1746143765.057310:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.058873:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594221056 00000100:00100000:0.0:1746143765.058880:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594221056 00010000:00010000:0.0:1746143765.058903:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.058924:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7223 00000100:00100000:0.0:1746143765.058929:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594221056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.058938:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.058951:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.058960:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.058979:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009075ee00/0xe984082ccd72fee0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 745472->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a3a expref: 12 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.058993:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.058995:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.058998:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.059005:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.059032:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.059058:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594221056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 129us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.059063:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7223 00010000:00010000:3.0:1746143765.059118:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059125:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059149:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059155:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059161:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059166:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009075e600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143765.059169:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059174:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059182:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.059186:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009075e600/0xe984082ccd72ff9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.059222:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963594218624:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 27367us (27728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.059228:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13458 00000100:00100000:1.0:1746143765.060225:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594219520:12345-192.168.202.48@tcp:4:cat.0 Request processed in 14263us (15577us total) trans 17179873108 rc 0/0 00000100:00100000:1.0:1746143765.060232:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1798 00002000:00100000:1.0:1746143765.060239:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1097728->1855487) req@ffff88012b7cc000 x1830963594219520/t17179873108(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.060247:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cc000 with x1830963594219520 ext(1097728->1855487) 00010000:00010000:1.0:1746143765.060253:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 25 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.060264:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 25 pid: 9527 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143765.060269:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7cc000 00000100:00100000:0.0:1746143765.064065:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.064551:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594221184 00000100:00100000:2.0:1746143765.064558:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594221184 00010000:00010000:2.0:1746143765.064588:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 25 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.064620:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7224 00000100:00100000:2.0:1746143765.064626:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594221184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.064636:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.064653:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 25 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.064664:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 25 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.064680:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c25ac00/0xe984082ccd72fee7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1097728->1855487) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a41 expref: 25 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.064704:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.064706:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.064710:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.064722:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.064848:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143765.064922:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064930:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064947:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064953:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064959:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064964:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009075e400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143765.064967:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064974:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064983:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.064988:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075e400/0xe984082ccd72ffa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.065077:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594221184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 450us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.065083:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7224 00000100:00100000:3.0:1746143765.065232:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963594218880:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 33192us (33697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.065239:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13459 00000100:00100000:0.0:1746143765.067082:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.067665:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594221440 00000100:00100000:3.0:1746143765.067671:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594221440 00000100:00100000:3.0:1746143765.068175:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9199 00000100:00100000:3.0:1746143765.068182:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31363:x1830963594221440:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1746143765.068234:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143765.068255:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7bd200/0xe984082ccd72ff6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a9c expref: 10 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068270:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.068274:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143765.068297:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.068308:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 249 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068314:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 249 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068321:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068326:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068333:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068339:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068345:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.068373:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068384:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 15 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.068396:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370304:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.068484:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068491:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.068497:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370432:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.068520:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068527:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.068534:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370560:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.068554:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068561:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.068572:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370688:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.068593:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 249 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068600:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 249 pid: 16090 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.068606:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370816:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.068627:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 249 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.068633:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 249 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.068639:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370944:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.068655:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.071463:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.071484:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.071505:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.071516:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.071531:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594221824 00000100:00100000:0.0:1746143765.071536:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594221824 00010000:00010000:0.0:1746143765.071560:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 16 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.071576:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594221568 00000100:00100000:0.0:1746143765.071578:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594221568 00010000:00010000:0.0:1746143765.071585:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 17 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.071595:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7225 00000100:00100000:0.0:1746143765.071599:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963594221824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.071609:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.071613:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 17 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.071622:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 17 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.071636:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143765.071641:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00000100:00100000:2.0:1746143765.071653:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594222080 00010000:00010000:0.0:1746143765.071653:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.071656:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594222080 00000100:00100000:2.0:1746143765.071674:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594222336 00000100:00100000:2.0:1746143765.071676:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594222336 00000100:00100000:0.0:1746143765.071679:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594221824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.071685:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7225 00000100:00100000:2.0:1746143765.071687:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3950 00000100:00100000:2.0:1746143765.071691:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31207:x1830963594222080:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143765.071717:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7226 00000100:00100000:0.0:1746143765.071721:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594221568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.071726:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.071729:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 17 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.071735:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 17 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.071749:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143765.071752:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.071756:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.071768:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594221568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.071772:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7226 00000100:00100000:0.0:1746143765.071793:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.071803:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594221696 00000100:00100000:0.0:1746143765.071805:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594221696 00010000:00010000:0.0:1746143765.071812:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 251 pid: 16090 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.071825:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7227 00000100:00100000:2.0:1746143765.071826:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31207:x1830963594222080:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 134us (341us total) trans 8589943526 rc 0/0 00000100:00100000:0.0:1746143765.071829:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1964:x1830963594221696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143765.071831:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3950 00010000:00010000:0.0:1746143765.071834:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.071836:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 251 pid: 16090 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.071839:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3951 00000100:00100000:2.0:1746143765.071843:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:27138:x1830963594222336:12345-192.168.202.48@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746143765.071843:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 251 pid: 16090 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.071852:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143765.071855:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.071859:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.071871:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1964:x1830963594221696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.071876:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7227 00000100:00100000:2.0:1746143765.071894:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:27138:x1830963594222336:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 50us (387us total) trans 8589943527 rc 0/0 00000100:00100000:2.0:1746143765.071899:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3951 00000100:00100000:0.0:1746143765.072125:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.072243:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594222464 00000100:00100000:1.0:1746143765.072246:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594222464 00010000:00010000:1.0:1746143765.072261:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 251 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.072279:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7228 00000100:00100000:1.0:1746143765.072285:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1963:x1830963594222464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.072291:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.072294:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 251 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.072301:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 251 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.072311:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143765.072314:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143765.072319:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.072335:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1963:x1830963594222464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.072340:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7228 00010000:00010000:3.0:1746143765.072651:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bc9800/0xe984082ccd72fecb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7a2c expref: 16 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.072663:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370304:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.072671:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370432:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.072677:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370560:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.072684:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c34800/0xe984082ccd72fd82 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a795a expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.072697:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370688:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.072704:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd72fd7b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7953 expref: 250 pid: 16090 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.072712:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370816:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.072720:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd72fd74 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a794c expref: 249 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.072737:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594370944:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.072757:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143765.075257:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.075295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.075358:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594222592 00000100:00100000:2.0:1746143765.075363:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594222720 00000100:00100000:3.0:1746143765.075364:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594222592 00000100:00100000:2.0:1746143765.075367:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594222720 00010000:00010000:3.0:1746143765.075383:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.075383:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.075410:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7229 00000100:00100000:3.0:1746143765.075416:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594222592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.075426:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143765.075430:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.075440:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.075460:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7bdc00/0xe984082ccd72fe54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79df expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.075482:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.075486:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.075492:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.075533:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594222592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 117us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.075550:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7229 00000100:00100000:3.0:1746143765.075563:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7230 00000100:00100000:3.0:1746143765.075568:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1963:x1830963594222720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.075574:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143765.075578:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.075586:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.075597:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cde7800/0xe984082ccd72fe31 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a79ca expref: 249 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.075607:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.075610:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.075620:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.075626:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.075643:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.075658:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1963:x1830963594222720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.075663:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7230 00010000:00010000:3.0:1746143765.075983:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143765.075990:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000040:00080000:3.0:1746143765.076632:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2677, 88 off226112 00000004:00080000:3.0:1746143765.076639:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086499258ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076679:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2694, 88 off227784 00000004:00080000:3.0:1746143765.076684:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086543948ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143765.076704:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2695, 88 off227872 00000004:00080000:3.0:1746143765.076708:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086568214ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143765.076715:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2678, 88 off226200 00000004:00080000:3.0:1746143765.076717:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086577157ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076722:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2679, 88 off226288 00000004:00080000:3.0:1746143765.076724:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086584620ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076730:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2696, 88 off227960 00000004:00080000:3.0:1746143765.076732:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086592824ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143765.076739:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2697, 88 off228048 00000004:00080000:3.0:1746143765.076742:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086602153ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143765.076748:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2698, 88 off228136 00000004:00080000:3.0:1746143765.076751:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086611438ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143765.076757:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2680, 88 off226376 00000004:00080000:3.0:1746143765.076759:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086619712ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076765:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2699, 88 off228224 00000004:00080000:3.0:1746143765.076767:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086627943ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143765.076773:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2681, 88 off226464 00000004:00080000:3.0:1746143765.076776:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086636290ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076782:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2700, 88 off228312 00000004:00080000:3.0:1746143765.076784:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086644148ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143765.076790:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2682, 88 off226552 00000004:00080000:3.0:1746143765.076792:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086652254ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076798:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2683, 88 off226640 00000004:00080000:3.0:1746143765.076799:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086659859ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076805:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2684, 88 off226728 00000004:00080000:3.0:1746143765.076807:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086667352ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076812:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2685, 88 off226816 00000004:00080000:3.0:1746143765.076815:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844086675437ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143765.076822:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2701, 88 off228400 00000004:00080000:3.0:1746143765.076824:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844086684464ns, next at 833304778357ns, rc = 0 00000004:00010000:2.0:1746143765.104903:0:20509:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880090767800 reply state ffff8800a578b000 transno 8589943528 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:2.0:1746143765.104915:0:20509:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143765.105008:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31363:x1830963594221440:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 36822us (37926us total) trans 8589943528 rc 0/0 00000100:00100000:2.0:1746143765.105016:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9199 00000001:00080000:0.0:1746143765.105067:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943512 is committed 00000001:00080000:0.0:1746143765.105077:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943527 is committed 00000001:00080000:0.0:1746143765.105081:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943526 is committed 00000001:00080000:0.0:1746143765.105101:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943528 is committed 00000004:00080000:0.0:1746143765.105105:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2037 committed 00000004:00080000:0.0:1746143765.105110:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2021 committed 00000004:00080000:0.0:1746143765.105115:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2020 committed 00000004:00080000:0.0:1746143765.105116:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2019 committed 00000004:00080000:0.0:1746143765.105118:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2018 committed 00000004:00080000:0.0:1746143765.105120:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2036 committed 00000004:00080000:0.0:1746143765.105121:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2017 committed 00000004:00080000:0.0:1746143765.105123:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2035 committed 00000004:00080000:0.0:1746143765.105124:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2016 committed 00000004:00080000:0.0:1746143765.105126:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2034 committed 00000004:00080000:0.0:1746143765.105127:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2033 committed 00000004:00080000:0.0:1746143765.105129:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2032 committed 00000004:00080000:0.0:1746143765.105130:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2015 committed 00000004:00080000:0.0:1746143765.105132:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2014 committed 00000004:00080000:0.0:1746143765.105133:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2031 committed 00000004:00080000:0.0:1746143765.105135:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2030 committed 00000004:00080000:0.0:1746143765.105136:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2013 committed 00000100:00100000:1.0:1746143765.106703:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.106742:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106764:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.106774:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106782:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.106793:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106801:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.106810:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106820:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143765.106824:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.106836:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106843:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.106852:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106858:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.106867:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106874:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.106882:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.106897:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371328 00000100:00100000:1.0:1746143765.106901:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371328 00000100:00100000:1.0:1746143765.106925:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371840 00000100:00100000:1.0:1746143765.106926:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371840 00000100:00100000:1.0:1746143765.106933:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372352 00000100:00100000:1.0:1746143765.106934:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372352 00000100:00100000:1.0:1746143765.106943:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372864 00000100:00100000:1.0:1746143765.106944:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372864 00000100:00100000:1.0:1746143765.106951:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371456 00000100:00100000:1.0:1746143765.106953:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371456 00000100:00100000:1.0:1746143765.106959:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371968 00000100:00100000:1.0:1746143765.106960:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371968 00000100:00100000:1.0:1746143765.106965:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372480 00000100:00100000:1.0:1746143765.106966:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372480 00000100:00100000:1.0:1746143765.106971:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372992 00000100:00100000:1.0:1746143765.106973:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372992 00000100:00100000:1.0:1746143765.106980:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13464 00000100:00100000:1.0:1746143765.106985:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594371328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.107167:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594371328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (424us total) trans 21474840428 rc 0/0 00000100:00100000:1.0:1746143765.107172:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13464 00000100:00100000:1.0:1746143765.107183:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13465 00000100:00100000:1.0:1746143765.107197:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594371840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.107267:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594371840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (492us total) trans 21474840429 rc 0/0 00000100:00100000:1.0:1746143765.107272:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13465 00000100:00100000:1.0:1746143765.107280:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13466 00000100:00100000:1.0:1746143765.107284:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963594372352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.107388:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594372352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (593us total) trans 17179873109 rc 0/0 00000100:00100000:1.0:1746143765.107393:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13466 00000100:00100000:1.0:1746143765.107401:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13467 00000100:00100000:1.0:1746143765.107404:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963594372864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.107473:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594372864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (661us total) trans 17179873110 rc 0/0 00000100:00100000:1.0:1746143765.107477:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13467 00000100:00100000:1.0:1746143765.107486:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13468 00000100:00100000:1.0:1746143765.107489:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594371456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.107555:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594371456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (717us total) trans 21474840430 rc 0/0 00000100:00100000:1.0:1746143765.107559:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13468 00000100:00100000:1.0:1746143765.107567:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13469 00000100:00100000:1.0:1746143765.107571:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594371968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.107637:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594371968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (783us total) trans 21474840431 rc 0/0 00000100:00100000:1.0:1746143765.107642:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13469 00000100:00100000:1.0:1746143765.107651:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13470 00000100:00100000:1.0:1746143765.107655:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963594372480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143765.107714:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143765.107716:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143765.107718:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143765.107720:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143765.107721:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143765.107738:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594372480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (870us total) trans 17179873111 rc 0/0 00000100:00100000:1.0:1746143765.107742:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13470 00000100:00100000:1.0:1746143765.107750:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13471 00000100:00100000:1.0:1746143765.107754:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963594372992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143765.107822:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594372992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (938us total) trans 17179873112 rc 0/0 00000100:00100000:1.0:1746143765.107826:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13471 00000100:00080000:1.0:1746143765.107849:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143765.107852:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746143765.107874:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a04cce00/2, rc 0, transno 21474840430 00000100:00100000:1.0:1746143765.107882:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.107889:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a0a80/2, rc 0, transno 21474840431 00000100:00100000:1.0:1746143765.107891:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371968:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.107898:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814e00/2, rc 0, transno 17179873111 00000100:00100000:1.0:1746143765.107900:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143765.107905:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0815180/2, rc 0, transno 17179873112 00000100:00100000:1.0:1746143765.107908:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143765.107914:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a04cf480/2, rc 0, transno 21474840428 00000100:00100000:1.0:1746143765.107916:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.107921:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0879180/2, rc 0, transno 21474840429 00000100:00100000:1.0:1746143765.107923:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594371840:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.107927:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814380/2, rc 0, transno 17179873109 00000100:00100000:1.0:1746143765.107929:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143765.107935:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0815f80/2, rc 0, transno 17179873110 00000100:00100000:1.0:1746143765.107937:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594372864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108011:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108034:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108055:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108068:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108077:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108090:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108099:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108110:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108120:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [2->3] 00000100:00100000:3.0:1746143765.108125:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108136:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108165:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108177:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108183:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108204:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108211:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108221:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108225:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108235:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.108251:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371200 00000100:00100000:3.0:1746143765.108254:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371200 00000100:00100000:3.0:1746143765.108266:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371712 00000100:00100000:3.0:1746143765.108267:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371712 00000100:00100000:3.0:1746143765.108272:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372224 00000100:00100000:3.0:1746143765.108273:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372224 00000100:00100000:3.0:1746143765.108278:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372736 00000100:00100000:3.0:1746143765.108279:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372736 00000100:00100000:3.0:1746143765.108284:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371072 00000100:00100000:3.0:1746143765.108285:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371072 00000100:00100000:3.0:1746143765.108299:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371584 00000100:00100000:3.0:1746143765.108301:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371584 00000100:00100000:3.0:1746143765.108306:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372096 00000100:00100000:3.0:1746143765.108307:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372096 00000100:00100000:3.0:1746143765.108312:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372608 00000100:00100000:3.0:1746143765.108314:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372608 00000100:00100000:3.0:1746143765.108318:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373120 00000100:00100000:3.0:1746143765.108319:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373120 00000100:00100000:3.0:1746143765.108325:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13472 00000100:00100000:3.0:1746143765.108328:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594371200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108408:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594371200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (373us total) trans 21474840432 rc 0/0 00000100:00100000:3.0:1746143765.108413:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13472 00000100:00100000:3.0:1746143765.108422:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13473 00000100:00100000:3.0:1746143765.108425:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594371712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108478:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594371712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (409us total) trans 21474840433 rc 0/0 00000100:00100000:3.0:1746143765.108482:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13473 00000100:00100000:3.0:1746143765.108488:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13474 00000100:00100000:3.0:1746143765.108491:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594372224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108550:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594372224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (459us total) trans 17179873113 rc 0/0 00000100:00100000:3.0:1746143765.108554:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13474 00000100:00100000:3.0:1746143765.108560:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13475 00000100:00100000:3.0:1746143765.108564:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594372736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108617:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594372736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (505us total) trans 17179873114 rc 0/0 00000100:00100000:3.0:1746143765.108621:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13475 00000100:00100000:3.0:1746143765.108627:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13476 00000100:00100000:3.0:1746143765.108630:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594371072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108689:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594371072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (551us total) trans 21474840434 rc 0/0 00000100:00100000:3.0:1746143765.108694:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13476 00000100:00100000:3.0:1746143765.108702:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13477 00000100:00100000:3.0:1746143765.108705:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594371584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.108765:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594371584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (586us total) trans 21474840435 rc 0/0 00000100:00100000:3.0:1746143765.108769:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13477 00000100:00100000:3.0:1746143765.108777:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13478 00000100:00100000:3.0:1746143765.108781:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594372096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.108844:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594372096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (639us total) trans 17179873115 rc 0/0 00000100:00100000:3.0:1746143765.109273:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13478 00000100:00100000:3.0:1746143765.109285:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13479 00000100:00100000:3.0:1746143765.109289:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594372608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.109363:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594372608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (1140us total) trans 17179873116 rc 0/0 00000100:00100000:3.0:1746143765.109368:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13479 00000100:00100000:3.0:1746143765.109376:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13480 00000100:00100000:3.0:1746143765.109379:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3295:x1830963594373120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.109444:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3295:x1830963594373120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (1207us total) trans 21474840436 rc 0/0 00000100:00100000:3.0:1746143765.109448:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13480 00000004:00080000:3.0:1746143765.109484:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a04cea00/2, rc 0, transno 21474840434 00000100:00100000:3.0:1746143765.109489:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143765.109495:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a04ced80/2, rc 0, transno 21474840435 00000100:00100000:3.0:1746143765.109498:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371584:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143765.109505:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0815c00/2, rc 0, transno 17179873115 00000100:00100000:3.0:1746143765.109507:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.109512:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814700/2, rc 0, transno 17179873116 00000100:00100000:3.0:1746143765.109514:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.109520:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f01500/2, rc 0, transno 21474840436 00000100:00100000:3.0:1746143765.109522:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373120:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143765.109527:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a04cdc00/2, rc 0, transno 21474840432 00000100:00100000:3.0:1746143765.109529:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371200:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143765.109534:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a04cd500/2, rc 0, transno 21474840433 00000100:00100000:3.0:1746143765.109536:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594371712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143765.109541:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814000/2, rc 0, transno 17179873113 00000100:00100000:3.0:1746143765.109543:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372224:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.109547:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0817480/2, rc 0, transno 17179873114 00000100:00100000:3.0:1746143765.109550:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594372736:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143765.109620:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.109628:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.109634:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.109639:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7f7e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.109642:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.109648:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.109660:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143765.109663:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143765.109666:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.109670:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7e00/0xe984082ccd72ffc7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143765.112088:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.112127:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594222848 00000100:00100000:2.0:1746143765.112134:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594222848 00000100:00100000:2.0:1746143765.112184:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9200 00000100:00100000:2.0:1746143765.112201:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31363:x1830963594222848:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143765.112216:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.112230:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7abf expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.112275:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.112285:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.112298:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143765.112301:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143765.112303:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486200, rc 0) 00000100:00100000:2.0:1746143765.112334:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31363:x1830963594222848:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 144us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.112339:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9200 00000100:00100000:0.0:1746143765.116700:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.116788:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594222976 00000100:00100000:1.0:1746143765.116795:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594222976 00000100:00100000:1.0:1746143765.116839:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9201 00000100:00100000:1.0:1746143765.116846:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31363:x1830963594222976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.116860:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.116875:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89de00/0xe984082ccd72ffd5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ac6 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.116945:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c000/0xe984082ccd72ffdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.116956:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c000/0xe984082ccd72ffdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.116966:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c000/0xe984082ccd72ffdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143765.116988:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 16777217 00000004:00200000:1.0:1746143765.116992:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143765.117005:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c000/0xe984082ccd72ffdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.117025:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89de00/0xe984082ccd72ffd5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ac6 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.117037:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c000/0xe984082ccd72ffdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ac6 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.117043:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143765.117046:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143765.117048:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f89c000, rc 0) 00000100:00100000:1.0:1746143765.117085:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31363:x1830963594222976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 239us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.117091:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9201 00000100:00100000:0.0:1746143765.120073:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.120102:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.120119:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.120129:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.120161:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.120395:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594223104 00000100:00100000:1.0:1746143765.120402:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594223104 00000100:00100000:1.0:1746143765.120432:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594223360 00000100:00100000:1.0:1746143765.120434:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594223360 00000100:00100000:1.0:1746143765.120459:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594223616 00000100:00100000:1.0:1746143765.120461:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594223616 00000100:00100000:1.0:1746143765.120471:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594223232 00000100:00100000:1.0:1746143765.120473:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594223232 00000100:00100000:1.0:1746143765.120481:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594223488 00000100:00100000:1.0:1746143765.120483:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594223488 00000100:00100000:1.0:1746143765.120493:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13481 00000100:00100000:1.0:1746143765.120499:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594223104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.120511:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.120527:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7acd expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143765.120550:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a14, atime: 0x68140a0e, ctime: 0x68140a14, blocks: 0x811 00010000:00010000:1.0:1746143765.120565:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.120566:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.120573:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.120585:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.120594:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff24200, rc 0) 00000100:00100000:1.0:1746143765.120626:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594223104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 127us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.120631:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13481 00000100:00100000:3.0:1746143765.120637:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13482 00000100:00100000:1.0:1746143765.120642:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13483 00000100:00100000:3.0:1746143765.120644:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1965:x1830963594223360:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:1.0:1746143765.120646:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594223616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.120650:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.120651:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.120657:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ae9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.120660:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7adb expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143765.120666:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a14, atime: 0x68140a12, ctime: 0x68140a14, blocks: 0x14ad 00010000:00010000:1.0:1746143765.120673:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.120674:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143765.120676:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a14, atime: 0x68140a14, ctime: 0x68140a14, blocks: 0x821 00010000:00010000:1.0:1746143765.120677:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.120683:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.120684:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.120685:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.120687:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 7 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.120691:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff25a00, rc 0) 00010000:00010000:3.0:1746143765.120695:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 7 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.120701:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f6400, rc 0) 00000100:00100000:1.0:1746143765.120704:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594223616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 58us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.120708:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13483 00000100:00100000:3.0:1746143765.120713:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594223360:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 70us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.120716:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13484 00000100:00100000:3.0:1746143765.120719:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13482 00000100:00100000:1.0:1746143765.120720:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594223232:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143765.120724:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143765.120727:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13485 00010000:00010000:1.0:1746143765.120730:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ad4 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.120731:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594223488:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143765.120735:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746143765.120739:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a14, atime: 0x68140a0f, ctime: 0x68140a14, blocks: 0x81f 00010000:00010000:3.0:1746143765.120741:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ae2 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.120744:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.120745:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143765.120748:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a14, atime: 0x68140a14, ctime: 0x68140a14, blocks: 0x821 00010000:00010000:1.0:1746143765.120748:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 7 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.120753:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.120754:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.120756:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 7 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.120757:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.120762:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7bce00, rc 0) 00010000:00010000:3.0:1746143765.120765:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.120771:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7600, rc 0) 00000100:00100000:1.0:1746143765.120772:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594223232:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 52us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.120776:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13484 00000100:00100000:3.0:1746143765.120781:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594223488:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 50us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.120786:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13485 00000100:00100000:0.0:1746143765.120838:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.121009:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594223744 00000100:00100000:2.0:1746143765.121013:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594223744 00000100:00100000:2.0:1746143765.121031:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13486 00000100:00100000:2.0:1746143765.121036:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594223744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143765.121042:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.121050:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7af0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143765.121061:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a14, atime: 0x68140a12, ctime: 0x68140a14, blocks: 0x1029 00010000:00010000:2.0:1746143765.121069:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.121070:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.121074:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.121082:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 8 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.121087:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a29c800, rc 0) 00000100:00100000:2.0:1746143765.121102:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594223744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 66us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.121106:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13486 00000100:00100000:0.0:1746143765.128546:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.128595:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.128696:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594224128 00000100:00100000:1.0:1746143765.128703:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594224128 00000100:00100000:1.0:1746143765.128755:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594224256 00000100:00100000:1.0:1746143765.128758:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594224256 00000100:00100000:1.0:1746143765.128773:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6337 00000100:00100000:1.0:1746143765.128778:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594224128:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143765.128807:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.128820:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.128821:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.128826:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.128837:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.129167:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6338 00000100:00100000:3.0:1746143765.129175:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594224256:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143765.129204:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.129211:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.129213:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.129216:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.129224:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.133121:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.133168:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.133186:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594224640 00000100:00100000:2.0:1746143765.133203:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594224640 00000100:00100000:2.0:1746143765.133237:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594224768 00000100:00100000:2.0:1746143765.133239:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594224768 00000100:00100000:2.0:1746143765.133258:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6339 00000100:00100000:2.0:1746143765.133263:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594224640:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143765.133287:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.133299:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.133300:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.133304:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.133313:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.134254:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6340 00000100:00100000:2.0:1746143765.134261:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594224768:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143765.134282:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.134291:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.134292:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.134295:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.134303:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.140576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.140626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.140644:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594225024 00000100:00100000:3.0:1746143765.140653:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594225024 00000100:00100000:0.0:1746143765.140694:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594225280 00000100:00100000:3.0:1746143765.140697:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6341 00000100:00100000:0.0:1746143765.140698:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594225280 00000100:00100000:3.0:1746143765.140704:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594225024:12345-192.168.202.48@tcp:3:lfs.0 00000100:00100000:0.0:1746143765.140724:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6342 00000100:00100000:0.0:1746143765.140729:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594225280:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143765.140733:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.140745:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.140745:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.140747:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.140752:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.140752:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.140754:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.140756:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.140763:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.140763:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.143480:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.143498:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.143533:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594225536 00000100:00100000:3.0:1746143765.143538:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594225536 00000100:00100000:3.0:1746143765.143568:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594225792 00000100:00100000:3.0:1746143765.143570:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594225792 00000100:00100000:3.0:1746143765.143892:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6343 00000100:00100000:3.0:1746143765.143899:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594225536:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143765.143923:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.143934:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.143936:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.143940:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.143951:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.145086:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6344 00000100:00100000:0.0:1746143765.145095:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594225792:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143765.145117:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.145126:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.145128:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.145131:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.145153:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.148320:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.148334:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.148351:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.148357:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7f7000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143765.148360:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.148367:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.148383:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.148388:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f7000/0xe984082ccd730014 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.148457:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594224256:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 19279us (19857us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.148465:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6338 00010000:00010000:2.0:1746143765.156058:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.156071:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.156077:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.156082:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f89de00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143765.156085:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.156095:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.156111:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.156115:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f89de00/0xe984082ccd73000d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.156236:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594224128:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 27453us (27693us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.156245:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6337 00010000:00010000:2.0:1746143765.158085:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158096:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158102:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158108:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7eb000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143765.158111:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158117:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158134:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158155:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7eb000/0xe984082ccd73001b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.158220:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594224640:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 24950us (25099us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.158228:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6339 00010000:00010000:2.0:1746143765.158494:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158501:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158507:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158511:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf12c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143765.158514:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158520:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158529:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.158538:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf12c00/0xe984082ccd730022 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.158582:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594224768:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 24322us (25412us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.158588:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6340 00010000:00010000:3.0:1746143765.165558:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.165573:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.165580:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.165591:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7f7c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143765.165594:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.165601:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.165616:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.165622:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7c00/0xe984082ccd730029 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.165701:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594225024:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 24993us (25130us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.165709:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6341 00010000:00010000:2.0:1746143765.170488:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.170503:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.170510:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.170515:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009336a200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143765.170518:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.170525:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.170540:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.170546:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336a200/0xe984082ccd730030 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.171726:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594225280:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 30989us (31093us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.171735:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6342 00010000:00010000:2.0:1746143765.176133:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.176181:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.176197:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.176204:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7f6a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143765.176208:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.176215:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.176229:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.176234:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f6a00/0xe984082ccd730037 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.176304:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594225536:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 32401us (32826us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.176315:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6343 00010000:00010000:1.0:1746143765.176414:0:26145:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.176422:0:26145:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.176428:0:26145:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.176433:0:26145:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009336b200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143765.176435:0:26145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.176441:0:26145:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.176451:0:26145:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.176456:0:26145:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336b200/0xe984082ccd73003e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.176503:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594225792:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 31410us (33003us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.176509:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6344 00000100:00100000:0.0:1746143765.180817:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.181107:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226048 00000100:00100000:2.0:1746143765.181115:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226048 00000100:00100000:2.0:1746143765.181184:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9202 00000100:00100000:2.0:1746143765.181206:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31363:x1830963594226048:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143765.181248:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.181316:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89c000/0xe984082ccd72ffdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ac6 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.181330:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143765.181333:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143765.181366:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.181376:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.181384:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00010000:2.0:1746143765.181527:0:20509:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880130fd5500 reply state ffff88012ec1c000 transno 8589943529 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:2.0:1746143765.181532:0:20509:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143765.181669:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31363:x1830963594226048:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 463us (1009us total) trans 8589943529 rc 0/0 00000100:00100000:2.0:1746143765.181674:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9202 00010000:00010000:0.0:1746143765.182788:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.182797:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.182802:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.182807:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5793800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143765.182810:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.182816:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.182825:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:0.0:1746143765.182827:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143765.182830:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143765.182834:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5793800/0xe984082ccd730045 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143765.183823:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.183857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.183889:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.183918:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.183949:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226304 00000100:00100000:0.0:1746143765.183954:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226304 00000100:00100000:0.0:1746143765.183980:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226432 00000100:00100000:0.0:1746143765.183982:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226432 00000100:00100000:0.0:1746143765.183993:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226688 00000100:00100000:0.0:1746143765.183994:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226688 00000100:00100000:0.0:1746143765.184005:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226560 00000100:00100000:0.0:1746143765.184007:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226560 00000100:00100000:0.0:1746143765.184018:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13487 00000100:00100000:0.0:1746143765.184024:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594226304:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:2.0:1746143765.184055:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13488 00000100:00100000:2.0:1746143765.184062:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594226432:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143765.184210:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143765.184213:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184215:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184217:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184218:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143765.184248:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594226432:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 187us (390us total) trans 17179873117 rc 0/0 00000100:00100000:2.0:1746143765.184254:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13488 00000100:00100000:2.0:1746143765.184267:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13489 00000100:00100000:2.0:1746143765.184272:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594226688:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143765.184354:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:2.0:1746143765.184356:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184358:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143762 -> 1746143764 00002000:00010000:2.0:1746143765.184360:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184361:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5293 -> 5293 00000100:00100000:2.0:1746143765.184376:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594226688:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 104us (486us total) trans 21474840437 rc 0/0 00000100:00100000:2.0:1746143765.184381:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13489 00000100:00100000:2.0:1746143765.184390:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13490 00000100:00100000:2.0:1746143765.184394:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594226560:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143765.184439:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143765.184441:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184443:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184445:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.184446:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143765.184459:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594226560:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 65us (541us total) trans 21474840438 rc 0/0 00000100:00100000:2.0:1746143765.184464:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13490 00000100:00100000:1.0:1746143765.185228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:0.0:1746143765.185236:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143765.185239:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.185241:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143759 -> 1746143764 00002000:00010000:0.0:1746143765.185243:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.185244:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143765.185262:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.185265:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594226304:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 1241us (1580us total) trans 17179873118 rc 0/0 00000100:00100000:0.0:1746143765.185270:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13487 00000100:00100000:0.0:1746143765.185377:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226816 00000100:00100000:0.0:1746143765.185380:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226816 00000100:00100000:0.0:1746143765.185394:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594226176 00000100:00100000:0.0:1746143765.185395:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594226176 00000100:00100000:0.0:1746143765.185708:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13491 00000100:00100000:0.0:1746143765.185715:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594226816:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:0.0:1746143765.185772:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143765.185774:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.185777:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143762 -> 1746143764 00002000:00010000:0.0:1746143765.185778:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.185780:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143765.185797:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594226816:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 84us (570us total) trans 17179873119 rc 0/0 00000100:00100000:2.0:1746143765.185804:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13492 00000100:00100000:2.0:1746143765.185811:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594226176:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143765.185877:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143765.185880:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.185882:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143758 -> 1746143764 00002000:00010000:2.0:1746143765.185884:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:2.0:1746143765.185885:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:2.0:1746143765.185899:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594226176:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 89us (637us total) trans 21474840439 rc 0/0 00000100:00100000:2.0:1746143765.185905:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13492 00000100:00100000:0.0:1746143765.186837:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13491 00000100:00100000:0.0:1746143765.187335:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.187554:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594227072 00000100:00100000:1.0:1746143765.187559:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594227072 00000100:00100000:1.0:1746143765.187599:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3952 00000100:00100000:1.0:1746143765.187604:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6457850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31363:x1830963594227072:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:1.0:1746143765.187647:0:16141:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2d9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd72ff8f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ab8 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.187685:0:16141:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143765.187694:0:16141:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.187700:0:16141:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143765.187726:0:16141:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.187736:0:16141:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 9 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.187747:0:16141:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16141:1830963594373248:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.187822:0:16141:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.188973:0:16141:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f00a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16141:1830963594373248:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.188986:0:16141:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00000100:00100000:0.0:1746143765.189777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.190305:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594227200 00000100:00100000:1.0:1746143765.190310:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594227200 00010000:00010000:1.0:1746143765.190334:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.190367:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7231 00000100:00100000:1.0:1746143765.190373:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594227200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.190382:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.190386:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.190395:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.190414:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090486200/0xe984082ccd72ffce lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7abf expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.190446:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:1.0:1746143765.190450:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143765.190456:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143765.190461:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16141 initiator: MDT0 00010000:00010000:1.0:1746143765.190488:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.190523:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594227200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 149us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.190529:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7231 00010000:00010000:2.0:1746143765.190856:0:16141:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143765.190862:0:16141:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00000040:00080000:2.0:1746143765.191432:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2686, 88 off226904 00000004:00080000:2.0:1746143765.191438:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201298145ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191730:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2702, 88 off228488 00000004:00080000:2.0:1746143765.191735:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201594786ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.191757:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2703, 88 off228576 00000004:00080000:2.0:1746143765.191760:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201620557ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.191766:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2687, 88 off226992 00000004:00080000:2.0:1746143765.191769:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201629371ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191787:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2688, 88 off227080 00000004:00080000:2.0:1746143765.191789:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201649765ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191795:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2704, 88 off228664 00000004:00080000:2.0:1746143765.191797:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201657577ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.191803:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2705, 88 off228752 00000004:00080000:2.0:1746143765.191805:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201665415ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.191810:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2706, 88 off228840 00000004:00080000:2.0:1746143765.191812:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201672557ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.191817:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2689, 88 off227168 00000004:00080000:2.0:1746143765.191819:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201679762ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191824:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2707, 88 off228928 00000004:00080000:2.0:1746143765.191827:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201687005ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.191832:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2690, 88 off227256 00000004:00080000:2.0:1746143765.191834:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201694115ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191839:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2708, 88 off229016 00000004:00080000:2.0:1746143765.191841:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201701597ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.191847:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2691, 88 off227344 00000004:00080000:2.0:1746143765.191849:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201708991ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191854:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2692, 88 off227432 00000004:00080000:2.0:1746143765.191856:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201716082ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191861:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2693, 88 off227520 00000004:00080000:2.0:1746143765.191863:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201723222ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191868:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2694, 88 off227608 00000004:00080000:2.0:1746143765.191871:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844201730972ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.191876:0:16141:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2709, 88 off229104 00000004:00080000:2.0:1746143765.191878:0:16141:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844201738387ns, next at 833304778357ns, rc = 0 00000001:00080000:1.0:1746143765.212037:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943530 is committed 00000004:00080000:1.0:1746143765.212046:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2045 committed 00000004:00080000:1.0:1746143765.212053:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2030 committed 00000004:00080000:1.0:1746143765.212057:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2029 committed 00000004:00080000:1.0:1746143765.212059:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2028 committed 00000004:00080000:1.0:1746143765.212060:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2027 committed 00000004:00080000:1.0:1746143765.212061:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2044 committed 00000004:00080000:1.0:1746143765.212062:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2026 committed 00000004:00080000:1.0:1746143765.212064:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2043 committed 00000004:00080000:1.0:1746143765.212065:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2025 committed 00000004:00080000:1.0:1746143765.212066:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2042 committed 00000004:00080000:1.0:1746143765.212067:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2041 committed 00000004:00080000:1.0:1746143765.212068:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2040 committed 00000004:00080000:1.0:1746143765.212070:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2024 committed 00000004:00080000:1.0:1746143765.212071:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2023 committed 00000004:00080000:1.0:1746143765.212073:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2039 committed 00000004:00080000:1.0:1746143765.212074:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746143765.212076:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2022 committed 00000004:00010000:3.0:1746143765.212249:0:16141:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a6457850 reply state ffff880136a07c00 transno 8589943530 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16141 initiator: MDT0 00000100:00100000:3.0:1746143765.212258:0:16141:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746143765.212265:0:16141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:3.0:1746143765.212267:0:16141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143765.212274:0:16141:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652bc00/0xe984082ccd72ff8f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ab8 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746143765.212349:0:16141:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143765.212357:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6457850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31363:x1830963594227072:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 24753us (25023us total) trans 8589943530 rc 0/0 00000100:00100000:3.0:1746143765.212365:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3952 00000100:00100000:3.0:1746143765.212416:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212444:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212461:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212470:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212480:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143765.212484:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212493:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212499:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594374272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212508:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212519:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594373632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212530:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212536:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594374144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212544:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212551:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746143765.212554:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594373504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212562:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212570:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594374016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212579:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.212598:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373376 00000100:00100000:3.0:1746143765.212603:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373376 00000100:00100000:0.0:1746143765.212616:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373888 00000100:00100000:0.0:1746143765.212621:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373888 00000100:00100000:3.0:1746143765.212625:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373760 00000100:00100000:3.0:1746143765.212626:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373760 00000100:00100000:0.0:1746143765.212638:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374272 00000100:00100000:0.0:1746143765.212640:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374272 00000100:00100000:3.0:1746143765.212642:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373632 00000100:00100000:3.0:1746143765.212644:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373632 00000100:00100000:0.0:1746143765.212648:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374144 00000100:00100000:0.0:1746143765.212650:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374144 00000100:00100000:3.0:1746143765.212652:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373504 00000100:00100000:3.0:1746143765.212653:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373504 00000100:00100000:0.0:1746143765.212657:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374016 00000100:00100000:0.0:1746143765.212658:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374016 00000100:00100000:3.0:1746143765.212661:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13493 00000100:00100000:3.0:1746143765.212667:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594373376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.212668:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13494 00000100:00100000:0.0:1746143765.212672:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594373888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.212707:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13495 00000100:00100000:0.0:1746143765.212711:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594373760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212757:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13496 00000100:00100000:3.0:1746143765.212762:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3295:x1830963594374272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212801:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13497 00000100:00100000:3.0:1746143765.212806:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3293:x1830963594373632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143765.212812:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143765.212814:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143765.212817:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143765.212818:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143765.212820:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143765.212843:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963594373760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 132us (349us total) trans 17179873120 rc 0/0 00000100:00100000:3.0:1746143765.212848:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13498 00000100:00100000:3.0:1746143765.212852:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3293:x1830963594374144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.212852:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13495 00000100:00100000:0.0:1746143765.212862:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13499 00000100:00100000:0.0:1746143765.212866:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3293:x1830963594373504:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.212894:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cea00/2, rc 0, transno 17179873120 00000100:00100000:3.0:1746143765.212898:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373760:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143765.212927:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143765.212929:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.212931:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.212933:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.212935:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746143765.212951:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143765.212952:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963594373504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (388us total) trans 17179873121 rc 0/0 00002000:00010000:3.0:1746143765.212953:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.212955:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.212957:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00000100:00100000:0.0:1746143765.212957:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13499 00002000:00010000:3.0:1746143765.212959:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143765.212964:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13500 00000100:00100000:0.0:1746143765.212968:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3293:x1830963594374016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.212980:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963594373376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 313us (534us total) trans 17179873122 rc 0/0 00000100:00100000:3.0:1746143765.212984:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13493 00000100:00100000:0.0:1746143765.213029:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963594374016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (449us total) trans 17179873123 rc 0/0 00000100:00100000:0.0:1746143765.213034:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13500 00000100:00100000:3.0:1746143765.213050:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963594374272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (540us total) trans 17179873124 rc 0/0 00000100:00100000:3.0:1746143765.213056:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13496 00002000:00010000:3.0:1746143765.213116:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143765.213118:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.213120:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.213122:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.213124:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746143765.213167:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3293:x1830963594373632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 360us (635us total) trans 17179873125 rc 0/0 00000100:00100000:3.0:1746143765.213172:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13497 00000100:00100000:0.0:1746143765.213184:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3295:x1830963594373888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 511us (711us total) trans 17179873126 rc 0/0 00000100:00100000:0.0:1746143765.213205:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13494 00010000:00010000:2.0:1746143765.213449:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143765.213457:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143765.213463:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143765.213467:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fafb200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.213471:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143765.213477:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143765.213488:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff88012bf78000) 00010000:00010000:2.0:1746143765.213490:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143765.213493:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16141 initiator: MDT0 00010000:00010000:2.0:1746143765.213497:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd73004c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16141 initiator: MDT0 00000100:00100000:1.0:1746143765.213898:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594374784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.213922:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.213946:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594375296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.213958:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.213967:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143765.213970:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594374400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.213980:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.213992:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594374912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.214002:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143765.214013:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374784 00000100:00100000:0.0:1746143765.214017:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374784 00000100:00100000:0.0:1746143765.214033:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375296 00000100:00100000:0.0:1746143765.214034:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375296 00000100:00100000:0.0:1746143765.214042:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374400 00000100:00100000:0.0:1746143765.214043:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374400 00000100:00100000:1.0:1746143765.214047:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594374528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.214049:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374912 00000100:00100000:0.0:1746143765.214051:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374912 00000100:00100000:0.0:1746143765.214059:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13501 00000100:00100000:0.0:1746143765.214063:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963594374784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.214064:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.214072:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594375040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.214083:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.214090:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143765.214094:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594374656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.214107:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.214114:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594375168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.214124:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.214156:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374528 00000100:00100000:1.0:1746143765.214159:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374528 00000100:00100000:1.0:1746143765.214171:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375040 00000100:00100000:1.0:1746143765.214173:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375040 00000100:00100000:0.0:1746143765.214173:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3294:x1830963594374784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (249us total) trans 21474840440 rc 0/0 00000100:00100000:0.0:1746143765.214178:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13501 00000100:00100000:1.0:1746143765.214181:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374656 00000100:00100000:1.0:1746143765.214183:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374656 00000100:00100000:0.0:1746143765.214185:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375168 00000100:00100000:1.0:1746143765.214200:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13502 00000100:00100000:0.0:1746143765.214200:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375168 00000100:00100000:1.0:1746143765.214204:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594375296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.214210:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13503 00000100:00100000:0.0:1746143765.214214:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594374400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143765.214277:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143765.214280:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.214282:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.214283:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.214285:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:1.0:1746143765.214286:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3294:x1830963594375296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (327us total) trans 21474840441 rc 0/0 00000100:00100000:1.0:1746143765.214292:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13502 00000100:00100000:1.0:1746143765.214301:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13504 00000100:00100000:0.0:1746143765.214302:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594374400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (321us total) trans 21474840442 rc 0/0 00000100:00100000:1.0:1746143765.214305:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594374912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.214307:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13503 00000100:00100000:0.0:1746143765.214316:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13505 00000100:00100000:0.0:1746143765.214319:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963594374528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.214374:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594374912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (370us total) trans 21474840443 rc 0/0 00000100:00100000:1.0:1746143765.214378:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13504 00000100:00100000:1.0:1746143765.214386:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13506 00000100:00100000:1.0:1746143765.214389:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963594375040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.214457:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594375040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (372us total) trans 21474840444 rc 0/0 00000100:00100000:1.0:1746143765.214462:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13506 00000100:00100000:1.0:1746143765.214473:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13507 00000100:00100000:1.0:1746143765.214477:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963594374656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143765.214525:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143765.214528:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.214529:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.214531:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.214532:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746143765.214539:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:1.0:1746143765.214542:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.214543:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.214545:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.214546:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5293 -> 5293 00000100:00100000:0.0:1746143765.214550:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3292:x1830963594374528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (485us total) trans 21474840445 rc 0/0 00000100:00100000:0.0:1746143765.214555:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13505 00000100:00100000:1.0:1746143765.214563:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594374656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (455us total) trans 21474840446 rc 0/0 00000100:00100000:0.0:1746143765.214567:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13508 00000100:00100000:1.0:1746143765.214569:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13507 00000100:00100000:0.0:1746143765.214571:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594375168:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.214593:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd5c00/2, rc 0, transno 21474840446 00000100:00100000:1.0:1746143765.214602:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594374656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.214609:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd4700/2, rc 0, transno 21474840445 00000100:00100000:1.0:1746143765.214611:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594374528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.214616:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd7800/2, rc 0, transno 21474840444 00000100:00100000:1.0:1746143765.214619:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594375040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.214634:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594375168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (509us total) trans 21474840447 rc 0/0 00000100:00100000:0.0:1746143765.214639:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13508 00000004:00080000:1.0:1746143765.214648:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd7480/2, rc 0, transno 21474840447 00000100:00100000:1.0:1746143765.214651:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594375168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.214661:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd4a80/2, rc 0, transno 21474840442 00000100:00100000:1.0:1746143765.214663:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594374400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.214784:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3293:x1830963594374144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 395us (701us total) trans 17179873127 rc 0/0 00000100:00100000:3.0:1746143765.214793:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13498 00000004:00080000:3.0:1746143765.214822:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cc380/2, rc 0, transno 17179873121 00000100:00100000:3.0:1746143765.214826:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594373504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.214833:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7ced80/2, rc 0, transno 17179873123 00000100:00100000:3.0:1746143765.214841:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594374016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.214848:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cd500/2, rc 0, transno 17179873125 00000100:00100000:3.0:1746143765.214851:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594373632:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.214856:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7ce680/2, rc 0, transno 17179873127 00000100:00100000:3.0:1746143765.214858:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594374144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.214871:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594375424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.214889:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143765.214905:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cd180/2, rc 0, transno 17179873124 00000100:00100000:3.0:1746143765.214908:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594374272:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.214914:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cd880/2, rc 0, transno 17179873122 00000100:00100000:3.0:1746143765.214917:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.214922:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cdf80/2, rc 0, transno 17179873126 00000100:00100000:3.0:1746143765.214925:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594373888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.214937:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375424 00000100:00100000:3.0:1746143765.214939:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375424 00000100:00100000:3.0:1746143765.214953:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13509 00000100:00100000:3.0:1746143765.214958:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963594375424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143765.215040:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3295:x1830963594375424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (149us total) trans 21474840448 rc 0/0 00000100:00100000:3.0:1746143765.215045:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13509 00000004:00080000:3.0:1746143765.215062:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dc000/2, rc 0, transno 21474840448 00000100:00100000:3.0:1746143765.215065:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594375424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.215221:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd5f80/2, rc 0, transno 21474840443 00000100:00100000:1.0:1746143765.215226:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594374912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.215237:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd6680/2, rc 0, transno 21474840440 00000100:00100000:1.0:1746143765.215239:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594374784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.215244:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd6d80/2, rc 0, transno 21474840441 00000100:00100000:1.0:1746143765.215246:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594375296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.215896:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.215931:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594227328 00000100:00100000:2.0:1746143765.215935:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594227328 00000100:00100000:2.0:1746143765.215969:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9203 00000100:00100000:2.0:1746143765.215974:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31363:x1830963594227328:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143765.215986:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.215998:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7af7 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.216039:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.216050:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.216062:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.216065:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143765.216067:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5db8200, rc 0) 00000100:00100000:2.0:1746143765.216104:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31363:x1830963594227328:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 129us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.216109:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9203 00000100:00100000:2.0:1746143765.219784:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.219845:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594227584 00000100:00100000:3.0:1746143765.219852:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594227584 00000100:00100000:3.0:1746143765.219894:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3953 00000100:00100000:3.0:1746143765.219900:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31363:x1830963594227584:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143765.220118:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31363:x1830963594227584:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 217us (340us total) trans 8589943531 rc 0/0 00000100:00100000:3.0:1746143765.220124:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3953 00000100:00100000:0.0:1746143765.237272:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.237365:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594227840 00000100:00100000:1.0:1746143765.237373:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594227840 00000100:00100000:1.0:1746143765.237424:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9204 00000100:00100000:1.0:1746143765.237431:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31374:x1830963594227840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143765.237452:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.237466:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb800/0xe984082ccd73005a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7afe expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.237567:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237578:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237587:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237597:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237603:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237608:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237693:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237699:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237704:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143765.237711:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143765.237770:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237775:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237784:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237789:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fafb000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143765.237792:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237796:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237804:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143765.237806:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.237808:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.237812:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb000/0xe984082ccd730061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143765.238176:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.238243:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594228096 00000100:00100000:2.0:1746143765.238247:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594228096 00000100:00100000:2.0:1746143765.238270:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9205 00000100:00100000:2.0:1746143765.238281:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:31370:x1830963594228096:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143765.238290:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.238296:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9e00/0xe984082ccd73007d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b05 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.238331:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238338:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238343:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238350:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238355:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238360:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238404:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238411:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238417:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:2.0:1746143765.238423:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143765.238459:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238465:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238469:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238473:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5db8e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.238475:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238479:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238485:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143765.238488:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.238490:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238494:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8e00/0xe984082ccd730084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238504:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238508:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238511:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238515:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5db8c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.238516:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238521:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238525:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c500) 00010000:00010000:2.0:1746143765.238526:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.238528:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238531:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8c00/0xe984082ccd73008b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143765.238553:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9e00/0xe984082ccd73007d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.238565:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.238571:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.238573:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143765.238575:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5db8400, rc 0) 00000100:00100000:2.0:1746143765.238608:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31370:x1830963594228096:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 332us (433us total) trans 8589943533 rc 0/0 00000100:00100000:2.0:1746143765.238613:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9205 00010000:00010000:1.0:1746143765.239504:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.239511:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.239516:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.239520:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fafa600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143765.239522:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.239527:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.239537:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c500) 00010000:00010000:1.0:1746143765.239539:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143765.239540:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.239544:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa600/0xe984082ccd730068 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.239576:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb800/0xe984082ccd73005a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.239584:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 242 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.239588:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.239590:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143765.239591:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafbc00, rc 0) 00000100:00100000:1.0:1746143765.239612:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31374:x1830963594227840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2182us (2348us total) trans 8589943532 rc 0/0 00000100:00100000:1.0:1746143765.239617:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9204 00000100:00100000:0.0:1746143765.243179:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.243422:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594228224 00000100:00100000:2.0:1746143765.243432:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594228224 00000100:00100000:2.0:1746143765.243477:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13510 00000100:00100000:2.0:1746143765.243484:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:31374:x1830963594228224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.243497:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.243510:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b0c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.243530:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.243532:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.243538:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.243551:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 16 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.243560:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5db9400, rc 0) 00000100:00100000:2.0:1746143765.243594:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31374:x1830963594228224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.243600:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13510 00000100:00100000:0.0:1746143765.243748:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.243808:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.243896:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594228608 00000100:00100000:1.0:1746143765.243899:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594228608 00000100:00100000:1.0:1746143765.243919:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594228736 00000100:00100000:1.0:1746143765.243920:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594228736 00000100:00100000:1.0:1746143765.243933:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9206 00000100:00100000:1.0:1746143765.243938:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31375:x1830963594228608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143765.243950:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.243960:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafba00/0xe984082ccd7300a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b13 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244034:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.244043:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.244051:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143765.244061:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143765.244173:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafba00/0xe984082ccd7300a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244203:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244209:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.244212:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143765.244214:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafa800, rc 0) 00000100:00100000:1.0:1746143765.244235:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31375:x1830963594228608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 297us (487us total) trans 8589943534 rc 0/0 00000100:00100000:1.0:1746143765.244240:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9206 00000100:00100000:1.0:1746143765.244253:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9207 00000100:00100000:1.0:1746143765.244258:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31372:x1830963594228736:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.244266:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.244272:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd7300bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b1a expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244314:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.244321:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244327:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244332:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.244401:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244411:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 9 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.244421:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375552:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.244621:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.244628:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 243 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.244635:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375680:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.244654:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012da59c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.245983:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375552:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.246013:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375680:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.246027:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143765.246058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.246172:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594228992 00000100:00100000:2.0:1746143765.246176:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594228992 00000100:00100000:0.0:1746143765.246327:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13511 00000100:00100000:0.0:1746143765.246338:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31375:x1830963594228992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143765.246358:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.246372:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b21 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.246392:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.246393:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.246400:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.246413:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 12 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.246428:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368d6800, rc 0) 00000100:00100000:0.0:1746143765.246490:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31375:x1830963594228992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 152us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.246495:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13511 00000100:00100000:0.0:1746143765.249934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.249968:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.249984:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594228864 00000100:00100000:1.0:1746143765.249992:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594228864 00010000:00010000:1.0:1746143765.250019:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.250045:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.250051:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594229120 00000100:00100000:1.0:1746143765.250053:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594229120 00010000:00010000:1.0:1746143765.250062:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 244 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.250264:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7232 00000100:00100000:1.0:1746143765.250271:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594228864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.250282:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.250287:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.250296:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.250314:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd730092 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b05 expref: 10 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.250326:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.250331:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.250337:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.250342:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.250373:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594228864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 103us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.250384:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7232 00000100:00100000:1.0:1746143765.250751:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7233 00000100:00100000:1.0:1746143765.250760:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1964:x1830963594229120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.250767:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.250771:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 244 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.250779:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 244 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.250789:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafbc00/0xe984082ccd73006f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7afe expref: 244 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.250797:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.250800:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.250806:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.250810:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.250828:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.250843:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1964:x1830963594229120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.250849:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7233 00010000:00010000:1.0:1746143765.250867:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.250873:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143765.250904:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594229248 00000100:00100000:2.0:1746143765.250908:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594229248 00000100:00100000:2.0:1746143765.250938:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9208 00000100:00100000:2.0:1746143765.250943:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31374:x1830963594229248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.250955:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.250963:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9600/0xe984082ccd7300d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b28 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.251005:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9600/0xe984082ccd7300d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b28 expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.251013:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9600/0xe984082ccd7300d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b28 expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.251026:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.251029:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143765.251031:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5db9600, rc 0) 00000100:00100000:2.0:1746143765.251062:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31374:x1830963594229248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 119us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.251066:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9208 00000004:00200000:1.0:1746143765.251103:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143765.251300:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb200/0xe984082ccd7300bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.251313:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.251318:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.251321:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143765.251322:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0000, rc 0) 00000100:00100000:1.0:1746143765.251350:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31372:x1830963594228736:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7091us (7541us total) trans 8589943535 rc 0/0 00000100:00100000:1.0:1746143765.251355:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9207 00000100:00100000:0.0:1746143765.255910:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.256022:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594229504 00000100:00100000:1.0:1746143765.256031:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594229504 00002000:00100000:1.0:1746143765.256074:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a087ad80 x1830963594229504/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.256084:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087ad80 with x1830963594229504 ext(0->1048575) 00002000:00010000:1.0:1746143765.256089:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087ad80 00000100:00100000:1.0:1746143765.256132:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6345 00000100:00100000:1.0:1746143765.256165:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594229504:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143765.263443:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.263510:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594229760 00000100:00100000:3.0:1746143765.263518:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594229760 00002000:00100000:3.0:1746143765.263552:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009cdc1180 x1830963594229760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.263561:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1180 with x1830963594229760 ext(0->1048575) 00002000:00010000:3.0:1746143765.263565:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1180 00000100:00100000:3.0:1746143765.263581:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6346 00000100:00100000:3.0:1746143765.263587:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594229760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143765.277255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.277394:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230016 00000100:00100000:2.0:1746143765.277401:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230016 00000100:00100000:2.0:1746143765.277434:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9209 00000100:00100000:2.0:1746143765.277440:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31372:x1830963594230016:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143765.277456:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.277458:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143765.277480:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9600/0xe984082ccd7300d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b28 expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.277494:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.277498:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143765.277506:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9c00/0xe984082ccd7300df lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b2f expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.277546:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.277555:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.277561:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.277562:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594229504:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21423us (21661us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746143765.277567:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143765.277569:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6345 00002000:00100000:1.0:1746143765.277576:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a087ad80 x1830963594229504/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.277585:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087ad80 with x1830963594229504 ext(0->1048575) 00010000:00010000:2.0:1746143765.277587:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143765.277588:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a087ad80 00010000:00010000:2.0:1746143765.277597:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 8 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.277611:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375808:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.277673:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.277680:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 7 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.277686:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375936:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.277702:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.278288:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594229760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14700us (14852us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.278295:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6346 00002000:00100000:3.0:1746143765.278300:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009cdc1180 x1830963594229760/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.278307:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1180 with x1830963594229760 ext(0->1048575) 00002000:00010000:3.0:1746143765.278310:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1180 00000100:00100000:0.0:1746143765.281835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.281877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.281947:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230144 00000100:00100000:3.0:1746143765.281954:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230144 00010000:00010000:3.0:1746143765.281986:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 8 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.282007:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230272 00000100:00100000:3.0:1746143765.282009:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230272 00010000:00010000:3.0:1746143765.282019:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.282034:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7234 00000100:00100000:3.0:1746143765.282039:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594230144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.282050:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143765.282055:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 8 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.282064:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 8 pid: 20509 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.282082:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.282087:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.282094:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.282099:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.282160:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7235 00000100:00100000:0.0:1746143765.282166:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594230272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.282172:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.282176:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.282183:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.282202:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143765.282205:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143765.282210:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143765.282218:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143765.282230:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143765.282385:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa800/0xe984082ccd7300ae lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b13 expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.282406:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375808:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.282416:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8200/0xe984082ccd730053 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af7 expref: 8 pid: 20509 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.282423:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594375936:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.282438:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.282444:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.282449:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000040:00080000:2.0:1746143765.282996:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2695, 88 off227696 00000004:00080000:2.0:1746143765.283001:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844292861445ns, next at 788202887869ns, rc = 0 00000100:00100000:3.0:1746143765.283157:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1962:x1830963594230144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1115us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.283164:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7234 00000100:00100000:0.0:1746143765.284124:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594230272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1956us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.284131:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7235 00000040:00080000:2.0:1746143765.284392:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2710, 88 off229192 00000004:00080000:2.0:1746143765.284397:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844294257779ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.284409:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2711, 88 off229280 00000004:00080000:2.0:1746143765.284412:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844294272166ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.284420:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2696, 88 off227784 00000004:00080000:2.0:1746143765.284422:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844294282619ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.284429:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2697, 88 off227872 00000004:00080000:2.0:1746143765.284431:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844294291244ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.284463:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2713, 88 off229464 00000004:00080000:2.0:1746143765.284466:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844294326234ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.284771:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2714, 88 off229552 00000004:00080000:2.0:1746143765.284775:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844294635776ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.284877:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2715, 88 off229640 00000004:00080000:2.0:1746143765.284881:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844294741099ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143765.284891:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2698, 88 off227960 00000004:00080000:2.0:1746143765.284894:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844294754876ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.284985:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2716, 88 off229728 00000004:00080000:2.0:1746143765.284988:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844294848664ns, next at 833304778357ns, rc = 0 00000100:00100000:0.0:1746143765.284989:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.285011:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230400 00000100:00100000:2.0:1746143765.285016:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230400 00000100:00100000:0.0:1746143765.285250:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13512 00000100:00100000:0.0:1746143765.285258:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31375:x1830963594230400:12345-192.168.202.48@tcp:101:cat.0 00000040:00080000:2.0:1746143765.285266:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2699, 88 off228048 00000004:00080000:2.0:1746143765.285271:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844295130965ns, next at 788202887869ns, rc = 0 00010000:00010000:0.0:1746143765.285271:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.285283:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b36 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.285300:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.285302:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.285308:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746143765.285318:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2717, 88 off229816 00010000:00010000:0.0:1746143765.285319:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 13 pid: 6929 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746143765.285322:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844295182010ns, next at 833304778357ns, rc = 0 00010000:00010000:0.0:1746143765.285327:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5806c00, rc 0) 00000100:00100000:0.0:1746143765.285358:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31375:x1830963594230400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 101us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.285363:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13512 00000040:00080000:2.0:1746143765.285400:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2700, 88 off228136 00000004:00080000:2.0:1746143765.285403:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844295263866ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.285413:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2701, 88 off228224 00000004:00080000:2.0:1746143765.285630:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844295490217ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.286227:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2702, 88 off228312 00000004:00080000:2.0:1746143765.286232:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844296092132ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.286253:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2703, 88 off228400 00000004:00080000:2.0:1746143765.286256:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 844296116347ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143765.286264:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2718, 88 off229904 00000004:00080000:2.0:1746143765.286266:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 844296126730ns, next at 833304778357ns, rc = 0 00000100:00100000:3.0:1746143765.287484:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.287506:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230528 00000100:00100000:3.0:1746143765.287511:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230528 00000100:00100000:3.0:1746143765.287539:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9210 00000100:00100000:3.0:1746143765.287545:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31375:x1830963594230528:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.287559:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.287571:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b3d expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.287610:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.287618:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.287632:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.287640:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.287654:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.287657:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143765.287659:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.287664:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7f7800, rc 0) 00000100:00100000:3.0:1746143765.287707:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31375:x1830963594230528:12345-192.168.202.48@tcp:101:cat.0 Request processed in 162us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.287712:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9210 00000100:00100000:0.0:1746143765.288777:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.288820:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230656 00000100:00100000:0.0:1746143765.288823:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230656 00000100:00100000:0.0:1746143765.288841:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13513 00000100:00100000:0.0:1746143765.288846:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31374:x1830963594230656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143765.288853:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.288863:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b44 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.288875:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.288877:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.288882:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.288891:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.288897:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08400, rc 0) 00000100:00100000:0.0:1746143765.288916:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31374:x1830963594230656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 70us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.288921:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13513 00000100:00100000:1.0:1746143765.292798:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.293944:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230784 00000100:00100000:3.0:1746143765.293952:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230784 00000100:00100000:3.0:1746143765.293989:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9211 00000100:00100000:3.0:1746143765.293995:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31374:x1830963594230784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.294010:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.294023:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b4b expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.294071:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 247 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.294082:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 247 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.294092:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.294094:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143765.294097:0:2976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.294103:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5db9200, rc 0) 00000100:00100000:3.0:1746143765.294167:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31374:x1830963594230784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 171us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.294173:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9211 00000001:00080000:1.0:1746143765.313489:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943535 is committed 00000001:00080000:1.0:1746143765.313501:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943534 is committed 00000001:00080000:1.0:1746143765.313507:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943536 is committed 00000004:00080000:1.0:1746143765.313511:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2053 committed 00000004:00080000:1.0:1746143765.313517:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2039 committed 00000004:00080000:1.0:1746143765.313523:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2038 committed 00000004:00080000:1.0:1746143765.313525:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2037 committed 00000004:00080000:1.0:1746143765.313526:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2036 committed 00000004:00080000:1.0:1746143765.313528:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2052 committed 00000004:00080000:1.0:1746143765.313529:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2035 committed 00000004:00080000:1.0:1746143765.313530:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2051 committed 00000004:00080000:1.0:1746143765.313532:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2034 committed 00000004:00080000:1.0:1746143765.313533:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2050 committed 00000004:00080000:1.0:1746143765.313534:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2049 committed 00000004:00080000:1.0:1746143765.313536:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2048 committed 00000004:00080000:1.0:1746143765.313537:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2033 committed 00000004:00080000:1.0:1746143765.313539:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2032 committed 00000004:00080000:1.0:1746143765.313541:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2047 committed 00000004:00080000:1.0:1746143765.313542:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2046 committed 00000004:00080000:1.0:1746143765.313543:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2031 committed 00000001:00080000:1.0:1746143765.313555:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943531 is committed 00000100:00100000:1.0:1746143765.313682:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313735:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313772:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313786:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313800:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143765.313804:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313817:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313827:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313839:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313853:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313865:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313875:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313885:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313894:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746143765.313898:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313909:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313918:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.313930:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143765.313948:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376064 00000100:00100000:1.0:1746143765.313954:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376064 00000100:00100000:1.0:1746143765.313981:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376576 00000100:00100000:1.0:1746143765.313983:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376576 00000100:00100000:1.0:1746143765.313992:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376192 00000100:00100000:1.0:1746143765.313993:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376192 00000100:00100000:1.0:1746143765.314002:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376704 00000100:00100000:1.0:1746143765.314004:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376704 00000100:00100000:1.0:1746143765.314012:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376320 00000100:00100000:1.0:1746143765.314013:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376320 00000100:00100000:1.0:1746143765.314018:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376832 00000100:00100000:1.0:1746143765.314019:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376832 00000100:00100000:1.0:1746143765.314028:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13514 00000100:00100000:1.0:1746143765.314033:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3292:x1830963594376064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143765.314205:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143765.314208:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314210:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314212:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314213:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2065 -> 2065 00000100:00100000:1.0:1746143765.314237:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3292:x1830963594376064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (502us total) trans 21474840449 rc 0/0 00000100:00100000:1.0:1746143765.314242:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13514 00000100:00100000:1.0:1746143765.314261:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376448 00000100:00100000:1.0:1746143765.314263:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376448 00000100:00100000:1.0:1746143765.314269:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376960 00000100:00100000:1.0:1746143765.314271:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376960 00000100:00100000:1.0:1746143765.314277:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13515 00000100:00100000:1.0:1746143765.314280:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963594376576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.314345:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594376576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (558us total) trans 21474840450 rc 0/0 00000100:00100000:1.0:1746143765.314350:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13515 00000100:00100000:1.0:1746143765.314357:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13516 00000100:00100000:1.0:1746143765.314361:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963594376192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143765.314411:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143765.314413:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314415:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314416:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314418:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143765.314430:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594376192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (612us total) trans 21474840451 rc 0/0 00000100:00100000:1.0:1746143765.314434:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13516 00000100:00100000:1.0:1746143765.314442:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13517 00000100:00100000:1.0:1746143765.314445:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963594376704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.314498:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594376704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (658us total) trans 21474840452 rc 0/0 00000100:00100000:1.0:1746143765.314502:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13517 00000100:00100000:1.0:1746143765.314509:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13518 00000100:00100000:1.0:1746143765.314513:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963594376320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143765.314560:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:1.0:1746143765.314563:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314564:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314566:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:1.0:1746143765.314567:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5293 -> 5293 00000100:00100000:1.0:1746143765.314582:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963594376320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (717us total) trans 21474840453 rc 0/0 00000100:00100000:1.0:1746143765.314586:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13518 00000100:00100000:1.0:1746143765.314593:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13519 00000100:00100000:1.0:1746143765.314598:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963594376832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.314664:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963594376832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (777us total) trans 21474840454 rc 0/0 00000100:00100000:1.0:1746143765.314669:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13519 00000100:00100000:1.0:1746143765.314678:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13520 00000100:00100000:1.0:1746143765.314682:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963594376448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.314749:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963594376448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (838us total) trans 21474840455 rc 0/0 00000100:00100000:1.0:1746143765.314754:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13520 00000100:00100000:1.0:1746143765.314762:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13521 00000100:00100000:1.0:1746143765.314766:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3294:x1830963594376960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.314849:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3294:x1830963594376960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (917us total) trans 21474840456 rc 0/0 00000100:00100000:1.0:1746143765.314854:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13521 00000004:00080000:1.0:1746143765.314903:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dea00/2, rc 0, transno 21474840455 00000100:00100000:1.0:1746143765.314911:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.314919:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090766300/2, rc 0, transno 21474840456 00000100:00100000:1.0:1746143765.314921:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.314928:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930df800/2, rc 0, transno 21474840453 00000100:00100000:1.0:1746143765.314930:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.314936:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090766a00/2, rc 0, transno 21474840454 00000100:00100000:1.0:1746143765.314938:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594376832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.314966:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594377088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.314987:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143765.315014:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930ded80/2, rc 0, transno 21474840451 00000100:00100000:1.0:1746143765.315017:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376192:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.315022:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090767480/2, rc 0, transno 21474840452 00000100:00100000:1.0:1746143765.315025:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.315030:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dd180/2, rc 0, transno 21474840449 00000100:00100000:1.0:1746143765.315032:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376064:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143765.315037:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930ddc00/2, rc 0, transno 21474840450 00000100:00100000:1.0:1746143765.315039:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594376576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143765.315100:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377088 00000100:00100000:0.0:1746143765.315104:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377088 00000100:00100000:0.0:1746143765.315122:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13522 00010000:00010000:2.0:1746143765.315126:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.315126:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594377088:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143765.315136:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.315152:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143765.315156:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 6 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.315165:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 6 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.315170:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 6 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.315176:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.315182:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.315197:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.315217:0:14762:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.315225:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594377216:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143765.315262:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3292:x1830963594377088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (274us total) trans 21474840457 rc 0/0 00000100:00100000:0.0:1746143765.315268:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13522 00010000:00010000:2.0:1746143765.315282:0:14762:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 6 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.315288:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594377344:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.315303:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.315689:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594377472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315709:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315730:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594377984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315740:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315748:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746143765.315752:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594377856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315761:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315767:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594378368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315777:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315788:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594377728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315798:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315805:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594378240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315814:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315821:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143765.315824:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594377600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315833:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315839:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594378112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.315848:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143765.315861:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377472 00000100:00100000:3.0:1746143765.315864:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377472 00000100:00100000:3.0:1746143765.315875:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377984 00000100:00100000:3.0:1746143765.315876:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377984 00000100:00100000:3.0:1746143765.315881:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377856 00000100:00100000:3.0:1746143765.315882:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377856 00000100:00100000:3.0:1746143765.315887:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378368 00000100:00100000:3.0:1746143765.315888:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378368 00000100:00100000:3.0:1746143765.315892:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377728 00000100:00100000:3.0:1746143765.315893:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377728 00000100:00100000:3.0:1746143765.315897:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378240 00000100:00100000:3.0:1746143765.315898:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378240 00000100:00100000:3.0:1746143765.315903:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377600 00000100:00100000:3.0:1746143765.315904:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377600 00000100:00100000:3.0:1746143765.315907:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378112 00000100:00100000:3.0:1746143765.315908:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378112 00000100:00100000:3.0:1746143765.315914:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13523 00000100:00100000:3.0:1746143765.315917:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963594377472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143765.316015:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143765.316018:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.316020:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.316021:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.316023:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143765.316046:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963594377472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (336us total) trans 17179873128 rc 0/0 00000100:00100000:3.0:1746143765.316051:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13523 00000100:00100000:3.0:1746143765.316062:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13524 00000100:00100000:3.0:1746143765.316066:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963594377984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.316075:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13525 00000100:00100000:0.0:1746143765.316080:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963594377856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.316132:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963594377984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (390us total) trans 17179873129 rc 0/0 00000100:00100000:3.0:1746143765.316153:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13524 00000100:00100000:3.0:1746143765.316161:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13526 00000100:00100000:3.0:1746143765.316164:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963594378368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.316238:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3293:x1830963594378368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (460us total) trans 17179873131 rc 0/0 00000100:00100000:3.0:1746143765.316242:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13526 00000100:00100000:3.0:1746143765.316250:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13527 00000100:00100000:3.0:1746143765.316253:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594377728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143765.316290:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143765.316293:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143765.316295:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143765.316297:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143765.316298:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1746143765.316310:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143765.316312:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.316314:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.316316:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:3.0:1746143765.316317:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746143765.316317:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3293:x1830963594377856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (554us total) trans 17179873130 rc 0/0 00000100:00100000:0.0:1746143765.316322:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13525 00000100:00100000:3.0:1746143765.316337:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594377728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (537us total) trans 17179873132 rc 0/0 00000100:00100000:3.0:1746143765.316341:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13527 00000100:00100000:3.0:1746143765.316351:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13528 00000100:00100000:3.0:1746143765.316354:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830963594378240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143765.316405:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13529 00000100:00100000:0.0:1746143765.316409:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594377600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143765.316416:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594378240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (600us total) trans 17179873133 rc 0/0 00000100:00100000:3.0:1746143765.316420:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13528 00000100:00100000:3.0:1746143765.316428:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13530 00000100:00100000:3.0:1746143765.316431:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3295:x1830963594378112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143765.316475:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143765.316477:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.316479:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.316480:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143764 -> 1746143764 00002000:00010000:0.0:1746143765.316482:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143765.316487:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3295:x1830963594378112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (638us total) trans 17179873135 rc 0/0 00000100:00100000:3.0:1746143765.316491:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13530 00000100:00100000:0.0:1746143765.316501:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594377600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (667us total) trans 17179873134 rc 0/0 00000100:00100000:0.0:1746143765.316507:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13529 00000004:00080000:3.0:1746143765.316519:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efac000/2, rc 0, transno 17179873134 00000100:00100000:3.0:1746143765.316523:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594377600:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.316528:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efaca80/2, rc 0, transno 17179873135 00000100:00100000:3.0:1746143765.316530:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594378112:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.316673:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efac380/2, rc 0, transno 17179873132 00000100:00100000:3.0:1746143765.316677:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594377728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.316687:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efae300/2, rc 0, transno 17179873133 00000100:00100000:3.0:1746143765.316689:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594378240:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.316701:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eface00/2, rc 0, transno 17179873130 00000100:00100000:3.0:1746143765.316703:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594377856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.316707:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efae680/2, rc 0, transno 17179873131 00000100:00100000:3.0:1746143765.316709:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594378368:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.316713:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ee300/2, rc 0, transno 17179873128 00000100:00100000:3.0:1746143765.316715:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594377472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143765.316719:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efad180/2, rc 0, transno 17179873129 00000100:00100000:3.0:1746143765.316721:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594377984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143765.316847:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3ca300/2, rc 0, transno 21474840457 00000100:00100000:1.0:1746143765.316851:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594377088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143765.318626:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.318911:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594377344:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143765.319194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.319222:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.319259:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594230912 00000100:00100000:2.0:1746143765.319264:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594230912 00000100:00100000:2.0:1746143765.319294:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594231040 00000100:00100000:2.0:1746143765.319296:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594231040 00000100:00100000:2.0:1746143765.319309:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3954 00000100:00100000:2.0:1746143765.319314:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31374:x1830963594230912:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143765.319416:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31374:x1830963594230912:12345-192.168.202.48@tcp:49:cat.0 Request processed in 101us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.319421:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3954 00000100:00100000:2.0:1746143765.319434:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3955 00000100:00100000:2.0:1746143765.319439:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31375:x1830963594231040:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143765.319468:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31375:x1830963594231040:12345-192.168.202.48@tcp:49:cat.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.319473:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3955 00000100:00100000:2.0:1746143765.319497:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594377216:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.319525:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9c00/0xe984082ccd7300df lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 244 pid: 14762 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143765.319540:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 243 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.319555:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5db8400, rc 0) 00000100:00100000:2.0:1746143765.319571:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31372:x1830963594230016:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 42131us (42323us total) trans 8589943536 rc 0/0 00000100:00100000:2.0:1746143765.319576:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9209 00000100:00100000:2.0:1746143765.320976:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594231168 00000100:00100000:2.0:1746143765.320983:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594231168 00000100:00100000:2.0:1746143765.321021:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9212 00000100:00100000:2.0:1746143765.321026:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31370:x1830963594231168:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143765.321038:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.321050:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61fe400/0xe984082ccd730109 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b52 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.321091:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61fe400/0xe984082ccd730109 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b52 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.321101:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61fe400/0xe984082ccd730109 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b52 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.321112:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.321115:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143765.321117:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61fe400, rc 0) 00000100:00100000:2.0:1746143765.321165:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31370:x1830963594231168:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 138us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.321170:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9212 00000100:00100000:0.0:1746143765.323412:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.323503:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.323593:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594231296 00000100:00100000:3.0:1746143765.323600:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594231296 00000100:00100000:3.0:1746143765.323626:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594231552 00000100:00100000:3.0:1746143765.323627:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594231552 00000100:00100000:3.0:1746143765.323725:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3956 00000100:00100000:3.0:1746143765.323731:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31372:x1830963594231296:12345-192.168.202.48@tcp:49:multiop.0 00000100:00100000:0.0:1746143765.323878:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3957 00000100:00100000:0.0:1746143765.323884:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6457c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31370:x1830963594231552:12345-192.168.202.48@tcp:49:multiop.0 00000100:00100000:3.0:1746143765.324175:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31372:x1830963594231296:12345-192.168.202.48@tcp:49:multiop.0 Request processed in 444us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.324181:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3956 00000100:00100000:0.0:1746143765.324442:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6457c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31370:x1830963594231552:12345-192.168.202.48@tcp:49:multiop.0 Request processed in 558us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.324449:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3957 00000100:00100000:0.0:1746143765.325799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.325838:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.325976:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594231680 00000100:00100000:1.0:1746143765.325982:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594231680 00000100:00100000:1.0:1746143765.326007:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13531 00000100:00100000:1.0:1746143765.326013:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31370:x1830963594231680:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.326024:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.326039:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b59 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.326060:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.326070:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.326072:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.326075:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 14 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.326097:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.326108:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 10 pid: 15784 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143765.326122:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594378496:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.326213:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.326351:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594231424 00000100:00100000:3.0:1746143765.326355:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594231424 00000100:00100000:3.0:1746143765.326380:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 732 00000100:00100000:3.0:1746143765.326385:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594231424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.326393:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143765.326408:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61fe400/0xe984082ccd730109 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b52 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.326424:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.326429:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.326457:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1962:x1830963594231424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.326463:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 732 00000100:00100000:0.0:1746143765.326533:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.326616:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594231936 00000100:00100000:3.0:1746143765.326619:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594231936 00002000:00100000:3.0:1746143765.326641:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0879500 x1830963594231936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.326650:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879500 with x1830963594231936 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.326653:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879500 00000100:00100000:3.0:1746143765.326666:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6347 00000100:00100000:3.0:1746143765.326671:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594231936:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.327792:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594378496:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.327813:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.327824:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0a00, rc 0) 00000100:00100000:1.0:1746143765.327846:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31370:x1830963594231680:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1834us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.327852:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13531 00000100:00100000:0.0:1746143765.328759:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.328819:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594232064 00000100:00100000:1.0:1746143765.328824:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594232064 00010000:00010000:1.0:1746143765.328842:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 11 pid: 15784 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143765.328878:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7236 00000100:00100000:1.0:1746143765.328884:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594232064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.328892:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.328908:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 11 pid: 15784 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.328917:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 11 pid: 15784 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.328933:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd730006 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7af0 expref: 11 pid: 15784 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.328946:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.328947:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.329502:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.329510:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.329536:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.329547:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594378624:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143765.329827:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.330278:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.330293:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594232192 00000100:00100000:1.0:1746143765.330297:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594232192 00000100:00100000:2.0:1746143765.330320:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.330322:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13532 00000100:00100000:1.0:1746143765.330327:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31372:x1830963594232192:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.330338:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.330347:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b60 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.330362:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.330367:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.330369:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.330371:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3788800->4149247] (req 3788800->4149247) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.330387:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.330665:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 15 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.330675:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594378752:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.331284:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.332707:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594232448 00000100:00100000:3.0:1746143765.332717:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594232448 00002000:00100000:3.0:1746143765.332745:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009cdc0000 x1830963594232448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.332754:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0000 with x1830963594232448 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.332758:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0000 00000100:00100000:3.0:1746143765.332775:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6348 00000100:00100000:3.0:1746143765.332780:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594232448:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143765.335057:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594378624:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.335077:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.335103:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594232064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6219us (6350us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.335111:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7236 00000100:00100000:0.0:1746143765.335252:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.337058:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594231936:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10381us (10519us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.337067:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6347 00002000:00100000:3.0:1746143765.337077:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a0879500 x1830963594231936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.337085:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0879500 with x1830963594231936 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.337089:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0879500 00000100:00100000:3.0:1746143765.337106:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594232704 00000100:00100000:3.0:1746143765.337110:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594232704 00000100:00100000:1.0:1746143765.337128:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594378752:192.168.202.48@tcp:104: 00002000:00100000:3.0:1746143765.337132:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4009983) req@ffff8800a087a680 x1830963594232704/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.337152:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a680 with x1830963594232704 ext(4005888->4009983) 00010000:00010000:3.0:1746143765.337159:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 14 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.337163:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3788800->4149247] (req 3788800->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.337170:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 14 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.337179:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc1c00, rc 0) 00002000:00010000:3.0:1746143765.337180:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a087a680 00000100:00100000:1.0:1746143765.337208:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31372:x1830963594232192:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6880us (7381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.337214:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13532 00000100:00100000:3.0:1746143765.337216:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1799 00000100:00100000:3.0:1746143765.337221:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594232704:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.337373:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a087a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594232704:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 151us (2342us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.337379:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1799 00002000:00100000:3.0:1746143765.337383:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4009983) req@ffff8800a087a680 x1830963594232704/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.337391:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a087a680 with x1830963594232704 ext(4005888->4009983) 00010000:00010000:3.0:1746143765.337396:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 14 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.337405:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 14 pid: 9527 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.337411:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a087a680 00000100:00100000:2.0:1746143765.340851:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594232448:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8063us (10523us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.340860:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6348 00002000:00100000:2.0:1746143765.340869:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009cdc0000 x1830963594232448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.340877:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0000 with x1830963594232448 ext(1048576->2097151) 00002000:00010000:2.0:1746143765.340882:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc0000 00000100:00100000:0.0:1746143765.347004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.347103:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594232960 00000100:00100000:2.0:1746143765.347111:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594232960 00002000:00100000:2.0:1746143765.347177:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4194303) req@ffff880093f01c00 x1830963594232960/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.347184:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963594232960 ext(4005888->4194303) 00010000:00010000:2.0:1746143765.347202:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 14 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.347213:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 14 pid: 9527 timeout: 944 lvb_type: 0 00002000:00010000:2.0:1746143765.347219:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f01c00 00000100:00100000:2.0:1746143765.347251:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1800 00000100:00100000:2.0:1746143765.347258:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594232960:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143765.347660:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.347684:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.347697:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594233088 00000100:00100000:2.0:1746143765.347698:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594233216 00000100:00100000:2.0:1746143765.347701:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594233216 00000100:00100000:1.0:1746143765.347701:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594233088 00000100:00100000:0.0:1746143765.347703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.347719:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594233344 00000100:00100000:1.0:1746143765.347720:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594233344 00000100:00100000:2.0:1746143765.347770:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13533 00000100:00100000:2.0:1746143765.347775:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31375:x1830963594233088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.347783:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.347794:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b67 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.347852:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.347853:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.347859:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.347870:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.347878:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61fe200, rc 0) 00000100:00100000:2.0:1746143765.347901:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31375:x1830963594233088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 126us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.347906:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13533 00000100:00100000:1.0:1746143765.347922:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13534 00000100:00100000:1.0:1746143765.347927:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31374:x1830963594233216:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143765.347929:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13535 00010000:00010000:1.0:1746143765.347933:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143765.347936:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31370:x1830963594233344:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.347939:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b6e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.347943:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.347950:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.347951:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.347952:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b75 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.347955:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.347963:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 27 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.347967:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.347969:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7eac00, rc 0) 00010000:00010000:0.0:1746143765.347973:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.347974:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.347977:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4194304->4583423] (req 4194304->4583423) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.347984:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31374:x1830963594233216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.347988:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13534 00010000:00010000:0.0:1746143765.347999:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.348013:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 10 pid: 21542 timeout: 944 lvb_type: 1 00000100:00100000:0.0:1746143765.348022:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594378880:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143765.348076:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.352218:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.352246:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.352263:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594233728 00000100:00100000:0.0:1746143765.352270:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594233728 00002000:00100000:0.0:1746143765.352298:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093f02a00 x1830963594233728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143765.352307:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02a00 with x1830963594233728 ext(1048576->2097151) 00002000:00010000:0.0:1746143765.352310:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f02a00 00000100:00100000:0.0:1746143765.352323:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594233856 00000100:00100000:0.0:1746143765.352325:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594233856 00002000:00100000:0.0:1746143765.352333:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093f02d80 x1830963594233856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143765.352338:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02d80 with x1830963594233856 ext(1048576->2097151) 00002000:00010000:0.0:1746143765.352341:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f02d80 00000100:00100000:0.0:1746143765.352358:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6349 00000100:00100000:0.0:1746143765.352363:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594233728:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.352395:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6350 00000100:00100000:3.0:1746143765.352402:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594233856:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.352496:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594378880:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.352518:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4194304->4583423] (req 4194304->4583423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.352531:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136489600, rc 0) 00000100:00100000:1.0:1746143765.352563:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31370:x1830963594233344:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4628us (4859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.352568:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13535 00000100:00100000:1.0:1746143765.352613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.354832:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594232960:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 7568us (7829us total) trans 17179873136 rc 0/0 00000100:00100000:2.0:1746143765.354844:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1800 00002000:00100000:2.0:1746143765.354852:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4194303) req@ffff880093f01c00 x1830963594232960/t17179873136(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.354861:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01c00 with x1830963594232960 ext(4005888->4194303) 00010000:00010000:2.0:1746143765.354869:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 19 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.354880:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 19 pid: 9527 timeout: 944 lvb_type: 0 00002000:00010000:2.0:1746143765.354885:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f01c00 00000100:00100000:2.0:1746143765.354908:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594233984 00000100:00100000:2.0:1746143765.354912:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594233984 00010000:00010000:2.0:1746143765.354931:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 11 pid: 21542 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.354948:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7237 00000100:00100000:2.0:1746143765.354953:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594233984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.354962:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.354977:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 11 pid: 21542 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.354987:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 11 pid: 21542 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.355009:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff25a00/0xe984082ccd72ffea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae9 expref: 11 pid: 21542 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.355023:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.355025:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.355031:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 12 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.355038:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 12 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.355063:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 12 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.355074:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594379008:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.355117:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.360983:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.361198:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594379008:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.361215:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.361252:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594233984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6297us (8637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.361261:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7237 00000100:00100000:2.0:1746143765.361284:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594234112 00000100:00100000:2.0:1746143765.361288:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594234112 00010000:00010000:2.0:1746143765.361312:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 19 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.361335:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7238 00000100:00100000:2.0:1746143765.361341:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594234112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.361350:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143765.361364:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143764 -> 1746143765 00002000:00010000:2.0:1746143765.361367:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143764 -> 1746143765 00010000:00010000:2.0:1746143765.361372:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 19 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.361382:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 19 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.361399:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0a00/0xe984082ccd730110 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b59 expref: 19 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.361412:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.361413:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.361419:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.361426:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.361453:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 28 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.361469:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594379136:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.361515:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.362489:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594233728:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10123us (10275us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.362497:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6349 00002000:00100000:1.0:1746143765.362505:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093f02a00 x1830963594233728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.362514:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02a00 with x1830963594233728 ext(1048576->2097151) 00002000:00010000:1.0:1746143765.362518:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f02a00 00000100:00100000:0.0:1746143765.364414:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.364535:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594234368 00000100:00100000:1.0:1746143765.364540:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594234368 00002000:00100000:1.0:1746143765.364573:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (4579328->4583423) req@ffff880093f02300 x1830963594234368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.364581:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963594234368 ext(4579328->4583423) 00002000:00010000:1.0:1746143765.364585:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02300 00000100:00100000:1.0:1746143765.365889:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6351 00000100:00100000:1.0:1746143765.365899:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594234368:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.366083:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594234368:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 186us (1673us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143765.366090:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6351 00002000:00100000:1.0:1746143765.366095:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (4579328->4583423) req@ffff880093f02300 x1830963594234368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.366103:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02300 with x1830963594234368 ext(4579328->4583423) 00002000:00010000:1.0:1746143765.366107:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f02300 00000100:00100000:3.0:1746143765.366245:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594379136:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143765.366261:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.366285:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594234112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4944us (5308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.366296:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7238 00000100:00100000:3.0:1746143765.366568:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594233856:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14167us (14320us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.366574:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6350 00002000:00100000:3.0:1746143765.366579:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093f02d80 x1830963594233856/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.366586:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02d80 with x1830963594233856 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.366589:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f02d80 00000100:00100000:0.0:1746143765.367255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.367301:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594234624 00000100:00100000:3.0:1746143765.367306:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594234624 00002000:00100000:3.0:1746143765.367327:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3788800->3792895) req@ffff8800930de680 x1830963594234624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.367333:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930de680 with x1830963594234624 ext(3788800->3792895) 00002000:00010000:3.0:1746143765.367337:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930de680 00000100:00100000:3.0:1746143765.367360:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6352 00000100:00100000:3.0:1746143765.367365:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594234624:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.367458:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594234624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 92us (202us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.367463:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6352 00002000:00100000:3.0:1746143765.367467:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3788800->3792895) req@ffff8800930de680 x1830963594234624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.367472:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930de680 with x1830963594234624 ext(3788800->3792895) 00002000:00010000:3.0:1746143765.367474:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930de680 00000100:00100000:0.0:1746143765.368176:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.368398:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594234752 00000100:00100000:1.0:1746143765.368402:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594234752 00000100:00100000:0.0:1746143765.368534:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.368550:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235008 00000100:00100000:0.0:1746143765.368553:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235008 00000100:00100000:0.0:1746143765.368590:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3958 00000100:00100000:0.0:1746143765.368595:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31370:x1830963594235008:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143765.368715:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13536 00000100:00100000:1.0:1746143765.368721:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31375:x1830963594234752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143765.368730:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.368746:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b7c expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.368764:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.368766:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.368772:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 14 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.368785:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 14 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.368794:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba27200, rc 0) 00000100:00100000:1.0:1746143765.368819:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31375:x1830963594234752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 98us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.368827:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13536 00000100:00100000:0.0:1746143765.369979:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31370:x1830963594235008:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1379us (1441us total) trans 8589943537 rc 0/0 00000100:00100000:0.0:1746143765.369986:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3958 00000100:00100000:0.0:1746143765.371061:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.371278:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235136 00000100:00100000:2.0:1746143765.371283:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235136 00000100:00100000:2.0:1746143765.371313:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13537 00000100:00100000:2.0:1746143765.371318:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31374:x1830963594235136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.371329:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.371340:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b83 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.371356:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.371357:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.371361:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.371371:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.371378:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f9d0c00, rc 0) 00000100:00100000:2.0:1746143765.371407:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31374:x1830963594235136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.371412:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13537 00000100:00100000:1.0:1746143765.374014:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.374117:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235392 00000100:00100000:3.0:1746143765.374122:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235392 00002000:00100000:3.0:1746143765.374168:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (4145152->4149247) req@ffff88008f3c9f80 x1830963594235392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.374177:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9f80 with x1830963594235392 ext(4145152->4149247) 00002000:00010000:3.0:1746143765.374182:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9f80 00000100:00100000:3.0:1746143765.374206:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6353 00000100:00100000:3.0:1746143765.374213:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594235392:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.374938:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594235392:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 723us (927us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.374944:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6353 00002000:00100000:3.0:1746143765.374950:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (4145152->4149247) req@ffff88008f3c9f80 x1830963594235392/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.374960:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9f80 with x1830963594235392 ext(4145152->4149247) 00002000:00010000:3.0:1746143765.374964:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9f80 00000100:00100000:0.0:1746143765.375419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.375501:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.376338:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235776 00000100:00100000:3.0:1746143765.376343:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235776 00002000:00100000:3.0:1746143765.376365:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1ef100 x1830963594235776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.376372:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef100 with x1830963594235776 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.376375:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ef100 00000100:00100000:3.0:1746143765.376397:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594235904 00000100:00100000:3.0:1746143765.376399:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594235904 00002000:00100000:3.0:1746143765.376409:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1eed80 x1830963594235904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.376419:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963594235904 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.376422:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eed80 00000100:00100000:3.0:1746143765.376435:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6354 00000100:00100000:3.0:1746143765.376440:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594235776:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.377047:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6355 00000100:00100000:1.0:1746143765.377054:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594235904:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.386386:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594235904:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 9323us (10875us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.386396:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6355 00002000:00100000:1.0:1746143765.386406:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1eed80 x1830963594235904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.386415:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eed80 with x1830963594235904 ext(1048576->2097151) 00002000:00010000:1.0:1746143765.386421:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1eed80 00000100:00100000:3.0:1746143765.388974:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594235776:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12527us (13549us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.388984:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6354 00002000:00100000:3.0:1746143765.388992:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88008f1ef100 x1830963594235776/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.389000:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef100 with x1830963594235776 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.389005:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f1ef100 00000100:00100000:0.0:1746143765.391946:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.392037:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236032 00000100:00100000:1.0:1746143765.392043:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236032 00000100:00100000:1.0:1746143765.392086:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13538 00000100:00100000:1.0:1746143765.392092:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31374:x1830963594236032:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143765.392107:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.392121:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b8a expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.392166:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.392173:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.392175:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.392179:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.392218:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 13 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.392229:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 13 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.392239:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594379264:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.393260:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.394264:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594379264:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.394286:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.394298:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bb800, rc 0) 00000100:00100000:1.0:1746143765.394326:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31374:x1830963594236032:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2234us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.394333:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13538 00000100:00100000:0.0:1746143765.395602:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.395632:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.395654:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236160 00000100:00100000:3.0:1746143765.395660:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236160 00002000:00100000:3.0:1746143765.395691:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4583423) req@ffff88008f1edc00 x1830963594236160/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143765.395696:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236416 00000100:00100000:1.0:1746143765.395699:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236416 00002000:00100000:3.0:1746143765.395700:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edc00 with x1830963594236160 ext(4194304->4583423) 00010000:00010000:3.0:1746143765.395706:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 15 pid: 8495 timeout: 944 lvb_type: 0 00002000:00100000:1.0:1746143765.395710:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f1edf80 x1830963594236416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143765.395716:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 15 pid: 8495 timeout: 944 lvb_type: 0 00002000:00100000:1.0:1746143765.395716:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edf80 with x1830963594236416 ext(2097152->3145727) 00010000:00010000:1.0:1746143765.395719:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 15 pid: 8495 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.395722:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1edc00 00010000:00010000:1.0:1746143765.395731:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 15 pid: 8495 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143765.395736:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1edf80 00000100:00100000:3.0:1746143765.395802:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1801 00000100:00100000:3.0:1746143765.395809:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594236160:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143765.395893:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1802 00000100:00100000:1.0:1746143765.395898:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963594236416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143765.401926:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594236416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6019us (6285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.401936:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1802 00002000:00100000:1.0:1746143765.401946:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f1edf80 x1830963594236416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.401955:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edf80 with x1830963594236416 ext(2097152->3145727) 00010000:00010000:1.0:1746143765.401963:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.401975:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00002000:00010000:1.0:1746143765.401981:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1edf80 00000100:00100000:3.0:1746143765.404176:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594236160:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8361us (8570us total) trans 21474840458 rc 0/0 00000100:00100000:3.0:1746143765.404195:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1801 00002000:00100000:3.0:1746143765.404204:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4583423) req@ffff88008f1edc00 x1830963594236160/t21474840458(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.404213:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1edc00 with x1830963594236160 ext(4194304->4583423) 00010000:00010000:3.0:1746143765.404220:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.404233:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.404238:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f1edc00 00000100:00100000:0.0:1746143765.404861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.405403:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236544 00000100:00100000:1.0:1746143765.405411:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236544 00000100:00100000:1.0:1746143765.405453:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13539 00000100:00100000:1.0:1746143765.405460:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31375:x1830963594236544:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143765.405725:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.405739:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b91 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.405763:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.405866:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.405868:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.405871:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.405895:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 26 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.405903:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 26 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.405913:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594379392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.406004:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.407430:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.407514:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594379392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.407537:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.407547:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938bb400, rc 0) 00000100:00100000:1.0:1746143765.407586:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31375:x1830963594236544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2127us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.407594:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13539 00000100:00100000:3.0:1746143765.407671:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236672 00000100:00100000:3.0:1746143765.407676:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236672 00010000:00010000:3.0:1746143765.407699:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.407730:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7239 00000100:00100000:3.0:1746143765.407735:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594236672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.407744:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143765.407761:0:7151:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143764 -> 1746143765 00002000:00010000:3.0:1746143765.407763:0:7151:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143764 -> 1746143765 00010000:00010000:3.0:1746143765.407864:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.407874:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.407891:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136489600/0xe984082ccd73012c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b75 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.407912:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.407914:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.407919:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.407926:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.407948:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.407957:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594379520:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143765.408344:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.408836:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.408909:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594236800 00000100:00100000:3.0:1746143765.408913:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594236800 00002000:00100000:3.0:1746143765.408935:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3788800->4149247) req@ffff88008f1eca80 x1830963594236800/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.408944:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eca80 with x1830963594236800 ext(3788800->4149247) 00010000:00010000:3.0:1746143765.408949:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 27 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.408959:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 27 pid: 9527 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.408964:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1eca80 00000100:00100000:3.0:1746143765.409050:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1803 00000100:00100000:3.0:1746143765.409056:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594236800:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143765.411871:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.412023:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594237056 00000100:00100000:1.0:1746143765.412028:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594237056 00002000:00100000:1.0:1746143765.412055:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880090765500 x1830963594237056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.412063:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765500 with x1830963594237056 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.412068:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090765500 00000100:00100000:1.0:1746143765.412089:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6356 00000100:00100000:1.0:1746143765.412094:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594237056:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143765.413100:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594379520:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143765.413115:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.413160:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963594236672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5425us (5733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.413167:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7239 00000100:00100000:2.0:1746143765.415705:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594236800:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6641us (6861us total) trans 17179873137 rc 0/0 00000100:00100000:2.0:1746143765.415716:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1803 00002000:00100000:2.0:1746143765.415727:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3788800->4149247) req@ffff88008f1eca80 x1830963594236800/t17179873137(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.415735:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1eca80 with x1830963594236800 ext(3788800->4149247) 00010000:00010000:2.0:1746143765.415743:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 29 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.415756:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 29 pid: 9527 timeout: 944 lvb_type: 0 00002000:00010000:2.0:1746143765.415762:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1eca80 00000100:00100000:1.0:1746143765.419366:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594237056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7260us (7490us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.419376:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6356 00002000:00100000:1.0:1746143765.419385:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880090765500 x1830963594237056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.419393:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765500 with x1830963594237056 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.419398:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090765500 00000100:00100000:0.0:1746143765.419427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.419658:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594237184 00000100:00100000:2.0:1746143765.419663:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594237184 00010000:00010000:2.0:1746143765.419686:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 29 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.419707:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7240 00000100:00100000:2.0:1746143765.419713:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594237184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.419722:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.419738:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 29 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.419747:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 29 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.419765:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dc1c00/0xe984082ccd730117 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3788800->4149247) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b60 expref: 29 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.419799:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.419801:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.419807:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.419814:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.419838:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.419847:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594379648:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.419899:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.423335:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594379648:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.423350:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.423550:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594237184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3835us (4121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.423559:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7240 00000100:00100000:0.0:1746143765.425448:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.425800:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594237440 00000100:00100000:1.0:1746143765.425807:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594237440 00002000:00100000:1.0:1746143765.425841:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880090766d80 x1830963594237440/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.425849:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963594237440 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.425853:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766d80 00000100:00100000:1.0:1746143765.425884:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6357 00000100:00100000:1.0:1746143765.425890:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594237440:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143765.426630:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.426668:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594237568 00000100:00100000:2.0:1746143765.426672:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594237568 00000100:00100000:2.0:1746143765.426728:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13540 00000100:00100000:2.0:1746143765.426733:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31374:x1830963594237568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.426741:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.426753:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b98 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.426775:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.426776:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.426781:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.426792:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 29 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.426800:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347800, rc 0) 00000100:00100000:2.0:1746143765.427024:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31374:x1830963594237568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 290us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.427030:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13540 00000100:00100000:1.0:1746143765.438373:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594237440:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12474us (12920us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.438383:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6357 00002000:00100000:1.0:1746143765.438393:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880090766d80 x1830963594237440/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.438402:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766d80 with x1830963594237440 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.438407:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766d80 00000100:00100000:0.0:1746143765.439316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.441156:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594237824 00000100:00100000:1.0:1746143765.441165:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594237824 00002000:00100000:1.0:1746143765.441208:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880130fd4e00 x1830963594237824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.441219:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4e00 with x1830963594237824 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.441224:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4e00 00000100:00100000:1.0:1746143765.441246:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6358 00000100:00100000:1.0:1746143765.441251:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594237824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143765.443274:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.443312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.443368:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238080 00000100:00100000:3.0:1746143765.443374:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238080 00002000:00100000:3.0:1746143765.443405:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880130fd7b80 x1830963594238080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.443413:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7b80 with x1830963594238080 ext(3145728->4194303) 00002000:00010000:3.0:1746143765.443418:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7b80 00000100:00100000:3.0:1746143765.443431:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238336 00000100:00100000:3.0:1746143765.443433:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238336 00002000:00100000:3.0:1746143765.443442:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9fb80 x1830963594238336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.443449:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9fb80 with x1830963594238336 ext(3145728->4194303) 00002000:00010000:3.0:1746143765.443451:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9fb80 00000100:00100000:3.0:1746143765.443464:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6359 00000100:00100000:3.0:1746143765.443469:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594238080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143765.444077:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6360 00000100:00100000:2.0:1746143765.444085:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594238336:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143765.448427:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.451100:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238464 00000100:00100000:3.0:1746143765.451111:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238464 00000100:00100000:3.0:1746143765.451182:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13541 00000100:00100000:3.0:1746143765.451200:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31375:x1830963594238464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.451216:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.451230:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7b9f expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.451251:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.451253:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.451259:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.451273:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.451283:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0800, rc 0) 00000100:00100000:3.0:1746143765.451342:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31375:x1830963594238464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 144us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.451349:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13541 00000100:00100000:1.0:1746143765.453556:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594237824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12299us (14236us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.453565:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6358 00002000:00100000:1.0:1746143765.453574:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880130fd4e00 x1830963594237824/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.453582:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4e00 with x1830963594237824 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.453587:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4e00 00000100:00100000:3.0:1746143765.457549:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594238080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14071us (14271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.457559:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6359 00002000:00100000:3.0:1746143765.457569:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880130fd7b80 x1830963594238080/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.457583:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7b80 with x1830963594238080 ext(3145728->4194303) 00002000:00010000:3.0:1746143765.457587:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd7b80 00000100:00100000:0.0:1746143765.458636:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.458770:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.459212:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238720 00000100:00100000:1.0:1746143765.459219:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238720 00002000:00100000:1.0:1746143765.459250:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9f100 x1830963594238720/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.459259:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9f100 with x1830963594238720 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.459263:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9f100 00000100:00100000:1.0:1746143765.459275:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594238976 00000100:00100000:1.0:1746143765.459277:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594238976 00002000:00100000:1.0:1746143765.459288:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136b9ce00 x1830963594238976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.459294:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ce00 with x1830963594238976 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.459297:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ce00 00000100:00100000:1.0:1746143765.459314:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6361 00000100:00100000:1.0:1746143765.459320:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594238720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143765.459488:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594238336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15403us (16173us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.459495:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6360 00002000:00100000:2.0:1746143765.459500:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9fb80 x1830963594238336/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.459507:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9fb80 with x1830963594238336 ext(3145728->4194303) 00002000:00010000:2.0:1746143765.459509:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9fb80 00000100:00100000:2.0:1746143765.459523:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6362 00000100:00100000:2.0:1746143765.459529:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594238976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143765.469216:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594238720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9886us (10574us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.469226:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6361 00002000:00100000:1.0:1746143765.469236:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9f100 x1830963594238720/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.469245:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9f100 with x1830963594238720 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.469250:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9f100 00000100:00100000:0.0:1746143765.474173:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.475896:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594238976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16361us (17120us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.475906:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6362 00002000:00100000:2.0:1746143765.475916:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880136b9ce00 x1830963594238976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.475925:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9ce00 with x1830963594238976 ext(3145728->4194303) 00002000:00010000:2.0:1746143765.475930:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136b9ce00 00000100:00100000:2.0:1746143765.475959:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594239232 00000100:00100000:2.0:1746143765.475965:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594239232 00002000:00100000:2.0:1746143765.475991:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880136b9c700 x1830963594239232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.475997:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9c700 with x1830963594239232 ext(4194304->4771839) 00002000:00010000:2.0:1746143765.476000:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9c700 00000100:00100000:2.0:1746143765.476014:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6363 00000100:00100000:2.0:1746143765.476019:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594239232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143765.483103:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.483353:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594239488 00000100:00100000:2.0:1746143765.483361:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594239488 00002000:00100000:2.0:1746143765.483396:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880136b9dc00 x1830963594239488/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.483404:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9dc00 with x1830963594239488 ext(4194304->4771839) 00002000:00010000:2.0:1746143765.483408:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9dc00 00000100:00100000:2.0:1746143765.483440:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6364 00000100:00100000:2.0:1746143765.483446:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594239488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143765.483684:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594239232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7663us (9551us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143765.483692:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6363 00002000:00100000:3.0:1746143765.483698:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880136b9c700 x1830963594239232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.483703:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9c700 with x1830963594239232 ext(4194304->4771839) 00002000:00010000:3.0:1746143765.483707:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9c700 00000100:00100000:2.0:1746143765.488337:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594239488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4884us (5235us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143765.488348:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6364 00002000:00100000:2.0:1746143765.488357:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880136b9dc00 x1830963594239488/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.488366:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9dc00 with x1830963594239488 ext(4194304->4771839) 00002000:00010000:2.0:1746143765.488370:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9dc00 00000100:00100000:0.0:1746143765.493031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.493397:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594239744 00000100:00100000:2.0:1746143765.493404:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594239744 00000100:00100000:2.0:1746143765.493656:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3959 00000100:00100000:2.0:1746143765.493664:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31374:x1830963594239744:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:0.0:1746143765.494069:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.494282:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594240000 00000100:00100000:3.0:1746143765.494286:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594240000 00000100:00100000:3.0:1746143765.494306:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3960 00000100:00100000:3.0:1746143765.494310:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31375:x1830963594240000:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143765.494784:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31374:x1830963594239744:12345-192.168.202.48@tcp:35:cat.0 Request processed in 1120us (1758us total) trans 8589943538 rc 0/0 00000100:00100000:2.0:1746143765.494791:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3959 00000100:00100000:3.0:1746143765.494934:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31375:x1830963594240000:12345-192.168.202.48@tcp:35:cat.0 Request processed in 622us (864us total) trans 8589943539 rc 0/0 00000100:00100000:3.0:1746143765.494940:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3960 00000100:00100000:0.0:1746143765.599448:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.599575:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594240256 00000100:00100000:3.0:1746143765.599582:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594240256 00000100:00100000:3.0:1746143765.599649:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9213 00000100:00100000:3.0:1746143765.599656:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31382:x1830963594240256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143765.599678:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.599692:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1800/0xe984082ccd73015d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ba6 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.599791:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599801:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599810:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599821:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599826:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599831:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599918:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599924:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.599929:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143765.599936:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143765.600005:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600010:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600019:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600025:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e0000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.600028:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600033:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600043:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143765.600045:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.600049:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600053:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600081:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600086:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600091:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600094:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e1e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.600096:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600101:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600110:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442500) 00010000:00010000:3.0:1746143765.600112:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.600114:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600118:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73016b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600170:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1800/0xe984082ccd73015d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 247 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.600181:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 246 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.600199:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.600201:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143765.600203:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0a00, rc 0) 00000100:00100000:3.0:1746143765.600248:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31382:x1830963594240256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 591us (1108us total) trans 8589943540 rc 0/0 00000100:00100000:3.0:1746143765.600253:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9213 00000100:00100000:3.0:1746143765.600358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.600373:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594240512 00000100:00100000:3.0:1746143765.600376:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594240512 00000100:00100000:3.0:1746143765.600393:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9214 00000100:00100000:3.0:1746143765.600398:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31383:x1830963594240512:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143765.600408:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.600413:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1c00/0xe984082ccd730180 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bad expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.600450:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600456:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600462:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600469:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600474:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600478:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600526:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600532:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600537:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143765.600542:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143765.600570:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600575:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600582:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600586:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e0400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.600588:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600593:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600599:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143765.600601:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.600603:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600608:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0400/0xe984082ccd730187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600615:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600619:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600624:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600627:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e0600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.600629:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600633:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600641:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442b00) 00010000:00010000:3.0:1746143765.600643:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.600645:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600649:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73018e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143765.600667:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1c00/0xe984082ccd730180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 12 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.600675:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.600681:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.600683:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143765.600684:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009505f400, rc 0) 00000100:00100000:3.0:1746143765.600699:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31383:x1830963594240512:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 301us (342us total) trans 8589943541 rc 0/0 00000100:00100000:3.0:1746143765.600704:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9214 00000100:00100000:3.0:1746143765.603037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.605770:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594240768 00000100:00100000:0.0:1746143765.605779:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594240768 00000100:00100000:0.0:1746143765.605962:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3961 00000100:00100000:0.0:1746143765.605969:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31382:x1830963594240768:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143765.606179:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31382:x1830963594240768:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 210us (3147us total) trans 8589943542 rc 0/0 00000100:00100000:0.0:1746143765.606195:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3961 00000100:00100000:0.0:1746143765.608919:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.608985:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594240896 00000100:00100000:2.0:1746143765.608991:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594240896 00000100:00100000:2.0:1746143765.609038:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13542 00000100:00100000:2.0:1746143765.609044:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31383:x1830963594240896:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143765.609056:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.609070:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bb4 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.609099:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.609111:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.609116:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.609118:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.609120:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3272704->3416063] (req 3272704->3416063) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.609175:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.609205:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.609222:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594379776:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.609316:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.609323:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.609329:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594379904:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.609594:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.612908:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594379776:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.612920:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594379904:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.612944:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3272704->3416063] (req 3272704->3416063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.612958:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346800, rc 0) 00000100:00100000:2.0:1746143765.613003:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31383:x1830963594240896:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3958us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.613010:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13542 00000100:00100000:0.0:1746143765.616400:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.616487:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594241024 00000100:00100000:2.0:1746143765.616494:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594241024 00010000:00010000:2.0:1746143765.616523:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.616547:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7241 00000100:00100000:2.0:1746143765.616553:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594241024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.616564:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.616581:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.616590:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.616608:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd730156 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b9f expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.616767:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.618052:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594241024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1496us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.618060:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7241 00000100:00100000:0.0:1746143765.619339:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.619407:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594241152 00000100:00100000:2.0:1746143765.619412:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594241152 00010000:00010000:2.0:1746143765.619432:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 18 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.619450:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7242 00000100:00100000:2.0:1746143765.619455:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594241152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.619465:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.619479:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 18 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.619488:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 18 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.619502:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800938bb800/0xe984082ccd730141 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b8a expref: 18 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.619512:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.619514:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.619519:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 15 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.619527:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 15 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.619558:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 15 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.619567:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594380032:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.620321:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.624020:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.624091:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594241408 00000100:00100000:3.0:1746143765.624098:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594241408 00002000:00100000:3.0:1746143765.624134:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3272704->3276799) req@ffff8800a0816a00 x1830963594241408/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143765.624135:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594380032:192.168.202.48@tcp:105: 00002000:00100000:3.0:1746143765.624158:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816a00 with x1830963594241408 ext(3272704->3276799) 00002000:00010000:3.0:1746143765.624162:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0816a00 00010000:00010000:2.0:1746143765.624172:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.624183:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6365 00000100:00100000:3.0:1746143765.624200:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594241408:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143765.624231:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594241152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4775us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.624238:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7242 00000100:00100000:3.0:1746143765.624326:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594241408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 126us (311us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.624332:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6365 00002000:00100000:3.0:1746143765.624336:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3272704->3276799) req@ffff8800a0816a00 x1830963594241408/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.624342:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816a00 with x1830963594241408 ext(3272704->3276799) 00002000:00010000:3.0:1746143765.624345:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0816a00 00000100:00100000:0.0:1746143765.631603:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.632179:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594241664 00000100:00100000:3.0:1746143765.632199:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594241664 00002000:00100000:3.0:1746143765.632234:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3411968->3416063) req@ffff8800a0816300 x1830963594241664/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.632243:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816300 with x1830963594241664 ext(3411968->3416063) 00002000:00010000:3.0:1746143765.632247:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0816300 00000100:00100000:3.0:1746143765.632476:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6366 00000100:00100000:3.0:1746143765.632483:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594241664:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.632800:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594241664:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 316us (1201us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.632807:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6366 00002000:00100000:3.0:1746143765.632812:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3411968->3416063) req@ffff8800a0816300 x1830963594241664/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.632819:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816300 with x1830963594241664 ext(3411968->3416063) 00002000:00010000:3.0:1746143765.632822:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0816300 00000100:00100000:0.0:1746143765.634703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.635600:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594241920 00000100:00100000:2.0:1746143765.635607:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594241920 00000100:00100000:2.0:1746143765.635675:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3962 00000100:00100000:2.0:1746143765.635681:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31383:x1830963594241920:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143765.636153:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31383:x1830963594241920:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 458us (1441us total) trans 8589943543 rc 0/0 00000100:00100000:2.0:1746143765.636160:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3962 00000100:00100000:0.0:1746143765.717323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.717486:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594242048 00000100:00100000:2.0:1746143765.717495:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594242048 00000100:00100000:2.0:1746143765.717545:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13543 00000100:00100000:2.0:1746143765.717553:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31382:x1830963594242048:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143765.717568:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.717583:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bbb expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.717612:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.717620:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.717625:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.717627:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.717630:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2338816->3145727] (req 2338816->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 30 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.717654:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 30 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.717663:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 30 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.717674:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594380160:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.717754:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.717762:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 16 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.717768:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594380288:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.717788:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.721587:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.721784:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594242304 00000100:00100000:2.0:1746143765.721790:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594242304 00000100:00100000:2.0:1746143765.721927:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9215 00000100:00100000:2.0:1746143765.721935:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31388:x1830963594242304:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.721954:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.721967:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bc2 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.722059:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.722069:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.722078:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.722087:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.722091:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.722096:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.727916:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd7301c6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.727930:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd7301c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.727944:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd7301c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143765.727953:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143765.728033:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728038:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728043:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728047:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f5c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.728050:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728055:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728064:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143765.728067:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.728070:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728074:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728103:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728107:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728114:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728118:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f4c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.728120:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728124:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728130:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484300) 00010000:00010000:2.0:1746143765.728131:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.728133:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728137:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.728205:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bc2 expref: 15 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.728217:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd7301c6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bc2 expref: 14 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.728222:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.728224:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143765.728226:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f4000, rc 0) 00000100:00100000:2.0:1746143765.728286:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31388:x1830963594242304:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6350us (6704us total) trans 8589943544 rc 0/0 00000100:00100000:2.0:1746143765.728295:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9215 00000100:00100000:0.0:1746143765.728921:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.728948:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594242432 00000100:00100000:0.0:1746143765.728955:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594242432 00010000:00010000:0.0:1746143765.728975:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 31 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.728994:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7243 00000100:00100000:0.0:1746143765.729000:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594242432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.729010:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.729028:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 31 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.729036:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 31 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.729049:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.729067:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594242432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.729072:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7243 00010000:00010000:3.0:1746143765.729463:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd73014f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b98 expref: 30 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.729478:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594380160:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.729488:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594380288:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.729507:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2338816->3145727] (req 2338816->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 29 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.729515:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346c00, rc 0) 00000100:00100000:3.0:1746143765.729551:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31382:x1830963594242048:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11999us (12234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.729557:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13543 00000100:00100000:2.0:1746143765.730333:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.730449:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594242560 00000100:00100000:1.0:1746143765.730454:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594242560 00010000:00010000:1.0:1746143765.730472:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.730507:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7244 00000100:00100000:1.0:1746143765.730512:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594242560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.730520:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.730532:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.730540:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.730552:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800938bb400/0xe984082ccd730148 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b91 expref: 17 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.730575:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.730577:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.730583:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 28 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.730589:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 28 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.730613:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 28 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.730623:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594380416:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143765.730694:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.732201:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.734197:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594242688 00000100:00100000:3.0:1746143765.734206:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594242688 00000100:00100000:3.0:1746143765.734243:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13544 00000100:00100000:3.0:1746143765.734250:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594242688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.734266:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.734278:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e0000/0xe984082ccd7301d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bc9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.734320:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594380544:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143765.734378:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.734417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.734540:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594242816 00000100:00100000:2.0:1746143765.734544:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594242816 00000100:00100000:2.0:1746143765.734569:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 733 00000100:00100000:2.0:1746143765.734574:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594242816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.734580:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.734595:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4000/0xe984082ccd7301c6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bc2 expref: 14 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.735441:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.735447:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.735476:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594242816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 901us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.735483:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 733 00000100:00100000:3.0:1746143765.735916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.736100:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594380416:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143765.736117:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.736157:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594242560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5644us (5824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.736164:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7244 00002000:00010000:0.0:1746143765.736356:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143764 -> 1746143765 00000100:00100000:0.0:1746143765.736372:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594380544:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143765.736388:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e0000/0xe984082ccd7301d4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bc9 expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.736399:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e0000/0xe984082ccd7301d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bc9 expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.736409:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0000, rc 0) 00000100:00100000:0.0:1746143765.736428:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594242688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2178us (4243us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143765.736434:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13544 00000100:00100000:2.0:1746143765.737686:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594243072 00000100:00100000:2.0:1746143765.737693:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594243072 00002000:00100000:2.0:1746143765.737725:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2338816->2342911) req@ffff88008efaf480 x1830963594243072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.737733:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaf480 with x1830963594243072 ext(2338816->2342911) 00002000:00010000:2.0:1746143765.737736:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaf480 00000100:00100000:2.0:1746143765.737759:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6367 00000100:00100000:2.0:1746143765.737765:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594243072:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143765.737884:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594243072:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 119us (1969us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143765.737889:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6367 00002000:00100000:2.0:1746143765.737894:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2338816->2342911) req@ffff88008efaf480 x1830963594243072/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.738211:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaf480 with x1830963594243072 ext(2338816->2342911) 00002000:00010000:2.0:1746143765.738215:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaf480 00000100:00100000:0.0:1746143765.738405:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.738609:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594243328 00000100:00100000:2.0:1746143765.738612:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594243328 00000100:00100000:2.0:1746143765.738634:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9216 00000100:00100000:2.0:1746143765.738638:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31390:x1830963594243328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.738649:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.738660:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd7301db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bd0 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.738749:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738761:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738770:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738779:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738784:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738788:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738884:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738896:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738902:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143765.738911:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143765.738986:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738991:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.738996:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739001:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f4400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.739005:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739010:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739017:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143765.739020:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.739022:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739026:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd7301e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739034:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739042:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739046:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739049:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f4c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.739051:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739055:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739060:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484900) 00010000:00010000:2.0:1746143765.739062:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.739064:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739068:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd7301e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143765.739099:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd7301db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bd0 expref: 250 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.739107:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bd0 expref: 249 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.739112:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.739113:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143765.739115:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f5c00, rc 0) 00000100:00100000:2.0:1746143765.739136:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31390:x1830963594243328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 498us (732us total) trans 8589943545 rc 0/0 00000100:00100000:2.0:1746143765.739161:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9216 00000100:00100000:0.0:1746143765.744412:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.744496:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.744552:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594243584 00000100:00100000:1.0:1746143765.744559:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594243584 00000100:00100000:1.0:1746143765.744616:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 734 00000100:00100000:1.0:1746143765.744622:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1964:x1830963594243584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.744633:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.744653:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd7301f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bd0 expref: 249 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.744866:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.744881:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594243840 00000100:00100000:0.0:1746143765.744884:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594243840 00000100:00100000:2.0:1746143765.745462:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594243712 00000100:00100000:2.0:1746143765.745466:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594243712 00002000:00100000:2.0:1746143765.745491:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009c3fb480 x1830963594243712/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.745499:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830963594243712 ext(0->1048575) 00002000:00010000:2.0:1746143765.745503:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fb480 00000100:00100000:2.0:1746143765.745521:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6368 00000100:00100000:2.0:1746143765.745526:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594243712:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143765.745880:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13545 00000100:00100000:0.0:1746143765.745887:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594243840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143765.745895:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.745907:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd7301fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bd7 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.745944:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594380672:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143765.746008:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.746092:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143765.746305:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.746308:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.746330:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1964:x1830963594243584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1708us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.746337:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 734 00000100:00100000:1.0:1746143765.746355:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594244096 00000100:00100000:1.0:1746143765.746358:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594244096 00000100:00100000:1.0:1746143765.746371:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13546 00000100:00100000:1.0:1746143765.746375:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31382:x1830963594244096:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.746380:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.746386:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7be5 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.746399:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.746411:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.746412:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.746415:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3153919] (req 3145728->3153919) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.746429:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 16 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.746438:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 16 pid: 21542 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.746445:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594380800:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.746469:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.748585:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.748662:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594243968 00000100:00100000:3.0:1746143765.748669:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594243968 00000100:00100000:3.0:1746143765.748704:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9217 00000100:00100000:3.0:1746143765.748709:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31391:x1830963594243968:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143765.748725:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.748737:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73020c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bde expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.748786:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748795:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748804:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748814:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748818:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748822:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748906:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748914:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 247 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.748920:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.748943:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 247 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.748952:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 247 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.748962:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594380928:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.749008:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51390c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143765.750891:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143764 -> 1746143765 00000100:00100000:1.0:1746143765.750909:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594380672:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143765.750932:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd7301fe lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bd7 expref: 20 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.750942:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd7301fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bd7 expref: 20 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.750951:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba31e00, rc 0) 00000100:00100000:1.0:1746143765.750980:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594243840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5094us (6114us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143765.750987:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13545 00000100:00100000:1.0:1746143765.753578:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594380800:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.753609:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->3153919] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.753623:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b51fd600, rc 0) 00000100:00100000:1.0:1746143765.753660:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31382:x1830963594244096:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7283us (7567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.753668:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13546 00000100:00100000:3.0:1746143765.754923:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594380928:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.754940:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:3.0:1746143765.755447:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.756201:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594244224 00000100:00100000:1.0:1746143765.756209:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594244224 00010000:00010000:1.0:1746143765.756234:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 248 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.756265:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7245 00000100:00100000:1.0:1746143765.756272:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1964:x1830963594244224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.756282:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.756287:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 248 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.756295:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 248 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.756311:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129dc0000/0xe984082ccd7300c3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b1a expref: 248 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.756330:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.756334:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.756342:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.756348:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.756996:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.757042:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1964:x1830963594244224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 770us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.757048:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7245 00010000:00010000:2.0:1746143765.757241:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757248:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143765.757286:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:2.0:1746143765.757290:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143765.757304:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757313:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757320:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757325:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757329:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757334:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e0000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.757337:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757342:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757349:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143765.757351:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.757353:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757356:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757370:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757373:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757377:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757379:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e1e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.757381:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757385:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757389:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442300) 00010000:00010000:2.0:1746143765.757391:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.757393:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757396:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1e00/0xe984082ccd73021a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.757426:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0600/0xe984082ccd73020c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.757435:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.757440:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.757441:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143765.757443:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1600, rc 0) 00000100:00100000:2.0:1746143765.757468:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31391:x1830963594243968:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 8759us (8888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.757474:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9217 00000100:00100000:2.0:1746143765.759261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.759347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.759366:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594244864 00000100:00100000:2.0:1746143765.759371:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594244864 00000100:00100000:2.0:1746143765.759400:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9218 00000100:00100000:2.0:1746143765.759405:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31393:x1830963594244864:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143765.759422:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.759434:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd730228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bec expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.759520:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759529:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759535:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759544:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759548:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759553:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759634:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759641:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759647:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143765.759654:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143765.759725:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759730:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759734:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759741:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f5800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.759744:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759748:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759756:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143765.759758:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.759761:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759765:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5800/0xe984082ccd73022f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143765.759771:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143765.759774:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.759778:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00000100:00100000:3.0:1746143765.760047:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594244352 00000100:00100000:3.0:1746143765.760052:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594244352 00002000:00100000:3.0:1746143765.760076:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3272704->3416063) req@ffff88009cdc2d80 x1830963594244352/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.760084:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2d80 with x1830963594244352 ext(3272704->3416063) 00010000:00010000:3.0:1746143765.760091:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.760102:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.760108:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc2d80 00000100:00100000:3.0:1746143765.760125:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594244608 00000100:00100000:3.0:1746143765.760127:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594244608 00002000:00100000:3.0:1746143765.760158:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009c3fad80 x1830963594244608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.760169:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830963594244608 ext(0->1048575) 00002000:00010000:3.0:1746143765.760172:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:3.0:1746143765.760194:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1804 00000100:00100000:3.0:1746143765.760199:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594244352:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143765.760374:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6369 00000100:00100000:3.0:1746143765.760379:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594244608:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143765.760683:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.760688:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f4c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143765.760690:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.760695:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.760702:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484300) 00010000:00010000:2.0:1746143765.760705:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143765.760707:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.760711:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4c00/0xe984082ccd730236 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.760744:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f5c00/0xe984082ccd730228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.760754:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.760760:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.760761:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143765.760763:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f4400, rc 0) 00000100:00100000:2.0:1746143765.760787:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31393:x1830963594244864:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1382us (1440us total) trans 8589943546 rc 0/0 00000100:00100000:2.0:1746143765.760793:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9218 00000100:00100000:2.0:1746143765.760966:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594243712:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15439us (16469us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.760972:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6368 00002000:00100000:2.0:1746143765.760977:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009c3fb480 x1830963594243712/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.760984:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb480 with x1830963594243712 ext(0->1048575) 00002000:00010000:2.0:1746143765.760987:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fb480 00000100:00100000:0.0:1746143765.762596:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.763642:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.763712:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594244992 00000100:00100000:1.0:1746143765.763719:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594244992 00000100:00100000:1.0:1746143765.763763:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594245120 00000100:00100000:1.0:1746143765.763765:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594245120 00000100:00100000:1.0:1746143765.763780:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13547 00000100:00100000:1.0:1746143765.763785:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594244992:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143765.763798:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.763810:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5792000/0xe984082ccd73024b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bf3 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.763849:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594381056:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143765.763903:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.763920:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13548 00000100:00100000:1.0:1746143765.763925:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594245120:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143765.763932:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.763939:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd730252 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7bfa expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.763965:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594381184:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143765.763984:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.766237:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594244352:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6032us (6975us total) trans 21474840459 rc 0/0 00000100:00100000:2.0:1746143765.766247:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1804 00002000:00100000:2.0:1746143765.766256:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3272704->3416063) req@ffff88009cdc2d80 x1830963594244352/t21474840459(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.766265:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2d80 with x1830963594244352 ext(3272704->3416063) 00010000:00010000:2.0:1746143765.766272:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.766284:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00002000:00010000:2.0:1746143765.766290:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cdc2d80 00000100:00100000:1.0:1746143765.768199:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594381056:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143765.768226:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594381184:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143765.768229:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5792000/0xe984082ccd73024b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bf3 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.768240:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd730252 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bfa expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.768240:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5792000/0xe984082ccd73024b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bf3 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.768247:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5793800/0xe984082ccd730252 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bfa expref: 11 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.768250:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792000, rc 0) 00010000:00010000:2.0:1746143765.768253:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5793800, rc 0) 00000100:00100000:2.0:1746143765.768289:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594245120:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4363us (4647us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143765.768289:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594244992:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4503us (5695us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143765.768296:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13548 00000100:00100000:1.0:1746143765.768299:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13547 00010000:00010000:2.0:1746143765.775375:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143765.780801:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.780843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.780844:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594245504 00000100:00100000:3.0:1746143765.780852:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594245504 00000100:00100000:3.0:1746143765.780888:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9219 00000100:00100000:3.0:1746143765.780895:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31391:x1830963594245504:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143765.780910:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.780925:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb5a00/0xe984082ccd730259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c08 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781003:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.781016:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781022:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781033:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.781061:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781070:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 14 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.781079:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594381312:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.781171:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781178:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 8 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.781204:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594381440:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.781225:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.781573:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594244608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21192us (21802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.781581:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6369 00000100:00100000:3.0:1746143765.781582:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594245248 00000100:00100000:3.0:1746143765.781586:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594245248 00002000:00100000:2.0:1746143765.781589:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009c3fad80 x1830963594244608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.781598:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fad80 with x1830963594244608 ext(0->1048575) 00002000:00010000:2.0:1746143765.781601:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fad80 00000100:00100000:3.0:1746143765.781878:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13549 00000100:00100000:3.0:1746143765.781884:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31388:x1830963594245248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.781892:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.781901:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c01 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781917:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.781918:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.781922:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781935:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.781944:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1e00, rc 0) 00000100:00100000:3.0:1746143765.781977:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31388:x1830963594245248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.781982:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13549 00000100:00100000:0.0:1746143765.783244:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.783265:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594245632 00000100:00100000:2.0:1746143765.783269:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594245632 00010000:00010000:2.0:1746143765.783289:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 19 pid: 21542 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.783307:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7246 00000100:00100000:2.0:1746143765.783312:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594245632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.783319:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.783334:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 19 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.783342:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 19 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.783357:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346800/0xe984082ccd7301a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3272704->3416063) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bb4 expref: 19 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.783366:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.783367:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.783372:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.783379:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.783390:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.783392:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.783394:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.783401:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.783419:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.783428:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594381568:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.783500:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.783508:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594381696:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.783622:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.784288:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594381312:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.784297:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594381440:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.784316:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143765.786253:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594381568:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143765.787718:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.787732:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.787742:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.787786:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.787816:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594246272 00000100:00100000:1.0:1746143765.787821:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594246272 00000100:00100000:1.0:1746143765.787855:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13550 00000100:00100000:1.0:1746143765.787860:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31393:x1830963594246272:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.787874:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.787888:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c0f expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.787909:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.787921:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.787927:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.787933:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.787935:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.787938:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1884160->2097151] (req 1884160->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.787957:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594381696:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143765.787960:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.787969:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.787971:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.787979:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594381824:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.787999:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594245632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4686us (4757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.788006:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7246 00000100:00100000:2.0:1746143765.788019:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594246016 00010000:00010000:1.0:1746143765.788020:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.788022:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594246016 00010000:00010000:1.0:1746143765.788027:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 28 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.788033:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.788034:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594381952:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.788045:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594246144 00000100:00100000:2.0:1746143765.788047:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594246144 00010000:00010000:1.0:1746143765.788052:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.788053:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.788060:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.788065:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7247 00000100:00100000:1.0:1746143765.788067:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594382080:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143765.788070:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594246016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.788078:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143765.788080:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143765.788083:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.788091:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.788094:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7248 00000100:00100000:1.0:1746143765.788099:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594246144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.788105:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.788106:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f4400/0xe984082ccd73023d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bec expref: 15 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.788110:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.788117:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.788415:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143765.788420:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.788427:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143765.788432:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143765.788441:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e1600/0xe984082ccd730221 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bde expref: 9 pid: 14762 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.788451:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594246016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 381us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.788457:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7247 00010000:00010000:1.0:1746143765.788466:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143765.788469:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143765.788476:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594245888 00010000:00010000:1.0:1746143765.788476:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143765.788478:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594245888 00010000:00010000:1.0:1746143765.788481:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143765.788495:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746143765.788499:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3149824->3153919) req@ffff88009c3f9180 x1830963594245888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143765.788504:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00002000:00100000:2.0:1746143765.788507:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830963594245888 ext(3149824->3153919) 00000100:00100000:1.0:1746143765.788510:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594246144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 411us (766us total) trans 0 rc 0/0 00002000:00010000:2.0:1746143765.788511:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9180 00010000:00010000:3.0:1746143765.788513:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143765.788516:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7248 00000100:00100000:2.0:1746143765.788522:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6370 00000100:00100000:2.0:1746143765.788526:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594245888:12345-192.168.202.48@tcp:3:cat.0 00000004:00200000:3.0:1746143765.788530:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143765.788635:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb5a00/0xe984082ccd730259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c08 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.788650:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c08 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.788657:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.788659:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143765.788662:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdb4800, rc 0) 00000100:00100000:2.0:1746143765.790100:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594245888:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1569us (2381us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143765.790108:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6370 00002000:00100000:2.0:1746143765.790115:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3149824->3153919) req@ffff88009c3f9180 x1830963594245888/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.790124:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9180 with x1830963594245888 ext(3149824->3153919) 00002000:00010000:2.0:1746143765.790127:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3f9180 00000100:00100000:3.0:1746143765.790493:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31391:x1830963594245504:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 9597us (9696us total) trans 8589943547 rc 0/0 00000100:00100000:3.0:1746143765.790501:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9219 00000100:00100000:0.0:1746143765.790766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.791022:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594381824:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.791035:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594381952:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.791042:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594382080:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.791068:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1884160->2097151] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.791080:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5806600, rc 0) 00000100:00100000:1.0:1746143765.791104:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31393:x1830963594246272:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3244us (3317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.791111:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13550 00000100:00100000:1.0:1746143765.791129:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594246400 00000100:00100000:1.0:1746143765.791133:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594246400 00010000:00010000:1.0:1746143765.791159:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143765.792062:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7249 00000100:00100000:1.0:1746143765.792071:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594246400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.792085:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.792102:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.792116:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.792132:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7f6400/0xe984082ccd72fff1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7adb expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.792169:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.792204:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594246400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 135us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.792210:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7249 00000100:00100000:0.0:1746143765.792420:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.792438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.792455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.792466:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594246912 00000100:00100000:0.0:1746143765.792469:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594246912 00000100:00100000:2.0:1746143765.792505:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594246656 00000100:00100000:1.0:1746143765.792506:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594246784 00000100:00100000:2.0:1746143765.792509:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594246656 00000100:00100000:1.0:1746143765.792509:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594246784 00010000:00010000:1.0:1746143765.792519:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 944 lvb_type: 0 00002000:00100000:2.0:1746143765.792529:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305c8e00 x1830963594246656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143765.792532:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7250 00000100:00100000:1.0:1746143765.792536:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594246784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746143765.792538:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8e00 with x1830963594246656 ext(2097152->3145727) 00002000:00010000:2.0:1746143765.792541:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8e00 00010000:00010000:1.0:1746143765.792542:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.792547:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.792554:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.792564:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6371 00010000:00010000:1.0:1746143765.792564:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61fe200/0xe984082ccd73011e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b67 expref: 17 pid: 9527 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.792570:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594246656:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:1.0:1746143765.792571:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.792585:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594246784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.792589:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7250 00010000:00010000:0.0:1746143765.792936:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 29 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.792948:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7251 00000100:00100000:0.0:1746143765.792952:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594246912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.792957:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143765.792964:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 29 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.792971:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 29 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.792980:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7eac00/0xe984082ccd730125 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b6e expref: 29 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.792999:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.793001:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.793006:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.793012:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.793034:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.793050:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594382208:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143765.793088:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.793116:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.793865:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594247168 00000100:00100000:0.0:1746143765.793869:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594247168 00000100:00100000:0.0:1746143765.793888:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3963 00000100:00100000:0.0:1746143765.793893:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6456850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31382:x1830963594247168:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143765.793900:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.794010:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594247424 00000100:00100000:3.0:1746143765.794015:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594247424 00000100:00100000:1.0:1746143765.794032:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.794044:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9220 00000100:00100000:1.0:1746143765.794045:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594247552 00000100:00100000:1.0:1746143765.794047:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594247552 00000100:00100000:3.0:1746143765.794049:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31391:x1830963594247424:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143765.794058:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.794060:0:2976:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1746143765.794063:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13551 00000100:00100000:1.0:1746143765.794067:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31390:x1830963594247552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.794073:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cdb4800/0xe984082ccd730260 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c08 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.794073:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.794081:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c1d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.794083:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6456850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31382:x1830963594247168:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 188us (965us total) trans 8589943548 rc 0/0 00010000:00010000:3.0:1746143765.794084:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.794088:0:2976:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.794089:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3963 00010000:00010000:1.0:1746143765.794093:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.794095:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730283 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c16 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.794104:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.794106:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143765.794108:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.794122:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 15 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.794130:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 15 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.794152:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594382336:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.794304:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00010000:00010000:3.0:1746143765.794355:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794364:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794370:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794381:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794386:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794391:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794396:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e0800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.794399:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794404:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794410:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.794412:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143765.794415:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794419:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0800/0xe984082ccd73028a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143765.794438:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730283 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c16 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.794444:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0000/0xe984082ccd730283 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c16 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.794449:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0000, rc 0) 00000100:00100000:3.0:1746143765.794467:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31391:x1830963594247424:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 418us (567us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143765.794473:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9220 00000100:00100000:0.0:1746143765.794814:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594382208:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143765.794823:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.794836:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594246912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1883us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.794842:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7251 00000100:00100000:0.0:1746143765.794883:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.795660:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594247808 00000100:00100000:3.0:1746143765.795664:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594247808 00002000:00100000:3.0:1746143765.795682:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1884160->1888255) req@ffff8801305cad80 x1830963594247808/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.795691:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cad80 with x1830963594247808 ext(1884160->1888255) 00010000:00010000:3.0:1746143765.795696:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.795707:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.795712:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305cad80 00000100:00100000:3.0:1746143765.795722:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1805 00000100:00100000:3.0:1746143765.795726:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594247808:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.795806:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594247808:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 79us (923us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.795811:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1805 00002000:00100000:3.0:1746143765.795815:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1884160->1888255) req@ffff8801305cad80 x1830963594247808/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.795821:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cad80 with x1830963594247808 ext(1884160->1888255) 00010000:00010000:3.0:1746143765.795825:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.795832:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.795837:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305cad80 00000100:00100000:1.0:1746143765.801492:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594382336:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.801520:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 29 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.801535:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5792c00, rc 0) 00000100:00100000:1.0:1746143765.801572:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31390:x1830963594247552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7503us (7538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.801579:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13551 00000100:00100000:2.0:1746143765.802219:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594246656:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 9647us (9796us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.802227:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6371 00002000:00100000:2.0:1746143765.802235:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305c8e00 x1830963594246656/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.802244:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8e00 with x1830963594246656 ext(2097152->3145727) 00002000:00010000:2.0:1746143765.802249:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8e00 00000100:00100000:1.0:1746143765.802426:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.802517:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594248064 00000100:00100000:0.0:1746143765.802523:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594248064 00000100:00100000:0.0:1746143765.802550:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3964 00000100:00100000:0.0:1746143765.802556:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31391:x1830963594248064:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143765.802694:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31391:x1830963594248064:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 138us (270us total) trans 8589943549 rc 0/0 00000100:00100000:0.0:1746143765.802700:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3964 00000100:00100000:0.0:1746143765.804926:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.805273:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.805356:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594248320 00000100:00100000:1.0:1746143765.805362:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594248320 00000100:00100000:1.0:1746143765.805394:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13552 00000100:00100000:1.0:1746143765.805400:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31393:x1830963594248320:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143765.805413:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.805427:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c24 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.805450:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.805458:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.805467:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.805472:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.805473:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.805476:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1204223] (req 1048576->1204223) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143765.805492:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594248448 00000100:00100000:3.0:1746143765.805495:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594248448 00010000:00010000:1.0:1746143765.805499:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.805507:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 19 pid: 8495 timeout: 944 lvb_type: 0 00002000:00100000:3.0:1746143765.805517:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1884160->2097151) req@ffff8801305ca680 x1830963594248448/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143765.805517:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594382464:192.168.202.48@tcp:104: 00002000:00100000:3.0:1746143765.805525:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca680 with x1830963594248448 ext(1884160->2097151) 00010000:00010000:3.0:1746143765.805530:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.805537:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 16 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.805542:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305ca680 00000100:00100000:3.0:1746143765.805555:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1806 00000100:00100000:3.0:1746143765.805559:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594248448:12345-192.168.202.48@tcp:4:multiop.0 00010000:00010000:1.0:1746143765.805579:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.805585:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 17 pid: 21542 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.805592:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594382592:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143765.805613:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.805624:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 9 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143765.805631:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594382720:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143765.805643:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.809429:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.809444:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.809467:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.809485:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594248576 00000100:00100000:1.0:1746143765.809491:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594248576 00010000:00010000:1.0:1746143765.809520:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:1.0:1746143765.809540:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594248704 00000100:00100000:1.0:1746143765.809542:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594248704 00010000:00010000:1.0:1746143765.809551:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.809561:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594248832 00000100:00100000:1.0:1746143765.809563:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594248832 00010000:00010000:1.0:1746143765.809570:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 20 pid: 8495 timeout: 944 lvb_type: 0 00000100:00100000:1.0:1746143765.809583:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7252 00000100:00100000:1.0:1746143765.809589:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594248576:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.809598:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.809616:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.809625:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00010000:00010000:1.0:1746143765.809645:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.809790:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7253 00000100:00100000:3.0:1746143765.809796:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594248704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143765.809802:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143765.809811:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.809818:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.809828:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.809900:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594382464:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.809912:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f9d0c00/0xe984082ccd73013a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b83 expref: 18 pid: 21542 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.809926:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594382592:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.809934:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7f7600/0xe984082ccd72ffff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ae2 expref: 10 pid: 4582 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.809941:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594382720:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143765.809962:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->1204223] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.809971:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08200, rc 0) 00000100:00100000:1.0:1746143765.810507:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594248576:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 917us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.810514:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7252 00000100:00100000:1.0:1746143765.810529:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7254 00000100:00100000:1.0:1746143765.810535:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594248832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.810541:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.810549:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 20 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.810557:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 20 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.810568:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27200/0xe984082ccd730133 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b7c expref: 20 pid: 8495 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.810581:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.810582:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.810588:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.810600:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.810623:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.810633:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594382848:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143765.810706:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594248704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 910us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.810716:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7253 00000100:00100000:3.0:1746143765.811408:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594248448:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5846us (6134us total) trans 17179873138 rc 0/0 00000100:00100000:3.0:1746143765.811415:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1806 00002000:00100000:3.0:1746143765.811421:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1884160->2097151) req@ffff8801305ca680 x1830963594248448/t17179873138(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.811430:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca680 with x1830963594248448 ext(1884160->2097151) 00010000:00010000:3.0:1746143765.811436:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 18 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.811446:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 18 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.811452:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305ca680 00000100:00100000:2.0:1746143765.811571:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31393:x1830963594248320:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6170us (6648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.811577:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13552 00000100:00100000:2.0:1746143765.811703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.811989:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.812484:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594248960 00000100:00100000:3.0:1746143765.812489:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594248960 00000100:00100000:3.0:1746143765.813159:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13553 00000100:00100000:3.0:1746143765.813167:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31388:x1830963594248960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.813179:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.813200:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c2b expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.813220:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 28 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.813233:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.813235:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.813238:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.813259:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 28 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.813269:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 28 pid: 21542 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.813279:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594382976:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.814128:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.814671:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594382848:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143765.814689:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143765.814712:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594248832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4177us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.814720:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7254 00000100:00100000:1.0:1746143765.814810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.814936:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.814975:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594249344 00000100:00100000:3.0:1746143765.814980:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594249344 00002000:00100000:3.0:1746143765.815006:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1200128->1204223) req@ffff88008f3cad80 x1830963594249344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.815016:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cad80 with x1830963594249344 ext(1200128->1204223) 00002000:00010000:3.0:1746143765.815019:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cad80 00000100:00100000:3.0:1746143765.815032:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6372 00000100:00100000:3.0:1746143765.815037:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594249344:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.815167:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594249344:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 129us (356us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.815173:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6372 00002000:00100000:3.0:1746143765.815179:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1200128->1204223) req@ffff88008f3cad80 x1830963594249344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.815196:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cad80 with x1830963594249344 ext(1200128->1204223) 00002000:00010000:3.0:1746143765.815199:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cad80 00000100:00100000:0.0:1746143765.815498:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594249088 00000100:00100000:0.0:1746143765.815501:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594249088 00010000:00010000:0.0:1746143765.815517:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:0.0:1746143765.815543:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7255 00000100:00100000:0.0:1746143765.815548:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594249088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143765.815555:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143765.815567:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143764 -> 1746143765 00002000:00010000:0.0:1746143765.815570:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143764 -> 1746143765 00010000:00010000:0.0:1746143765.815573:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.815582:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.815598:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806600/0xe984082ccd73026e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c0f expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:0.0:1746143765.815611:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.815613:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.815619:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.815625:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.815648:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 28 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143765.815656:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594383104:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143765.815704:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.819681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.819934:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594383104:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143765.819952:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143765.820075:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594382976:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.820096:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.820110:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0600, rc 0) 00000100:00100000:1.0:1746143765.820221:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594249728 00000100:00100000:1.0:1746143765.820226:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594249728 00000100:00100000:1.0:1746143765.820260:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3965 00000100:00100000:1.0:1746143765.820266:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31393:x1830963594249728:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143765.820447:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594249088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4897us (5509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.820454:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7255 00000100:00100000:3.0:1746143765.820563:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31388:x1830963594248960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7395us (8859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.820568:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13553 00000100:00100000:1.0:1746143765.820948:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31393:x1830963594249728:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 681us (1274us total) trans 8589943550 rc 0/0 00000100:00100000:1.0:1746143765.820954:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3965 00000100:00100000:0.0:1746143765.821010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.821379:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.821913:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594249472 00000100:00100000:3.0:1746143765.821917:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594249472 00002000:00100000:3.0:1746143765.821939:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2338816->3145727) req@ffff8801305c9180 x1830963594249472/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.821948:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9180 with x1830963594249472 ext(2338816->3145727) 00010000:00010000:3.0:1746143765.821954:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 29 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.821963:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 29 pid: 21542 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.821969:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305c9180 00000100:00100000:3.0:1746143765.821979:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594249984 00000100:00100000:3.0:1746143765.821981:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594249984 00002000:00100000:3.0:1746143765.821988:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8801305c9500 x1830963594249984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.821994:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9500 with x1830963594249984 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.821997:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c9500 00000100:00100000:3.0:1746143765.822004:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1807 00000100:00100000:3.0:1746143765.822008:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594249472:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143765.822631:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6373 00000100:00100000:1.0:1746143765.822637:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594249984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143765.833646:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594249984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11001us (12259us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.833656:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6373 00002000:00100000:1.0:1746143765.833666:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8801305c9500 x1830963594249984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.833675:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9500 with x1830963594249984 ext(1048576->2097151) 00002000:00010000:1.0:1746143765.833679:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c9500 00000100:00100000:3.0:1746143765.838200:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594249472:12345-192.168.202.48@tcp:4:cat.0 Request processed in 16173us (17172us total) trans 17179873139 rc 0/0 00000100:00100000:3.0:1746143765.838211:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1807 00002000:00100000:3.0:1746143765.838220:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2338816->3145727) req@ffff8801305c9180 x1830963594249472/t17179873139(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.838229:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9180 with x1830963594249472 ext(2338816->3145727) 00010000:00010000:3.0:1746143765.838237:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 31 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.838251:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 31 pid: 21542 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.838257:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305c9180 00000100:00100000:0.0:1746143765.839260:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.839350:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594250112 00000100:00100000:3.0:1746143765.839356:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594250112 00000100:00100000:3.0:1746143765.840197:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13554 00000100:00100000:3.0:1746143765.840206:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31390:x1830963594250112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.840220:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.840234:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c32 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.840259:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.840265:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.840266:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.840269:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.840293:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.840303:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 17 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.840313:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594383232:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.840390:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143765.843205:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.843355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.843371:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594383232:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.843397:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 18 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.843412:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1800, rc 0) 00000100:00100000:3.0:1746143765.843447:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31390:x1830963594250112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3243us (4189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.843454:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13554 00000100:00100000:3.0:1746143765.843481:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594250368 00000100:00100000:3.0:1746143765.843486:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594250368 00002000:00100000:3.0:1746143765.843511:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1204223) req@ffff8801305c8700 x1830963594250368/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.843520:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8700 with x1830963594250368 ext(1048576->1204223) 00010000:00010000:3.0:1746143765.843525:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 18 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.843531:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594250240 00010000:00010000:3.0:1746143765.843535:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 18 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.843536:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594250240 00002000:00010000:3.0:1746143765.843541:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305c8700 00010000:00010000:2.0:1746143765.843555:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 31 pid: 21542 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.843556:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1808 00000100:00100000:3.0:1746143765.843561:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594250368:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143765.843573:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7256 00000100:00100000:2.0:1746143765.843578:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594250240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.843588:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.843604:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 31 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.843613:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 31 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.843629:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346c00/0xe984082ccd7301aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2338816->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bbb expref: 31 pid: 21542 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.843641:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.843643:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.843648:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.843655:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.843677:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.843690:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594383360:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.843726:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.849723:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594383360:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.849742:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.849776:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594250240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6197us (6576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.849785:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7256 00000100:00100000:3.0:1746143765.850503:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594250368:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 6939us (7146us total) trans 21474840460 rc 0/0 00000100:00100000:3.0:1746143765.850511:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1808 00002000:00100000:3.0:1746143765.850520:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1204223) req@ffff8801305c8700 x1830963594250368/t21474840460(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.850528:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8700 with x1830963594250368 ext(1048576->1204223) 00010000:00010000:3.0:1746143765.850538:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.850549:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.850559:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305c8700 00000100:00100000:0.0:1746143765.851975:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.852369:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594250624 00000100:00100000:3.0:1746143765.852376:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594250624 00002000:00100000:3.0:1746143765.852411:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8801305cbb80 x1830963594250624/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.852417:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cbb80 with x1830963594250624 ext(2097152->3145727) 00002000:00010000:3.0:1746143765.852421:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cbb80 00000100:00100000:3.0:1746143765.853496:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6374 00000100:00100000:3.0:1746143765.853504:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594250624:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143765.855243:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.855407:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594250752 00000100:00100000:2.0:1746143765.855413:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594250752 00010000:00010000:2.0:1746143765.855440:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.855466:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7257 00000100:00100000:2.0:1746143765.855471:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594250752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.855481:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143765.855495:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143764 -> 1746143765 00002000:00010000:2.0:1746143765.855497:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143764 -> 1746143765 00010000:00010000:2.0:1746143765.855502:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.855513:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.855531:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730291 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1204223) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c24 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.855548:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.855550:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.855556:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.855562:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.855586:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.855596:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594383488:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.855655:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.860366:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594383488:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.860386:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.860433:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594250752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4959us (5194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.860442:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7257 00000100:00100000:3.0:1746143765.862392:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594250624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8882us (10415us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143765.862393:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.862402:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6374 00002000:00100000:3.0:1746143765.862492:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8801305cbb80 x1830963594250624/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.862501:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cbb80 with x1830963594250624 ext(2097152->3145727) 00002000:00010000:3.0:1746143765.862506:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cbb80 00000100:00100000:3.0:1746143765.862520:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594251008 00000100:00100000:3.0:1746143765.862525:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594251008 00002000:00100000:3.0:1746143765.862547:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305c9c00 x1830963594251008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.862553:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9c00 with x1830963594251008 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.862555:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9c00 00000100:00100000:3.0:1746143765.862576:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6375 00000100:00100000:3.0:1746143765.862583:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594251008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143765.868916:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.868999:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594251136 00000100:00100000:3.0:1746143765.869007:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594251136 00000100:00100000:3.0:1746143765.869056:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13555 00000100:00100000:3.0:1746143765.869063:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31388:x1830963594251136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143765.869078:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.869091:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c39 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.869116:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.869123:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.869124:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143765.869127:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.869175:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.869202:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 19 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.869213:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594383616:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.869282:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.874250:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594251008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11658us (11855us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.874265:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6375 00002000:00100000:3.0:1746143765.874275:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305c9c00 x1830963594251008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.874284:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9c00 with x1830963594251008 ext(1048576->2097151) 00002000:00010000:3.0:1746143765.874290:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9c00 00000100:00100000:0.0:1746143765.876277:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.876418:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594383616:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.876443:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.876458:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13400, rc 0) 00000100:00100000:3.0:1746143765.876492:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31388:x1830963594251136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7429us (7582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.876499:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13555 00000100:00100000:3.0:1746143765.876526:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594251264 00000100:00100000:3.0:1746143765.876531:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594251264 00002000:00100000:3.0:1746143765.876555:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3153919) req@ffff8801305ca300 x1830963594251264/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 8680/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.876562:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca300 with x1830963594251264 ext(3145728->3153919) 00010000:00010000:3.0:1746143765.876568:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 18 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.876579:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 18 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.876589:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305ca300 00000100:00100000:3.0:1746143765.876604:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1809 00000100:00100000:3.0:1746143765.876609:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594251264:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143765.876893:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594251264:12345-192.168.202.48@tcp:4:cat.0 Request processed in 283us (620us total) trans 21474840461 rc 0/0 00000100:00100000:3.0:1746143765.876899:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1809 00002000:00100000:3.0:1746143765.876904:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3153919) req@ffff8801305ca300 x1830963594251264/t21474840461(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 8680/448 e 0 to 0 dl 1746143776 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.876911:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305ca300 with x1830963594251264 ext(3145728->3153919) 00010000:00010000:3.0:1746143765.876916:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:3.0:1746143765.876925:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00002000:00010000:3.0:1746143765.876930:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305ca300 00000100:00100000:0.0:1746143765.882756:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.882849:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594251392 00000100:00100000:2.0:1746143765.882857:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594251392 00010000:00010000:2.0:1746143765.882889:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.882923:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7258 00000100:00100000:2.0:1746143765.882930:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594251392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.882942:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.882961:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.882971:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.882988:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b51fd600/0xe984082ccd730205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3153919) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7be5 expref: 20 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:2.0:1746143765.883006:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.883008:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.883014:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.883022:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.883051:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 19 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143765.883060:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594383744:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143765.883161:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143765.883812:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.883834:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.883879:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594251520 00000100:00100000:1.0:1746143765.883883:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594251520 00000100:00100000:1.0:1746143765.883909:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594251648 00000100:00100000:1.0:1746143765.883911:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594251648 00000100:00100000:1.0:1746143765.883925:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13556 00000100:00100000:1.0:1746143765.883929:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594251520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143765.883940:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.883949:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c40 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.883960:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.883962:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.883966:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.883975:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.883981:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095395e00, rc 0) 00000100:00100000:1.0:1746143765.887551:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594251520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3613us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.887561:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13556 00000100:00100000:1.0:1746143765.887588:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13557 00000100:00100000:1.0:1746143765.887598:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594251648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143765.887613:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143765.887627:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c47 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.887644:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.887645:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.887652:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 31 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.887663:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 31 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143765.887672:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095394400, rc 0) 00000100:00100000:1.0:1746143765.887688:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594251648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 95us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.887693:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13557 00000100:00100000:1.0:1746143765.888237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.888283:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.888325:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594252160 00000100:00100000:3.0:1746143765.888332:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594252160 00002000:00100000:3.0:1746143765.888357:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f3c9500 x1830963594252160/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.888366:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9500 with x1830963594252160 ext(3145728->4194303) 00002000:00010000:3.0:1746143765.888370:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9500 00000100:00100000:3.0:1746143765.888389:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6376 00000100:00100000:3.0:1746143765.888395:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594252160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143765.888445:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594252032 00000100:00100000:1.0:1746143765.888449:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594252032 00002000:00100000:1.0:1746143765.888465:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f3cb480 x1830963594252032/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.888472:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb480 with x1830963594252032 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.888474:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb480 00000100:00100000:1.0:1746143765.888485:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6377 00000100:00100000:1.0:1746143765.888489:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594252032:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143765.888918:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594383744:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143765.888933:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.888954:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594251392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6025us (6207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.888960:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7258 00000100:00100000:0.0:1746143765.902004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.902326:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594252416 00000100:00100000:2.0:1746143765.902334:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594252416 00000100:00100000:0.0:1746143765.902338:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.902358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143765.902369:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305c8000 x1830963594252416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.902379:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8000 with x1830963594252416 ext(2097152->3145727) 00002000:00010000:2.0:1746143765.902383:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8000 00000100:00100000:0.0:1746143765.902387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.902398:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594252672 00000100:00100000:2.0:1746143765.902400:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594252672 00002000:00100000:2.0:1746143765.902409:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8801305cb480 x1830963594252672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.902416:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb480 with x1830963594252672 ext(3145728->4194303) 00002000:00010000:2.0:1746143765.902418:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305cb480 00000100:00100000:3.0:1746143765.902419:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594252928 00000100:00100000:3.0:1746143765.902423:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594252928 00000100:00100000:2.0:1746143765.902426:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594253184 00000100:00100000:2.0:1746143765.902428:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594253184 00002000:00100000:2.0:1746143765.902436:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009c3fb800 x1830963594253184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.902441:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c3fbb80 x1830963594252928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.902442:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963594253184 ext(3145728->4194303) 00002000:00010000:2.0:1746143765.902445:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00002000:00100000:3.0:1746143765.902448:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963594252928 ext(2097152->3145727) 00002000:00010000:3.0:1746143765.902451:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:1.0:1746143765.902452:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6378 00000100:00100000:2.0:1746143765.902456:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6379 00000100:00100000:2.0:1746143765.902460:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594252672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143765.902460:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594252416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143765.902472:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6380 00000100:00100000:2.0:1746143765.902476:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6381 00000100:00100000:3.0:1746143765.902478:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594253184:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143765.902481:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594252928:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143765.909169:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594252160:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 20764us (20923us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.909179:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6376 00002000:00100000:3.0:1746143765.909200:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f3c9500 x1830963594252160/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.909209:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9500 with x1830963594252160 ext(3145728->4194303) 00002000:00010000:3.0:1746143765.909214:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c9500 00000100:00100000:1.0:1746143765.914721:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594252032:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 26221us (26427us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.914732:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6377 00002000:00100000:1.0:1746143765.914742:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f3cb480 x1830963594252032/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.914750:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb480 with x1830963594252032 ext(3145728->4194303) 00002000:00010000:1.0:1746143765.914755:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb480 00000100:00100000:1.0:1746143765.924488:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.924762:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594253184:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22282us (22371us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143765.924771:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6380 00002000:00100000:3.0:1746143765.924780:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009c3fb800 x1830963594253184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.924788:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fb800 with x1830963594253184 ext(3145728->4194303) 00002000:00010000:3.0:1746143765.924793:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fb800 00000100:00100000:0.0:1746143765.925221:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594253312 00000100:00100000:0.0:1746143765.925227:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594253312 00000100:00100000:0.0:1746143765.925263:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13558 00000100:00100000:0.0:1746143765.925269:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594253312:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143765.925280:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143765.925294:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c4e expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143765.925311:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.925313:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143765.925319:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.925331:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143765.925341:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5546c00, rc 0) 00000100:00100000:0.0:1746143765.925369:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594253312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 100us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143765.925373:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13558 00000100:00100000:2.0:1746143765.925454:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594252928:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22971us (23094us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.925461:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6381 00002000:00100000:2.0:1746143765.925465:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c3fbb80 x1830963594252928/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.925472:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fbb80 with x1830963594252928 ext(2097152->3145727) 00002000:00010000:2.0:1746143765.925475:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fbb80 00000100:00100000:0.0:1746143765.927051:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.927527:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594253696 00000100:00100000:3.0:1746143765.927533:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594253696 00000100:00100000:3.0:1746143765.927644:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9221 00000100:00100000:3.0:1746143765.927651:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31399:x1830963594253696:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143765.927667:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.927680:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12c00/0xe984082ccd7302c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c5c expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.927769:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.927789:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.927797:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.927808:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.927813:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.927817:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928266:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928274:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928280:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143765.928287:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143765.928357:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928363:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928367:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928373:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf13a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.928376:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928381:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928389:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143765.928392:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.928395:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928399:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd7302c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928426:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928431:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928436:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928443:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf13e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143765.928445:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928449:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928455:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442c00) 00010000:00010000:3.0:1746143765.928457:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143765.928458:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928462:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143765.928492:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12c00/0xe984082ccd7302c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.928501:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 250 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.928507:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143765.928508:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143765.928510:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12000, rc 0) 00000100:00100000:3.0:1746143765.928552:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31399:x1830963594253696:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 902us (1505us total) trans 8589943551 rc 0/0 00000100:00100000:3.0:1746143765.928558:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9221 00000100:00100000:0.0:1746143765.930374:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.931021:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594253440 00000100:00100000:2.0:1746143765.931027:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594253440 00000100:00100000:2.0:1746143765.931073:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13559 00000100:00100000:2.0:1746143765.931079:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594253440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143765.931092:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143765.931631:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c55 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143765.931650:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.931651:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143765.931658:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 21 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.931669:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 21 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143765.931678:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba31600, rc 0) 00000100:00100000:2.0:1746143765.931892:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594253440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 813us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.931898:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13559 00000100:00100000:1.0:1746143765.932411:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594252416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29951us (30414us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143765.932418:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6378 00002000:00100000:1.0:1746143765.932426:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8801305c8000 x1830963594252416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143765.932434:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8000 with x1830963594252416 ext(2097152->3145727) 00002000:00010000:1.0:1746143765.932437:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8000 00000100:00100000:2.0:1746143765.935871:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594252672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 33402us (33524us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143765.935881:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6379 00002000:00100000:2.0:1746143765.935890:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8801305cb480 x1830963594252672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.935899:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb480 with x1830963594252672 ext(3145728->4194303) 00002000:00010000:2.0:1746143765.935903:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305cb480 00000100:00100000:0.0:1746143765.937730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.937947:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594253952 00000100:00100000:2.0:1746143765.937955:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594253952 00002000:00100000:2.0:1746143765.937991:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a0817b80 x1830963594253952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.937999:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0817b80 with x1830963594253952 ext(4194304->4771839) 00002000:00010000:2.0:1746143765.938003:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0817b80 00000100:00100000:2.0:1746143765.938034:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6382 00000100:00100000:2.0:1746143765.938041:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594253952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143765.943359:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594253952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5310us (5626us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143765.943369:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6382 00002000:00100000:2.0:1746143765.943379:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a0817b80 x1830963594253952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.943387:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0817b80 with x1830963594253952 ext(4194304->4771839) 00002000:00010000:2.0:1746143765.943391:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0817b80 00000100:00100000:0.0:1746143765.949417:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.949579:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594254208 00000100:00100000:2.0:1746143765.949586:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594254208 00002000:00100000:2.0:1746143765.949630:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a0815500 x1830963594254208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.949639:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0815500 with x1830963594254208 ext(4194304->4771839) 00002000:00010000:2.0:1746143765.949644:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0815500 00000100:00100000:0.0:1746143765.949714:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143765.949857:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6383 00000100:00100000:2.0:1746143765.949864:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594254208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143765.949932:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594254464 00000100:00100000:1.0:1746143765.949936:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594254464 00000100:00100000:1.0:1746143765.949957:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3966 00000100:00100000:1.0:1746143765.949962:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31388:x1830963594254464:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143765.950841:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31388:x1830963594254464:12345-192.168.202.48@tcp:35:cat.0 Request processed in 876us (1124us total) trans 8589943552 rc 0/0 00000100:00100000:1.0:1746143765.950851:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3966 00000100:00100000:2.0:1746143765.957798:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594254208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7927us (8381us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143765.957808:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6383 00002000:00100000:2.0:1746143765.957818:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a0815500 x1830963594254208/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/440 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143765.957827:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0815500 with x1830963594254208 ext(4194304->4771839) 00002000:00010000:2.0:1746143765.957831:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0815500 00000100:00100000:0.0:1746143765.965252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.965323:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594254720 00000100:00100000:1.0:1746143765.965331:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594254720 00000100:00100000:1.0:1746143765.966568:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3967 00000100:00100000:1.0:1746143765.966577:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31390:x1830963594254720:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143765.971441:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31390:x1830963594254720:12345-192.168.202.48@tcp:35:cat.0 Request processed in 4856us (6187us total) trans 8589943553 rc 0/0 00000100:00100000:1.0:1746143765.971453:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3967 00000100:00100000:0.0:1746143765.971760:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.971820:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594254848 00000100:00100000:3.0:1746143765.971827:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594254848 00000100:00100000:3.0:1746143765.972125:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13560 00000100:00100000:3.0:1746143765.972131:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31399:x1830963594254848:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143765.972162:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143765.972176:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c63 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.972210:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 32 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.972217:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 18 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.972223:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.972224:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143765.972227:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1597440->2072575] (req 1597440->2072575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.972250:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 18 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143765.972260:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 18 pid: 8497 timeout: 944 lvb_type: 1 00000100:00100000:3.0:1746143765.972271:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594383872:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.972363:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 32 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.972375:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 32 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:3.0:1746143765.972383:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594384000:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.972408:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143765.975223:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594383872:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143765.975240:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594384000:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143765.975272:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1597440->2072575] (req 1597440->2072575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143765.975286:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12c00, rc 0) 00000100:00100000:3.0:1746143765.975330:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31399:x1830963594254848:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3198us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143765.975338:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13560 00000100:00100000:0.0:1746143765.980037:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143765.980123:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.980194:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594255104 00000100:00100000:1.0:1746143765.980202:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594255104 00010000:00010000:1.0:1746143765.980234:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 32 pid: 4581 timeout: 944 lvb_type: 0 00000100:00100000:2.0:1746143765.980394:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594254976 00000100:00100000:2.0:1746143765.980397:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594254976 00010000:00010000:2.0:1746143765.980413:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 19 pid: 8497 timeout: 944 lvb_type: 1 00000100:00100000:2.0:1746143765.980433:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7259 00000100:00100000:2.0:1746143765.980439:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594254976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143765.980448:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143765.980465:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 19 pid: 8497 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.980478:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 19 pid: 8497 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.980497:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd7302bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c4e expref: 19 pid: 8497 timeout: 944 lvb_type: 1 00010000:00010000:2.0:1746143765.980514:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143765.980549:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594254976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143765.980554:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7259 00000100:00100000:1.0:1746143765.980727:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7260 00000100:00100000:1.0:1746143765.980737:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594255104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143765.980747:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143765.980758:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 32 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.981010:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 32 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.981024:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5792c00/0xe984082ccd73027c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c1d expref: 32 pid: 4581 timeout: 944 lvb_type: 0 00010000:00010000:1.0:1746143765.981427:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.981429:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143765.981436:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.981444:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143765.981471:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143765.981482:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594384128:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143765.981680:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143765.985308:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594384128:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143765.985332:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143765.985380:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594255104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4647us (5348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143765.985389:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7260 00000100:00100000:0.0:1746143765.985500:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.986354:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594255360 00000100:00100000:3.0:1746143765.986360:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594255360 00002000:00100000:3.0:1746143765.986403:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1597440->1601535) req@ffff880094307100 x1830963594255360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.986415:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830963594255360 ext(1597440->1601535) 00002000:00010000:3.0:1746143765.986419:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:3.0:1746143765.986448:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6384 00000100:00100000:3.0:1746143765.986454:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594255360:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.989119:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594255360:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 2658us (3613us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.989128:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6384 00002000:00100000:3.0:1746143765.989136:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1597440->1601535) req@ffff880094307100 x1830963594255360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.989158:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307100 with x1830963594255360 ext(1597440->1601535) 00002000:00010000:3.0:1746143765.989163:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094307100 00000100:00100000:0.0:1746143765.993917:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143765.994019:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594255616 00000100:00100000:3.0:1746143765.994027:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594255616 00002000:00100000:3.0:1746143765.994061:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (2068480->2072575) req@ffff880094305180 x1830963594255616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/0 e 0 to 0 dl 1746143776 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.994070:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830963594255616 ext(2068480->2072575) 00002000:00010000:3.0:1746143765.994074:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:3.0:1746143765.994090:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6385 00000100:00100000:3.0:1746143765.994096:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594255616:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143765.994282:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594255616:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 184us (371us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143765.994289:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6385 00002000:00100000:3.0:1746143765.994294:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (2068480->2072575) req@ffff880094305180 x1830963594255616/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746143776 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143765.994301:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830963594255616 ext(2068480->2072575) 00002000:00010000:3.0:1746143765.994304:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:0.0:1746143765.997556:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143765.998577:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594255872 00000100:00100000:1.0:1746143765.998586:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594255872 00000100:00100000:1.0:1746143765.998624:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3968 00000100:00100000:1.0:1746143765.998630:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31399:x1830963594255872:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143765.998808:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31399:x1830963594255872:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 177us (1258us total) trans 8589943554 rc 0/0 00000100:00100000:1.0:1746143765.998817:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3968 00000100:00100000:0.0:1746143766.052232:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.052304:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594256128 00000100:00100000:3.0:1746143766.052312:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594256128 00000100:00080000:1.0:1746143766.052353:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143766.052362:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9222 00000100:00100000:3.0:1746143766.052369:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31404:x1830963594256128:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.052390:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.052405:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c6a expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.052496:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052506:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052516:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052528:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052533:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052538:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052626:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052634:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052640:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143766.052648:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.052718:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052727:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052733:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052738:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf13600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.052741:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052747:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052756:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143766.052758:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.052761:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.052766:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd7302fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054538:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054548:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054554:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054558:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0e1200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.054561:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054570:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054579:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442100) 00010000:00010000:3.0:1746143766.054582:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.054584:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054589:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1200/0xe984082ccd730301 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.054662:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd7302f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 19 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.054675:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 18 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.054682:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.054684:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143766.054686:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08000, rc 0) 00000100:00100000:3.0:1746143766.054749:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31404:x1830963594256128:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2380us (2524us total) trans 8589943555 rc 0/0 00000100:00100000:3.0:1746143766.054757:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9222 00000100:00100000:0.0:1746143766.062398:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.062914:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594256256 00000100:00100000:3.0:1746143766.062922:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594256256 00000100:00100000:3.0:1746143766.062990:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13561 00000100:00100000:3.0:1746143766.062997:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31404:x1830963594256256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.063015:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.063032:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c71 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.063058:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.063066:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.063072:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.063077:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.063079:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.063082:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [495616->593919] (req 495616->593919) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.063107:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.063118:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 19 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.063128:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384256:192.168.202.48@tcp:104: 00000100:00080000:1.0:1746143766.063246:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143766.064276:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 22 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.064286:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 22 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.064295:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384384:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.064324:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 8 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.064332:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 8 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.064340:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384512:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.064352:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.066963:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.066974:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384384:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.067082:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384512:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.067108:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [495616->593919] (req 495616->593919) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.067122:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08200, rc 0) 00000100:00100000:2.0:1746143766.067202:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31404:x1830963594256256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4204us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.067210:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13561 00000100:00100000:0.0:1746143766.069421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.072301:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.072347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.072586:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594256384 00000100:00100000:2.0:1746143766.072593:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594256384 00010000:00010000:2.0:1746143766.072631:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 20 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.072650:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594256512 00000100:00100000:2.0:1746143766.072652:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594256512 00010000:00010000:2.0:1746143766.072663:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 9 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.075655:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594256640 00000100:00100000:2.0:1746143766.075664:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594256640 00010000:00010000:2.0:1746143766.075696:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 22 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.075789:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7261 00000100:00100000:1.0:1746143766.075800:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594256384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.075811:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.075831:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 20 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.075841:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 20 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.075859:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5db9400/0xe984082ccd7300a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b0c expref: 20 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.075878:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.075920:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594256384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 123us (6504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.075926:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7261 00000100:00100000:1.0:1746143766.075940:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7262 00000100:00100000:1.0:1746143766.075944:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594256512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.075950:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.075958:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 9 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.075969:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 9 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.075980:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff24200/0xe984082ccd72ffe3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7acd expref: 9 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.075988:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.076002:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594256512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 57us (3707us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.076007:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7262 00000100:00100000:1.0:1746143766.076017:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7263 00000100:00100000:1.0:1746143766.076021:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594256640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.076027:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.076033:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 22 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.076041:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 22 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.076052:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368d6800/0xe984082ccd7300ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b21 expref: 22 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.076059:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.076061:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.076067:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.076078:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.076104:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.076114:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594384640:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.076168:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b540 going to sleep for 11 seconds 00000100:00080000:0.0:1746143766.076462:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143766.078519:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.078566:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594256896 00000100:00100000:0.0:1746143766.078572:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594256896 00002000:00100000:0.0:1746143766.078603:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (495616->499711) req@ffff88009cdc2a00 x1830963594256896/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.078611:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963594256896 ext(495616->499711) 00000100:00100000:1.0:1746143766.078613:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594384640:192.168.202.48@tcp:105: 00002000:00010000:0.0:1746143766.078614:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2a00 00010000:00010000:1.0:1746143766.078629:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.078659:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594256640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2637us (6312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.078667:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7263 00000100:00100000:0.0:1746143766.079378:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6386 00000100:00100000:0.0:1746143766.079386:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594256896:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143766.079776:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594256896:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 389us (1259us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143766.079782:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6386 00002000:00100000:1.0:1746143766.079788:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (495616->499711) req@ffff88009cdc2a00 x1830963594256896/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.079795:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2a00 with x1830963594256896 ext(495616->499711) 00002000:00010000:1.0:1746143766.079798:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc2a00 00000100:00100000:0.0:1746143766.084799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.087316:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594257152 00000100:00100000:1.0:1746143766.087325:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594257152 00002000:00100000:1.0:1746143766.087367:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (589824->593919) req@ffff880094305880 x1830963594257152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.087381:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305880 with x1830963594257152 ext(589824->593919) 00002000:00010000:1.0:1746143766.087386:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305880 00000100:00100000:1.0:1746143766.087418:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6387 00000100:00100000:1.0:1746143766.087425:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594257152:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143766.088656:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594257152:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 1227us (3859us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143766.088663:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6387 00002000:00100000:1.0:1746143766.088670:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (589824->593919) req@ffff880094305880 x1830963594257152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.088677:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305880 with x1830963594257152 ext(589824->593919) 00002000:00010000:1.0:1746143766.088680:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305880 00000100:00100000:1.0:1746143766.095594:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.096728:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594257408 00000100:00100000:0.0:1746143766.096736:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594257408 00000100:00100000:0.0:1746143766.096776:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3969 00000100:00100000:0.0:1746143766.096782:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6456050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31404:x1830963594257408:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143766.096977:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6456050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31404:x1830963594257408:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 195us (1525us total) trans 8589943556 rc 0/0 00000100:00100000:0.0:1746143766.096984:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3969 00000100:00100000:0.0:1746143766.102329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.103169:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594257664 00000100:00100000:3.0:1746143766.103176:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594257664 00000100:00080000:0.0:1746143766.103233:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143766.103245:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9223 00000100:00100000:3.0:1746143766.103255:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31407:x1830963594257664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.103277:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.103290:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd73031d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c78 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.103369:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.103380:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.103388:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143766.103397:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.103479:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd73031d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 255 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.103505:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 254 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.103511:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.103513:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143766.103516:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13e00, rc 0) 00000100:00100000:3.0:1746143766.103557:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31407:x1830963594257664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 305us (1236us total) trans 8589943557 rc 0/0 00000100:00100000:3.0:1746143766.103562:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9223 00000100:00100000:0.0:1746143766.108911:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.109645:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594257792 00000100:00100000:2.0:1746143766.109654:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594257792 00000100:00100000:2.0:1746143766.109704:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13562 00000100:00100000:2.0:1746143766.109710:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963594257792:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.109726:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.109740:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba30600/0xe984082ccd730332 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c7f expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.109780:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384768:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143766.109864:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143766.113442:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime: 1746143764 -> 1746143765 00002000:00010000:2.0:1746143766.113448:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143764 -> 1746143765 00002000:00010000:2.0:1746143766.113450:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime: 1746143764 -> 1746143765 00000100:00100000:2.0:1746143766.113471:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384768:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.113497:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba30600/0xe984082ccd730332 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c7f expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.113510:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30600/0xe984082ccd730332 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c7f expref: 20 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.113537:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba30600, rc 0) 00000100:00100000:2.0:1746143766.113890:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963594257792:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4178us (4984us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.113899:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13562 00000100:00100000:0.0:1746143766.118104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.118257:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594257920 00000100:00100000:2.0:1746143766.118265:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594257920 00000100:00100000:2.0:1746143766.118297:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13563 00000100:00100000:2.0:1746143766.118302:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31407:x1830963594257920:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.118318:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.118331:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c86 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.118354:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.118360:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.118361:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.118364:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.118385:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.118394:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 20 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.118403:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384896:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.118965:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.121120:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.121250:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594384896:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.121271:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.121284:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba30200, rc 0) 00000100:00100000:2.0:1746143766.121320:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31407:x1830963594257920:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3017us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.121330:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13563 00000100:00100000:1.0:1746143766.121410:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594258048 00000100:00100000:1.0:1746143766.121415:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594258048 00002000:00100000:1.0:1746143766.121446:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (495616->593919) req@ffff880094306a00 x1830963594258048/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.121453:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306a00 with x1830963594258048 ext(495616->593919) 00010000:00010000:1.0:1746143766.121459:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 21 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.121469:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 21 pid: 8497 timeout: 945 lvb_type: 0 00002000:00010000:1.0:1746143766.121475:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306a00 00000100:00100000:1.0:1746143766.122239:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1810 00000100:00100000:1.0:1746143766.122248:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594258048:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143766.125405:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594258048:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3151us (4284us total) trans 21474840462 rc 0/0 00000100:00100000:1.0:1746143766.125415:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1810 00002000:00100000:1.0:1746143766.125423:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (495616->593919) req@ffff880094306a00 x1830963594258048/t21474840462(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.125432:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306a00 with x1830963594258048 ext(495616->593919) 00010000:00010000:1.0:1746143766.125440:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.125452:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00002000:00010000:1.0:1746143766.125459:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306a00 00000100:00100000:0.0:1746143766.127581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.127661:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594258176 00000100:00100000:1.0:1746143766.127668:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594258176 00010000:00010000:1.0:1746143766.127693:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.128123:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7264 00000100:00100000:1.0:1746143766.128130:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594258176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.128400:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.128419:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.128436:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.128452:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08200/0xe984082ccd730316 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 495616->593919) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c71 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.129677:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.129679:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.129687:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.129695:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.129727:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.129738:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594385024:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.129825:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.133099:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594385024:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.133293:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.133522:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594258176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5390us (5945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.133532:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7264 00000100:00100000:0.0:1746143766.135136:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.135375:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594258432 00000100:00100000:3.0:1746143766.135382:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594258432 00000100:00100000:3.0:1746143766.135422:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9224 00000100:00100000:3.0:1746143766.135427:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31410:x1830963594258432:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.135449:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.135464:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd730340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c8d expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.135546:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.135558:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 255 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.135564:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 18 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.135569:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.135593:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 18 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.135603:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 18 pid: 14762 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.135613:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594385152:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.135682:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 255 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.135688:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 255 pid: 14762 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.135698:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594385280:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.135715:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.139030:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.139114:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.139397:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594385152:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.139408:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594385280:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.139427:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143766.139498:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594258688 00000100:00100000:1.0:1746143766.139504:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594258688 00002000:00100000:1.0:1746143766.139540:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880094304380 x1830963594258688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.139548:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830963594258688 ext(0->1048575) 00002000:00010000:1.0:1746143766.139552:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304380 00000100:00100000:1.0:1746143766.139568:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594258944 00000100:00100000:1.0:1746143766.139571:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594258944 00002000:00100000:1.0:1746143766.139588:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094305500 x1830963594258944/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 504/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.139594:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830963594258944 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.139597:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305500 00000100:00100000:1.0:1746143766.139608:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6388 00000100:00100000:1.0:1746143766.139614:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594258688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.139861:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6389 00000100:00100000:2.0:1746143766.139868:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594258944:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:0.0:1746143766.140877:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143766.147712:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.147755:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.148411:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594259072 00000100:00100000:3.0:1746143766.148419:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594259072 00010000:00010000:3.0:1746143766.148451:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 19 pid: 14762 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.148486:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594259200 00000100:00100000:3.0:1746143766.148489:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594259200 00010000:00010000:3.0:1746143766.148499:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 256 pid: 14762 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.148513:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7265 00000100:00100000:3.0:1746143766.148519:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594259072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.148530:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.148534:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 19 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.148542:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 19 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.148564:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c08000/0xe984082ccd730308 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c6a expref: 19 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.148583:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.148588:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.148595:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.148599:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.148635:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594259072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.148641:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7265 00000100:00100000:3.0:1746143766.148653:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7266 00000100:00100000:3.0:1746143766.148658:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1965:x1830963594259200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.148669:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.148672:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 256 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.148680:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 256 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.148690:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12000/0xe984082ccd7302d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c5c expref: 256 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.148698:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.148702:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.148707:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.148712:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.148727:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.148741:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1965:x1830963594259200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 82us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.148745:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7266 00010000:00010000:3.0:1746143766.148762:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.148768:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143766.148783:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.148903:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13600/0xe984082ccd730340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 256 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.148914:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 255 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.148919:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.148921:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143766.148923:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13a00, rc 0) 00000100:00100000:3.0:1746143766.148946:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31410:x1830963594258432:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 13518us (13811us total) trans 8589943558 rc 0/0 00000100:00100000:3.0:1746143766.148954:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9224 00000100:00100000:3.0:1746143766.150292:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594258944:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10421us (11173us total) trans 0 rc 573440/573440 00000100:00100000:3.0:1746143766.150300:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6389 00002000:00100000:3.0:1746143766.150308:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094305500 x1830963594258944/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 504/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 573440/573440 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.150317:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830963594258944 ext(1048576->2097151) 00002000:00010000:3.0:1746143766.150321:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305500 00000100:00100000:1.0:1746143766.157325:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594258688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17704us (18295us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.157335:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6388 00002000:00100000:1.0:1746143766.157345:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880094304380 x1830963594258688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.157354:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830963594258688 ext(0->1048575) 00002000:00010000:1.0:1746143766.157359:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304380 00000100:00100000:0.0:1746143766.190864:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.190954:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594259456 00000100:00100000:3.0:1746143766.190962:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594259456 00000100:00100000:3.0:1746143766.191012:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9225 00000100:00100000:3.0:1746143766.191019:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31413:x1830963594259456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.191038:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.191053:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c94 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.191173:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191196:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191206:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191216:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191225:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191230:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191321:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd73036a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191329:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd73036a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191334:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd73036a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143766.191342:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.191414:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191419:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191424:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191429:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2d600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.191433:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191438:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191447:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143766.191451:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.191453:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191458:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd73035c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191486:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191490:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191494:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191498:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2c800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.191500:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191504:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191509:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442c00) 00010000:00010000:3.0:1746143766.191511:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.191512:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191516:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd730363 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.191548:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c94 expref: 21 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.191561:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd73036a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c94 expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.191566:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.191567:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143766.191569:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c000, rc 0) 00000100:00100000:3.0:1746143766.191605:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31413:x1830963594259456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 587us (748us total) trans 8589943559 rc 0/0 00000100:00100000:3.0:1746143766.191611:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9225 00000100:00100000:0.0:1746143766.192196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.192255:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594259584 00000100:00100000:2.0:1746143766.192259:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594259584 00000100:00100000:2.0:1746143766.192282:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13564 00000100:00100000:2.0:1746143766.192287:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31410:x1830963594259584:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143766.192294:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.192304:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7c9b expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.192320:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.192326:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.192331:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.192333:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.192335:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4083712->4194303] (req 4083712->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.192359:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.192369:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.192379:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594385408:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.192459:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.192466:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 21 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.192474:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594385536:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.192493:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.195302:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594385408:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.195314:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594385536:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.195336:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4083712->4194303] (req 4083712->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.195349:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d5400, rc 0) 00000100:00100000:2.0:1746143766.195383:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31410:x1830963594259584:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3095us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.195390:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13564 00000100:00100000:0.0:1746143766.201011:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.201056:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.201085:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.201124:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.201222:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594259840 00000100:00100000:1.0:1746143766.201230:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594259840 00000100:00100000:1.0:1746143766.201264:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594259968 00000100:00100000:1.0:1746143766.201266:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594259968 00000100:00100000:1.0:1746143766.201288:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13565 00000100:00100000:1.0:1746143766.201293:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594259840:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.201308:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.201320:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ca2 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.201338:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.201340:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.201347:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 23 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.201361:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 23 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.201369:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034b800, rc 0) 00000100:00100000:1.0:1746143766.201405:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594259840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.201410:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13565 00000100:00100000:1.0:1746143766.201423:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13566 00000100:00100000:1.0:1746143766.201428:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594259968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.201433:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.201441:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a034bc00/0xe984082ccd730386 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ca9 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.201473:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594385664:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143766.201520:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.201539:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594259712 00000100:00100000:1.0:1746143766.201541:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594259712 00010000:00010000:1.0:1746143766.201556:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 23 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.201572:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594260096 00000100:00100000:1.0:1746143766.201574:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594260096 00000100:00100000:1.0:1746143766.201594:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7267 00000100:00100000:1.0:1746143766.201599:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594259712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.201606:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.201625:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 23 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.201633:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 23 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.201646:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf13400/0xe984082ccd7302a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c39 expref: 23 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.201659:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.201674:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594259712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.201679:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7267 00000100:00100000:1.0:1746143766.201688:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 735 00000100:00100000:1.0:1746143766.201692:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594260096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.201698:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.201708:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd73036a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c94 expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.201717:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143766.201720:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.201735:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594260096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 42us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.201739:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 735 00000100:00080000:0.0:1746143766.201943:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143766.202373:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.202429:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594260224 00000100:00100000:3.0:1746143766.202432:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594260224 00000100:00100000:3.0:1746143766.202460:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13567 00000100:00100000:3.0:1746143766.202465:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594260224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.202471:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.202478:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd73038d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cb0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.202489:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.202494:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd73038d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb0 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.202501:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2d800/0xe984082ccd73038d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb0 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.202520:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2d800, rc 0) 00000100:00100000:3.0:1746143766.202551:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594260224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 85us (178us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.202556:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13567 00000100:00100000:0.0:1746143766.203167:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.203231:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594260352 00000100:00100000:2.0:1746143766.203235:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594260352 00010000:00010000:2.0:1746143766.203249:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.203274:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7268 00000100:00100000:2.0:1746143766.203279:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594260352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.203285:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.203296:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.203303:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.203314:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095395e00/0xe984082ccd7302ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c40 expref: 21 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.203335:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.203337:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.203343:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.203350:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.203370:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.203379:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594385792:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143766.203428:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746143766.203825:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143764 -> 1746143765 00000100:00100000:1.0:1746143766.203836:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594385664:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143766.203850:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a034bc00/0xe984082ccd730386 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca9 expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.203856:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a034bc00/0xe984082ccd730386 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca9 expref: 19 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.203860:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034bc00, rc 0) 00000100:00100000:1.0:1746143766.203874:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594259968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2447us (2790us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.203878:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13566 00000100:00100000:2.0:1746143766.207535:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594385792:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143766.207552:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.207594:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594260352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4314us (4454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.207603:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7268 00000100:00100000:1.0:1746143766.207763:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.208024:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594260608 00000100:00100000:2.0:1746143766.208030:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594260608 00002000:00100000:2.0:1746143766.208063:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4083712->4087807) req@ffff88008f3caa00 x1830963594260608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.208071:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3caa00 with x1830963594260608 ext(4083712->4087807) 00002000:00010000:2.0:1746143766.208075:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3caa00 00000100:00100000:0.0:1746143766.208373:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.209472:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594260864 00000100:00100000:2.0:1746143766.209480:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594260864 00000100:00100000:0.0:1746143766.209501:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6390 00000100:00100000:0.0:1746143766.209510:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594260608:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143766.209649:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594260608:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 140us (1886us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143766.209655:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6390 00002000:00100000:0.0:1746143766.209661:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4083712->4087807) req@ffff88008f3caa00 x1830963594260608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.209668:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3caa00 with x1830963594260608 ext(4083712->4087807) 00002000:00010000:0.0:1746143766.209671:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3caa00 00002000:00100000:2.0:1746143766.209712:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012e17f800 x1830963594260864/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.209718:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f800 with x1830963594260864 ext(0->1048575) 00002000:00010000:2.0:1746143766.209721:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17f800 00000100:00100000:2.0:1746143766.209732:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6391 00000100:00100000:2.0:1746143766.209736:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594260864:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.214815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.215056:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594260992 00000100:00100000:1.0:1746143766.215063:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594260992 00000100:00100000:1.0:1746143766.215097:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13568 00000100:00100000:1.0:1746143766.215104:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31410:x1830963594260992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.215118:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.215133:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cb7 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.215175:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.215193:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 32 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.215199:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.215201:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.215204:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->3411967] (req 3145728->3411967) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 32 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.215229:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 32 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.215240:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 32 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143766.215250:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594385920:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.215304:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 17 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.215311:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 17 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.215318:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594386048:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143766.215334:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.219992:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594385920:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143766.226297:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.226898:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594261120 00000100:00100000:1.0:1746143766.226905:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594261120 00000100:00100000:1.0:1746143766.226976:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9226 00000100:00100000:1.0:1746143766.226984:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31416:x1830963594261120:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143766.227003:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.227019:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd73039b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cbe expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.227071:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227081:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227091:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227102:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227108:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227113:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227234:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227245:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 254 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.227255:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.227280:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 254 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.227290:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 254 pid: 14762 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.227300:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594386176:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143766.227366:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00080000:3.0:1746143766.227501:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143766.229351:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.229400:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.229424:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.229439:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594261248 00000100:00100000:0.0:1746143766.229444:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594261248 00010000:00010000:0.0:1746143766.229468:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 33 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143766.229486:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594261376 00000100:00100000:0.0:1746143766.229488:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594261376 00010000:00010000:0.0:1746143766.229495:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 18 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.229507:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7269 00000100:00100000:0.0:1746143766.229512:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594261248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.229525:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.229542:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 33 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.229551:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 33 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.229569:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd7302b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c47 expref: 33 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.229585:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143766.229612:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594261248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.229618:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7269 00000100:00100000:0.0:1746143766.229631:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7270 00000100:00100000:0.0:1746143766.229635:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594261376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.229642:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.229649:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 18 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.229656:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 18 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.229666:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.229668:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.229674:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.229681:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.229704:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.229714:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594386304:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143766.229757:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1c829c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143766.229897:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e0600/0xe984082ccd730298 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c2b expref: 18 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.229913:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594386048:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.229935:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.229943:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cdb5a00, rc 0) 00000100:00100000:2.0:1746143766.229970:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31410:x1830963594260992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14867us (15161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.229975:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13568 00000100:00100000:3.0:1746143766.230039:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594261632 00000100:00100000:3.0:1746143766.230043:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594261632 00000100:00100000:3.0:1746143766.230065:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9227 00000100:00100000:3.0:1746143766.230070:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31417:x1830963594261632:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.230085:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.230095:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd7303b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cc5 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.230199:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230208:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230214:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230222:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230227:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230231:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230310:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd7303cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230318:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd7303cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230324:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd7303cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143766.230331:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.230397:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230403:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230409:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230414:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2d600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.230417:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230423:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230431:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143766.230433:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.230436:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230439:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d600/0xe984082ccd7303be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230452:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230456:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230464:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230468:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2d800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.230470:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230475:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230481:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c800) 00010000:00010000:3.0:1746143766.230483:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.230484:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230489:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd7303c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143766.230515:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd7303b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cc5 expref: 22 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.230524:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd7303cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cc5 expref: 21 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.230530:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.230531:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143766.230534:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.230540:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.230548:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c000, rc 0) 00000100:00100000:3.0:1746143766.230568:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31417:x1830963594261632:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 497us (1221us total) trans 8589943560 rc 0/0 00000100:00100000:3.0:1746143766.230573:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9227 00000100:00100000:1.0:1746143766.231096:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594386176:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.231111:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:0.0:1746143766.231617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.231671:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594386304:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143766.231680:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143766.231698:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594261376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2062us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.231704:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7270 00000100:00100000:0.0:1746143766.231733:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594261760 00000100:00100000:0.0:1746143766.231736:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594261760 00010000:00010000:0.0:1746143766.231749:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 255 pid: 14762 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.231761:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7271 00000100:00100000:0.0:1746143766.231765:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:1964:x1830963594261760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.231772:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.231775:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 255 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.231787:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 255 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.231798:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13a00/0xe984082ccd730347 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c8d expref: 255 pid: 14762 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.231809:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143766.231812:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143766.231818:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143766.231822:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143766.231837:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143766.231850:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1964:x1830963594261760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.231855:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7271 00000100:00100000:3.0:1746143766.232103:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594260864:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22366us (23731us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.232111:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6391 00002000:00100000:3.0:1746143766.232118:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012e17f800 x1830963594260864/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.232125:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f800 with x1830963594260864 ext(0->1048575) 00002000:00010000:3.0:1746143766.232129:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17f800 00010000:00010000:3.0:1746143766.232174:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232188:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143766.232212:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143766.232216:0:2976:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143766.232225:0:2976:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232232:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232239:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232244:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232249:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232253:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6347800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.232256:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232260:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232266:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143766.232268:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.232270:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232274:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347800/0xe984082ccd7303a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232281:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232285:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232289:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232292:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6346800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.232293:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232297:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232305:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c800) 00010000:00010000:3.0:1746143766.232306:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.232308:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232312:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7303a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.232332:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd73039b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 10 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.232340:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.232344:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.232346:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143766.232348:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346c00, rc 0) 00000100:00100000:3.0:1746143766.232369:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31416:x1830963594261120:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 5386us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.232374:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9226 00000100:00100000:0.0:1746143766.233708:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.234238:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.236668:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.236802:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594262272 00000100:00100000:2.0:1746143766.236809:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594262272 00000100:00100000:1.0:1746143766.236835:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594262016 00000100:00100000:2.0:1746143766.236841:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13569 00000100:00100000:1.0:1746143766.236842:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594262016 00000100:00100000:2.0:1746143766.236846:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594262272:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143766.236859:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.236871:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ccc expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.237065:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.237067:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.237074:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.237087:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.237096:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136488800, rc 0) 00000100:00100000:3.0:1746143766.237176:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594262144 00000100:00100000:3.0:1746143766.237189:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594262144 00002000:00100000:3.0:1746143766.237210:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3407872->3411967) req@ffff88012e17c000 x1830963594262144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.237218:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c000 with x1830963594262144 ext(3407872->3411967) 00002000:00010000:3.0:1746143766.237221:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17c000 00000100:00100000:3.0:1746143766.237232:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6392 00000100:00100000:3.0:1746143766.237236:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594262144:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143766.237351:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594262144:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 113us (3112us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143766.237357:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6392 00002000:00100000:3.0:1746143766.237362:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3407872->3411967) req@ffff88012e17c000 x1830963594262144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.237367:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c000 with x1830963594262144 ext(3407872->3411967) 00002000:00010000:3.0:1746143766.237370:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17c000 00000100:00100000:3.0:1746143766.237390:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 736 00000100:00100000:3.0:1746143766.237395:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594262016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.237402:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.237417:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c000/0xe984082ccd7303cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cc5 expref: 21 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.237434:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.237437:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.237453:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594262016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (3748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.237457:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 736 00000100:00100000:2.0:1746143766.237606:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594262272:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 284us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.237611:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13569 00000100:00100000:0.0:1746143766.237919:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.237934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.237947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.237965:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.238060:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594262400 00000100:00100000:1.0:1746143766.238064:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594262400 00000100:00100000:1.0:1746143766.238088:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594262528 00000100:00100000:1.0:1746143766.238090:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594262528 00000100:00100000:1.0:1746143766.238101:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594262656 00000100:00100000:1.0:1746143766.238102:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594262656 00000100:00100000:1.0:1746143766.238110:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594262784 00000100:00100000:1.0:1746143766.238112:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594262784 00000100:00100000:1.0:1746143766.238122:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13570 00000100:00100000:1.0:1746143766.238126:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594262400:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00080000:0.0:1746143766.238159:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143766.238173:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13571 00000100:00100000:0.0:1746143766.238189:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594262528:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143766.238196:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.238202:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cda expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.238215:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.238217:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.238221:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.238230:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.238236:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0800, rc 0) 00000100:00100000:0.0:1746143766.238254:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594262528:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 76us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.238258:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13571 00000100:00100000:0.0:1746143766.238267:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13572 00000100:00100000:0.0:1746143766.238271:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594262656:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143766.238275:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.238279:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd7303e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ce1 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.238305:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594386432:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143766.238343:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.238507:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13573 00000100:00100000:3.0:1746143766.238513:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594262784:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143766.238520:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.238528:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf12000/0xe984082ccd7303ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ce8 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.238552:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594386560:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143766.238574:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51390c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143766.238903:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.238912:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd7303f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cd3 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.238932:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594386688:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143766.238953:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.239996:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594386432:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143766.240015:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd7303e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ce1 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.240024:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1600/0xe984082ccd7303e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ce1 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.240045:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1600, rc 0) 00000100:00100000:0.0:1746143766.240079:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594262656:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1807us (2130us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143766.240085:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13572 00000100:00100000:3.0:1746143766.240778:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594386560:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143766.240796:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12000/0xe984082ccd7303ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ce8 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.240803:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12000/0xe984082ccd7303ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ce8 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.240810:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12000, rc 0) 00000100:00100000:3.0:1746143766.241661:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594262784:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 3145us (3692us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.241667:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13573 00000100:00100000:1.0:1746143766.241848:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594386688:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143766.241867:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd7303f6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cd3 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.241876:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a29c800/0xe984082ccd7303f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cd3 expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.241903:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a29c800, rc 0) 00000100:00100000:1.0:1746143766.241929:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594262400:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 3802us (4010us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.241934:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13570 00000100:00100000:0.0:1746143766.244014:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.244044:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594263040 00000100:00100000:1.0:1746143766.244050:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594263040 00000100:00100000:1.0:1746143766.244267:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3970 00000100:00100000:1.0:1746143766.244275:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31410:x1830963594263040:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143766.244434:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31410:x1830963594263040:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 159us (424us total) trans 8589943561 rc 0/0 00000100:00100000:1.0:1746143766.244440:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3970 00000100:00100000:0.0:1746143766.245740:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.245846:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594263296 00000100:00100000:3.0:1746143766.245851:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594263296 00000100:00100000:3.0:1746143766.245944:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9228 00000100:00100000:3.0:1746143766.245950:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31416:x1830963594263296:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143766.246045:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.246062:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd7303fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cef expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.246342:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.246357:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 10 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.246364:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.246390:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 10 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.246890:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 10 pid: 2976 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.246901:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594386816:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.247706:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a51390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.247751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.247830:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594263424 00000100:00100000:1.0:1746143766.247835:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594263424 00000100:00100000:1.0:1746143766.247870:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13574 00000100:00100000:1.0:1746143766.247876:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31413:x1830963594263424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.247884:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.247894:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cf6 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.247910:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.247916:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.247917:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.247919:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.247934:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.247940:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 30 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.247947:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594386944:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143766.247986:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.251498:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.251616:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594263552 00000100:00100000:2.0:1746143766.251623:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594263552 00010000:00010000:2.0:1746143766.251654:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 11 pid: 2976 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.251685:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7272 00000100:00100000:2.0:1746143766.251691:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594263552:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.251703:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143766.251707:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594386944:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.251708:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 11 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.251721:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 11 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.251732:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.251738:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.251742:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.251745:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5546c00, rc 0) 00010000:00010000:2.0:1746143766.251749:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.251754:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.251765:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.251780:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594263552:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.251780:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31413:x1830963594263424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3904us (4030us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.251785:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7272 00000100:00100000:1.0:1746143766.251787:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13574 00010000:00010000:3.0:1746143766.251848:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346c00/0xe984082ccd7303b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cbe expref: 10 pid: 2976 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.251859:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594386816:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.251870:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.251876:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.251880:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143766.251895:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.252005:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2c800/0xe984082ccd7303fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cef expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.252014:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cef expref: 10 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.252020:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.252022:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143766.252024:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2d800, rc 0) 00000100:00100000:3.0:1746143766.252042:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31416:x1830963594263296:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6093us (6306us total) trans 8589943562 rc 0/0 00000100:00100000:3.0:1746143766.252047:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9228 00000100:00100000:1.0:1746143766.253911:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.254067:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594263680 00000100:00100000:2.0:1746143766.254073:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594263680 00002000:00100000:2.0:1746143766.254106:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1597440->2072575) req@ffff88008f1ef480 x1830963594263680/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.254114:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef480 with x1830963594263680 ext(1597440->2072575) 00010000:00010000:2.0:1746143766.254122:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 31 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.254134:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 31 pid: 8497 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143766.254164:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1ef480 00000100:00100000:2.0:1746143766.254190:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1811 00000100:00100000:2.0:1746143766.254196:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594263680:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143766.255879:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.256923:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594263936 00000100:00100000:3.0:1746143766.256930:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594263936 00000100:00100000:2.0:1746143766.257074:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9229 00000100:00100000:2.0:1746143766.257079:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31416:x1830963594263936:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143766.257095:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.257097:0:2976:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143766.257116:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2d800/0xe984082ccd730404 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cef expref: 10 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.257130:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.257134:0:2976:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.257165:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136488400/0xe984082ccd730419 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7cfd expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.257247:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257258:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257265:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257274:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257279:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257284:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257288:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136489000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143766.257291:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257296:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257301:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.257304:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143766.257306:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257310:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136489000/0xe984082ccd730420 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.257327:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136488400/0xe984082ccd730419 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cfd expref: 10 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.257332:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136488400/0xe984082ccd730419 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cfd expref: 10 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.257338:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136488400, rc 0) 00000100:00100000:2.0:1746143766.257368:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31416:x1830963594263936:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 289us (1495us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.257374:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9229 00000100:00100000:2.0:1746143766.258875:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594263680:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 4674us (4966us total) trans 17179873140 rc 0/0 00000100:00100000:2.0:1746143766.258883:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1811 00002000:00100000:2.0:1746143766.258891:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1597440->2072575) req@ffff88008f1ef480 x1830963594263680/t17179873140(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.258898:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f1ef480 with x1830963594263680 ext(1597440->2072575) 00010000:00010000:2.0:1746143766.258905:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 33 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.258917:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 33 pid: 8497 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143766.258923:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f1ef480 00000100:00100000:0.0:1746143766.259359:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.259481:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594264192 00000100:00100000:2.0:1746143766.259486:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594264192 00000100:00100000:2.0:1746143766.259514:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3971 00000100:00100000:2.0:1746143766.259520:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31416:x1830963594264192:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143766.259643:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31416:x1830963594264192:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 122us (283us total) trans 8589943563 rc 0/0 00000100:00100000:2.0:1746143766.259648:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3971 00000100:00100000:0.0:1746143766.261293:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.261376:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594264320 00000100:00100000:2.0:1746143766.261381:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594264320 00010000:00010000:2.0:1746143766.261401:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 33 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.261435:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7273 00000100:00100000:2.0:1746143766.261441:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594264320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.261450:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.261465:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 33 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.261474:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 33 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.261491:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf12c00/0xe984082ccd7302ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1597440->2072575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c63 expref: 33 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.261502:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.261504:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.261509:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.261516:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.261541:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 17 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.261551:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594387072:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143766.261837:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.263647:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594387072:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143766.263659:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.263681:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594264320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2240us (2392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.263688:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7273 00000100:00100000:0.0:1746143766.269317:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.269376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.269488:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594264576 00000100:00100000:1.0:1746143766.269496:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594264576 00002000:00100000:1.0:1746143766.269531:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8801305caa00 x1830963594264576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.269541:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305caa00 with x1830963594264576 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.269545:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305caa00 00000100:00100000:1.0:1746143766.269742:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594264832 00000100:00100000:1.0:1746143766.269745:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594264832 00002000:00100000:1.0:1746143766.269759:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305c9f80 x1830963594264832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.269765:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9f80 with x1830963594264832 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.269768:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9f80 00000100:00100000:1.0:1746143766.269954:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6393 00000100:00100000:1.0:1746143766.269960:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594264576:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.270096:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6394 00000100:00100000:0.0:1746143766.270102:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594264832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143766.283475:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594264576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13506us (14156us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.283487:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6393 00002000:00100000:1.0:1746143766.283497:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8801305caa00 x1830963594264576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.283507:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305caa00 with x1830963594264576 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.283512:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305caa00 00000100:00100000:1.0:1746143766.285707:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594264832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15601us (16325us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.285715:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6394 00002000:00100000:1.0:1746143766.285722:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305c9f80 x1830963594264832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.285730:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c9f80 with x1830963594264832 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.285734:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c9f80 00000100:00100000:0.0:1746143766.292339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.292396:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.292572:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594264960 00000100:00100000:1.0:1746143766.292580:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594264960 00000100:00100000:1.0:1746143766.292611:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594265088 00000100:00100000:1.0:1746143766.292613:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594265088 00000100:00100000:3.0:1746143766.292617:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13575 00000100:00100000:3.0:1746143766.292626:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594264960:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143766.292630:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13576 00000100:00100000:1.0:1746143766.292635:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594265088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.292642:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.292642:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.292656:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009505fe00/0xe984082ccd730427 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d0b expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.292657:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd73042e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d04 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.292692:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594387328:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143766.292692:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594387200:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143766.292797:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.292828:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.295675:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594387328:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.295700:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd73042e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d04 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.295712:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2c800/0xe984082ccd73042e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d04 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.295725:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2c800, rc 0) 00000100:00100000:2.0:1746143766.295762:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594264960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3137us (3430us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.295769:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13575 00000100:00100000:1.0:1746143766.295772:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594387200:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143766.295796:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009505fe00/0xe984082ccd730427 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d0b expref: 19 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.295803:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009505fe00/0xe984082ccd730427 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d0b expref: 19 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.295825:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009505fe00, rc 0) 00000100:00100000:1.0:1746143766.295843:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594265088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3208us (3452us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.295848:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13576 00000100:00100000:0.0:1746143766.298330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.298595:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594265216 00000100:00100000:1.0:1746143766.298602:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594265216 00000100:00100000:1.0:1746143766.298644:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13577 00000100:00100000:1.0:1746143766.298654:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31413:x1830963594265216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.298668:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.298681:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d12 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.298702:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.298708:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.298710:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.298713:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.298742:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.298752:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 31 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.298766:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594387456:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143766.298841:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.300175:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594387456:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.300207:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.300219:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0f0600, rc 0) 00000100:00100000:1.0:1746143766.300255:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31413:x1830963594265216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1604us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.300262:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13577 00000100:00100000:0.0:1746143766.301298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.301413:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594265344 00000100:00100000:1.0:1746143766.301418:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594265344 00002000:00100000:1.0:1746143766.301446:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3411967) req@ffff88012f185500 x1830963594265344/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.301455:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185500 with x1830963594265344 ext(3145728->3411967) 00010000:00010000:1.0:1746143766.301462:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 32 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.301472:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 32 pid: 4581 timeout: 945 lvb_type: 0 00002000:00010000:1.0:1746143766.301478:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f185500 00000100:00100000:1.0:1746143766.301507:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1812 00000100:00100000:1.0:1746143766.301513:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594265344:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143766.307294:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594265344:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5772us (5989us total) trans 17179873141 rc 0/0 00000100:00100000:1.0:1746143766.307305:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1812 00002000:00100000:1.0:1746143766.307315:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3411967) req@ffff88012f185500 x1830963594265344/t17179873141(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.307323:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185500 with x1830963594265344 ext(3145728->3411967) 00010000:00010000:1.0:1746143766.307332:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 34 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.307345:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 34 pid: 4581 timeout: 945 lvb_type: 0 00002000:00010000:1.0:1746143766.307351:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f185500 00000100:00100000:0.0:1746143766.310638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.310967:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594265472 00000100:00100000:2.0:1746143766.310974:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594265472 00010000:00010000:2.0:1746143766.311005:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 34 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.311040:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7274 00000100:00100000:2.0:1746143766.311047:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963594265472:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.311057:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.311075:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 34 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.311085:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 34 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.311104:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cdb5a00/0xe984082ccd730394 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3411967) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cb7 expref: 34 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.311128:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.311130:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.311136:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.311168:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.311205:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.311214:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594387584:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143766.311296:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.313495:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594387584:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143766.313514:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.313542:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1963:x1830963594265472:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2496us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.313551:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7274 00000100:00100000:0.0:1746143766.316613:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.316673:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594265728 00000100:00100000:1.0:1746143766.316682:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594265728 00002000:00100000:1.0:1746143766.316722:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012f184a80 x1830963594265728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.316732:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184a80 with x1830963594265728 ext(2097152->3145727) 00002000:00010000:1.0:1746143766.316737:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f184a80 00000100:00100000:1.0:1746143766.316770:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6395 00000100:00100000:1.0:1746143766.316776:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594265728:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.325853:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.326041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.326996:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594265856 00000100:00100000:1.0:1746143766.327003:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594265856 00000100:00100000:0.0:1746143766.327024:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.327051:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594265984 00000100:00100000:1.0:1746143766.327053:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594265984 00000100:00100000:1.0:1746143766.327066:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594266112 00000100:00100000:1.0:1746143766.327068:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594266112 00000100:00100000:1.0:1746143766.327080:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13578 00000100:00100000:1.0:1746143766.327086:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594265856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.327100:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.327114:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d19 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.327132:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.327134:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.327162:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 35 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143766.327165:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13579 00000100:00100000:2.0:1746143766.327173:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594265984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.327176:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 35 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.327190:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.327194:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5600, rc 0) 00010000:00010000:2.0:1746143766.327200:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5547a00/0xe984082ccd730443 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d20 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.327233:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594265856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 145us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.327235:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594387712:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143766.327238:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13578 00000100:00100000:1.0:1746143766.327252:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13580 00000100:00100000:1.0:1746143766.327257:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594266112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.327263:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.327269:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d27 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.327278:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.327280:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143766.327283:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746143766.327284:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 35 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.327292:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 35 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.327298:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5c00, rc 0) 00000100:00100000:1.0:1746143766.327313:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594266112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.328264:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13580 00000100:00100000:3.0:1746143766.328462:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594265728:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11685us (11856us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.328469:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6395 00002000:00100000:3.0:1746143766.328476:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012f184a80 x1830963594265728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.328484:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184a80 with x1830963594265728 ext(2097152->3145727) 00002000:00010000:3.0:1746143766.328487:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f184a80 00000100:00100000:2.0:1746143766.332250:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594387712:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.332280:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5547a00/0xe984082ccd730443 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d20 expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.332293:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5547a00/0xe984082ccd730443 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d20 expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.332308:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5547a00, rc 0) 00000100:00100000:2.0:1746143766.332354:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594265984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5181us (6312us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.332362:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13579 00000100:00100000:0.0:1746143766.341747:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.341814:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594266240 00000100:00100000:2.0:1746143766.341822:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594266240 00000100:00100000:2.0:1746143766.341865:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13581 00000100:00100000:2.0:1746143766.341871:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31413:x1830963594266240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.341886:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.341901:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d2e expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.341931:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.341938:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.341939:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.341942:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.341965:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 19 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.341975:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 19 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.341984:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594387840:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.342067:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.343812:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594387840:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.343833:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 23 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.343846:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba30e00, rc 0) 00000100:00100000:2.0:1746143766.343874:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31413:x1830963594266240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2003us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.343881:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13581 00000100:00100000:0.0:1746143766.344616:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.344674:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594266368 00000100:00100000:3.0:1746143766.344680:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594266368 00002000:00100000:3.0:1746143766.344712:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4083712->4194303) req@ffff88012f185180 x1830963594266368/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.344721:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963594266368 ext(4083712->4194303) 00010000:00010000:3.0:1746143766.344727:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 20 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.344738:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 20 pid: 8497 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.344743:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f185180 00000100:00100000:3.0:1746143766.344772:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1813 00000100:00100000:3.0:1746143766.344778:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594266368:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143766.350604:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594266368:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5818us (5980us total) trans 21474840463 rc 0/0 00000100:00100000:3.0:1746143766.350615:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1813 00002000:00100000:3.0:1746143766.350624:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4083712->4194303) req@ffff88012f185180 x1830963594266368/t21474840463(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.350631:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963594266368 ext(4083712->4194303) 00010000:00010000:3.0:1746143766.350640:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 22 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.350653:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 22 pid: 8497 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.350658:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f185180 00000100:00100000:0.0:1746143766.351369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.351723:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594266624 00000100:00100000:3.0:1746143766.351730:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594266624 00002000:00100000:3.0:1746143766.351758:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012f185880 x1830963594266624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.351765:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185880 with x1830963594266624 ext(1048576->2097151) 00002000:00010000:3.0:1746143766.351769:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185880 00000100:00100000:3.0:1746143766.351789:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6396 00000100:00100000:3.0:1746143766.351795:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594266624:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.352204:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.352386:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594266752 00000100:00100000:2.0:1746143766.352391:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594266752 00010000:00010000:2.0:1746143766.352410:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 22 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.352616:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7275 00000100:00100000:2.0:1746143766.352622:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594266752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.352632:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.352647:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 22 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.352657:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 22 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.352677:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5400/0xe984082ccd730378 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4083712->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c9b expref: 22 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.352707:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.352709:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.352716:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.352725:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.352751:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.352762:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594387968:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143766.352823:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.358115:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594387968:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143766.358133:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.358215:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594266752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5591us (6009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.358224:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7275 00000100:00100000:3.0:1746143766.360304:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594266624:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8504us (8931us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.360314:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6396 00002000:00100000:3.0:1746143766.360323:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012f185880 x1830963594266624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.360332:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185880 with x1830963594266624 ext(1048576->2097151) 00002000:00010000:3.0:1746143766.360336:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185880 00000100:00100000:0.0:1746143766.367193:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.367620:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594266880 00000100:00100000:2.0:1746143766.367628:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594266880 00000100:00100000:2.0:1746143766.367676:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13582 00000100:00100000:2.0:1746143766.367686:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31422:x1830963594266880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.367700:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.367713:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d35 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.367733:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.367735:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.367742:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.367754:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 22 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.367764:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba30c00, rc 0) 00000100:00100000:2.0:1746143766.367803:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31422:x1830963594266880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 118us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.367809:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13582 00000100:00100000:0.0:1746143766.370466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.370517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.370817:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594267136 00000100:00100000:1.0:1746143766.370825:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594267136 00002000:00100000:1.0:1746143766.370863:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012f187480 x1830963594267136/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.370872:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963594267136 ext(3145728->4194303) 00002000:00010000:1.0:1746143766.370877:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187480 00000100:00100000:1.0:1746143766.370904:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594267392 00000100:00100000:1.0:1746143766.370907:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594267392 00002000:00100000:1.0:1746143766.370919:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012f185c00 x1830963594267392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.370925:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963594267392 ext(3145728->4194303) 00002000:00010000:1.0:1746143766.370928:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:1.0:1746143766.370940:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6397 00000100:00100000:1.0:1746143766.370946:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594267136:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.371379:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6398 00000100:00100000:2.0:1746143766.371388:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594267392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.379270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.379270:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.379312:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.379323:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.379355:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.379717:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594268672 00000100:00100000:3.0:1746143766.379725:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594268672 00000100:00100000:3.0:1746143766.379774:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9230 00000100:00100000:3.0:1746143766.379782:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+255:31424:x1830963594268672:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.379803:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.379817:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013061dc00/0xe984082ccd73045f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d3c expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.379903:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143766.379919:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143766.379927:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143766.379935:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.380031:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061dc00/0xe984082ccd73045f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 258 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.380049:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 257 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.380057:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.380059:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143766.380062:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061da00, rc 0) 00000100:00100000:3.0:1746143766.380101:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31424:x1830963594268672:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 320us (839us total) trans 8589943564 rc 0/0 00000100:00100000:3.0:1746143766.380107:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9230 00000100:00100000:0.0:1746143766.380224:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594267648 00000100:00100000:0.0:1746143766.380228:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594267648 00002000:00100000:0.0:1746143766.380252:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009cdc1c00 x1830963594267648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.380260:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1c00 with x1830963594267648 ext(2097152->3145727) 00002000:00010000:0.0:1746143766.380263:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1c00 00000100:00100000:0.0:1746143766.380273:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6399 00000100:00100000:0.0:1746143766.380278:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594267648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.380439:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594267904 00000100:00100000:2.0:1746143766.380443:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594267904 00002000:00100000:2.0:1746143766.380459:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009cdc1880 x1830963594267904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.380467:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1880 with x1830963594267904 ext(3145728->4194303) 00002000:00010000:2.0:1746143766.380470:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1880 00000100:00100000:2.0:1746143766.380478:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594268160 00000100:00100000:2.0:1746143766.380480:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594268160 00002000:00100000:2.0:1746143766.380490:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc2300 x1830963594268160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.380496:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2300 with x1830963594268160 ext(2097152->3145727) 00002000:00010000:2.0:1746143766.380499:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc2300 00000100:00100000:2.0:1746143766.380507:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594268416 00000100:00100000:2.0:1746143766.380509:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594268416 00002000:00100000:2.0:1746143766.380516:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009cdc3100 x1830963594268416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.380523:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3100 with x1830963594268416 ext(3145728->4194303) 00002000:00010000:2.0:1746143766.380525:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3100 00000100:00100000:2.0:1746143766.380532:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6400 00000100:00100000:2.0:1746143766.380537:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594267904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143766.381077:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6401 00000100:00100000:1.0:1746143766.381085:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594268160:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143766.381471:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6402 00000100:00100000:3.0:1746143766.381479:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594268416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.382984:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594267136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12034us (12520us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.382992:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6397 00002000:00100000:2.0:1746143766.383000:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012f187480 x1830963594267136/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.383007:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963594267136 ext(3145728->4194303) 00002000:00010000:2.0:1746143766.383011:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f187480 00000100:00100000:2.0:1746143766.387325:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594267392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15931us (16799us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.387336:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6398 00002000:00100000:2.0:1746143766.387346:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012f185c00 x1830963594267392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.387353:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963594267392 ext(3145728->4194303) 00002000:00010000:2.0:1746143766.387358:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:3.0:1746143766.394660:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594267904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14114us (15339us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.394670:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6400 00002000:00100000:3.0:1746143766.394679:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009cdc1880 x1830963594267904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.394693:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1880 with x1830963594267904 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.394697:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1880 00000100:00100000:0.0:1746143766.395588:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.397512:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594268800 00000100:00100000:2.0:1746143766.397522:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594268800 00000100:00100000:2.0:1746143766.397562:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13583 00000100:00100000:2.0:1746143766.397569:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31417:x1830963594268800:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143766.397584:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.397599:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d43 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.397623:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.397635:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.397641:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.397646:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.397648:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.397650:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.397677:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.397686:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 24 pid: 8497 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.397696:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388096:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.397849:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 9 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.397860:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 9 pid: 2839 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.397868:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388224:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.397897:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 23 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.397903:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 23 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.397909:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388352:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.397921:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.399291:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.399517:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594269056 00000100:00100000:3.0:1746143766.399522:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594269056 00002000:00100000:3.0:1746143766.399552:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009b852300 x1830963594269056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.399560:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852300 with x1830963594269056 ext(4194304->4771839) 00002000:00010000:3.0:1746143766.399564:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b852300 00000100:00100000:3.0:1746143766.399582:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6403 00000100:00100000:3.0:1746143766.399588:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594269056:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.400615:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594268416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19134us (21255us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.400623:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6402 00002000:00100000:2.0:1746143766.400629:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009cdc3100 x1830963594268416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.400636:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3100 with x1830963594268416 ext(3145728->4194303) 00002000:00010000:2.0:1746143766.400639:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3100 00000100:00100000:2.0:1746143766.404315:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388096:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.404328:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388224:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.404335:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388352:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.404362:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.404380:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba31e00, rc 0) 00000100:00100000:2.0:1746143766.404438:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31417:x1830963594268800:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6868us (8850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.404448:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13583 00000100:00100000:0.0:1746143766.406503:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.406533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.406571:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.406587:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594269184 00000100:00100000:0.0:1746143766.406592:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594269184 00010000:00010000:0.0:1746143766.406615:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 26 pid: 8497 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143766.406647:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594269312 00000100:00100000:0.0:1746143766.406650:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594269312 00010000:00010000:0.0:1746143766.406657:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 10 pid: 2839 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143766.406667:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594269440 00000100:00100000:0.0:1746143766.406669:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594269440 00010000:00010000:0.0:1746143766.406675:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 24 pid: 4581 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.406685:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7276 00000100:00100000:0.0:1746143766.406690:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594269184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.406700:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.406716:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 26 pid: 8497 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.406726:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 26 pid: 8497 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.406743:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31600/0xe984082ccd7302e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c55 expref: 26 pid: 8497 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.406756:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143766.406778:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594269184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.406784:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7276 00000100:00100000:0.0:1746143766.406813:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7277 00000100:00100000:0.0:1746143766.406816:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594269312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.406820:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.406826:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 10 pid: 2839 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.406832:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 10 pid: 2839 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.406841:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e0800/0xe984082ccd7303e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cda expref: 10 pid: 2839 timeout: 945 lvb_type: 1 00010000:00010000:0.0:1746143766.406848:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143766.406856:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594269312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.406860:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7277 00000100:00100000:0.0:1746143766.406868:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7278 00000100:00100000:0.0:1746143766.406871:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594269440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.406876:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.406882:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 24 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.406890:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 24 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.406904:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1800/0xe984082ccd73029f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c32 expref: 24 pid: 4581 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.406911:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.406912:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.406917:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.406924:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.406962:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.406972:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594388480:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143766.407015:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.407408:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594268160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26324us (28082us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.407415:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6401 00002000:00100000:1.0:1746143766.407422:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc2300 x1830963594268160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.407430:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc2300 with x1830963594268160 ext(2097152->3145727) 00002000:00010000:1.0:1746143766.407434:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc2300 00000100:00100000:2.0:1746143766.410885:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594267648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30599us (31617us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.410894:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6399 00002000:00100000:2.0:1746143766.410903:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009cdc1c00 x1830963594267648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.410912:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1c00 with x1830963594267648 ext(2097152->3145727) 00002000:00010000:2.0:1746143766.410916:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc1c00 00000100:00100000:3.0:1746143766.410963:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594269056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11374us (11674us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143766.410968:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6403 00002000:00100000:3.0:1746143766.410973:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009b852300 x1830963594269056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.410979:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852300 with x1830963594269056 ext(4194304->4771839) 00002000:00010000:3.0:1746143766.410982:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b852300 00000100:00100000:1.0:1746143766.411015:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594388480:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.411030:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.411046:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594269440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4174us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.411053:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7278 00000100:00100000:0.0:1746143766.411128:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.411541:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594269696 00000100:00100000:3.0:1746143766.411547:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594269696 00002000:00100000:3.0:1746143766.411572:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1892352->1896447) req@ffff88009b850e00 x1830963594269696/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.411579:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963594269696 ext(1892352->1896447) 00002000:00010000:3.0:1746143766.411582:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850e00 00000100:00100000:3.0:1746143766.411595:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6404 00000100:00100000:3.0:1746143766.411600:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594269696:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143766.412320:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594269696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 717us (1200us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143766.412326:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6404 00002000:00100000:3.0:1746143766.412331:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1892352->1896447) req@ffff88009b850e00 x1830963594269696/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.412338:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850e00 with x1830963594269696 ext(1892352->1896447) 00002000:00010000:3.0:1746143766.412341:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850e00 00000100:00100000:0.0:1746143766.416735:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.416786:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.416848:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594269824 00000100:00100000:2.0:1746143766.416856:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594269824 00000100:00100000:2.0:1746143766.416893:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13584 00000100:00100000:2.0:1746143766.416900:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31417:x1830963594269824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143766.416914:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143766.416916:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594270080 00000100:00100000:1.0:1746143766.416920:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594270080 00010000:00010000:2.0:1746143766.416929:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d4a expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.416956:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.416959:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3972 00010000:00010000:2.0:1746143766.416964:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 20 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.416964:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31413:x1830963594270080:12345-192.168.202.48@tcp:35:cat.0 00010000:00010000:2.0:1746143766.416969:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.416979:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.416981:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.416985:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->2830335] (req 2097152->2830335) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.417016:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.417028:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.417040:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388608:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143766.417189:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31413:x1830963594270080:12345-192.168.202.48@tcp:35:cat.0 Request processed in 223us (402us total) trans 8589943565 rc 0/0 00000100:00100000:1.0:1746143766.417195:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3972 00010000:00010000:2.0:1746143766.417383:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 20 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.417393:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 20 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.417403:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388736:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.417508:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.417517:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 24 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.417530:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388864:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.417558:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.419046:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.419207:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594270208 00000100:00100000:1.0:1746143766.419211:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594270208 00010000:00010000:1.0:1746143766.419232:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.419268:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7279 00000100:00100000:1.0:1746143766.419273:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594270208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.419283:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.419300:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.419308:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.419401:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388608:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.419410:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388736:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.419416:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594388864:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.419606:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1e00/0xe984082ccd730267 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c01 expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.419608:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->2830335] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.419618:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.419620:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061ca00, rc 0) 00000100:00100000:1.0:1746143766.419653:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594270208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 379us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.419654:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31417:x1830963594269824:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2754us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.419660:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7279 00000100:00100000:2.0:1746143766.419661:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13584 00000100:00100000:0.0:1746143766.422377:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.422549:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594270336 00000100:00100000:1.0:1746143766.422559:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594270336 00010000:00010000:1.0:1746143766.422592:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 23 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.423031:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.424005:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594270464 00000100:00100000:1.0:1746143766.424010:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594270464 00010000:00010000:1.0:1746143766.424027:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 21 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.424055:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7280 00000100:00100000:1.0:1746143766.424064:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594270336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.424076:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.424098:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 23 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.424107:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 23 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.424128:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30e00/0xe984082ccd730451 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d2e expref: 23 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.424170:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.424232:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594270336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 167us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.424238:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7280 00000100:00100000:1.0:1746143766.424258:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7281 00000100:00100000:1.0:1746143766.424265:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594270464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.424275:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.424286:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 21 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.424295:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 21 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.424312:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30c00/0xe984082ccd730458 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d35 expref: 21 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.424321:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.424323:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.424329:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.424337:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.424367:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.424380:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594388992:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.424444:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.429040:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.429122:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.429171:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594270592 00000100:00100000:0.0:1746143766.429188:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594270592 00000100:00100000:0.0:1746143766.429232:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594270720 00000100:00100000:0.0:1746143766.429235:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594270720 00000100:00100000:0.0:1746143766.429249:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13585 00000100:00100000:0.0:1746143766.429255:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594270592:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143766.429270:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.429284:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009066a000/0xe984082ccd730482 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d51 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.429326:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f185f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594389120:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143766.429400:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.429527:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594388992:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.429542:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.429564:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594270464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5299us (6535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.429570:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7281 00000100:00100000:3.0:1746143766.429642:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13586 00000100:00100000:3.0:1746143766.429650:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594270720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.429656:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.429663:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a041f200/0xe984082ccd730489 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d58 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.429685:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594389248:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143766.429706:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136801900 going to sleep for 11 seconds 00002000:00010000:2.0:1746143766.430313:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime: 1746143765 -> 1746143766 00002000:00010000:2.0:1746143766.430317:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143764 -> 1746143766 00002000:00010000:2.0:1746143766.430319:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime: 1746143765 -> 1746143766 00000100:00100000:2.0:1746143766.430334:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f185f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594389120:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.430349:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009066a000/0xe984082ccd730482 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d51 expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.430358:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009066a000/0xe984082ccd730482 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d51 expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.430387:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009066a000, rc 0) 00000100:00100000:2.0:1746143766.430409:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594270592:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1154us (1376us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.430415:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13585 00000100:00100000:0.0:1746143766.432722:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.432822:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594270976 00000100:00100000:3.0:1746143766.432827:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594270976 00002000:00100000:3.0:1746143766.432855:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2826240->2830335) req@ffff88012f185f80 x1830963594270976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.432861:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185f80 with x1830963594270976 ext(2826240->2830335) 00002000:00010000:3.0:1746143766.432864:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185f80 00000100:00100000:3.0:1746143766.432876:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6405 00000100:00100000:3.0:1746143766.432880:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594270976:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:2.0:1746143766.433169:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143765 -> 1746143766 00002000:00010000:2.0:1746143766.433172:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143765 -> 1746143766 00002000:00010000:2.0:1746143766.433173:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143765 -> 1746143766 00000100:00100000:2.0:1746143766.433191:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594389248:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.433220:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a041f200/0xe984082ccd730489 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d58 expref: 21 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.433231:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a041f200/0xe984082ccd730489 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d58 expref: 21 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.433239:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a041f200, rc 0) 00000100:00100000:3.0:1746143766.433240:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594270976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 358us (523us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143766.433246:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6405 00002000:00100000:3.0:1746143766.433251:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2826240->2830335) req@ffff88012f185f80 x1830963594270976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.433258:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185f80 with x1830963594270976 ext(2826240->2830335) 00002000:00010000:3.0:1746143766.433260:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185f80 00000100:00100000:2.0:1746143766.433264:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594270720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3616us (4143us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.433270:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13586 00000100:00100000:0.0:1746143766.435758:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.435807:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594271104 00000100:00100000:2.0:1746143766.435813:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594271104 00000100:00100000:2.0:1746143766.435853:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13587 00000100:00100000:2.0:1746143766.435860:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31422:x1830963594271104:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.435872:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.435885:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d5f expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.435906:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.435912:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.435914:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.435917:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.435939:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.435949:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.435959:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594389376:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143766.435981:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.436030:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.436206:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594271360 00000100:00100000:1.0:1746143766.436211:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594271360 00000100:00100000:1.0:1746143766.436233:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3973 00000100:00100000:1.0:1746143766.436238:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31417:x1830963594271360:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143766.436512:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31417:x1830963594271360:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 272us (528us total) trans 8589943566 rc 0/0 00000100:00100000:1.0:1746143766.436518:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3973 00000100:00100000:2.0:1746143766.444106:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594389376:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.444133:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 21 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.444243:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061cc00, rc 0) 00000100:00100000:2.0:1746143766.444288:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31422:x1830963594271104:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8426us (8533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.444295:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13587 00000100:00100000:0.0:1746143766.445864:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.445976:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594271488 00000100:00100000:3.0:1746143766.445983:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594271488 00002000:00100000:3.0:1746143766.446018:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2830335) req@ffff8800930d3800 x1830963594271488/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.446027:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3800 with x1830963594271488 ext(2097152->2830335) 00010000:00010000:3.0:1746143766.446034:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.446047:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.446054:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d3800 00000100:00100000:3.0:1746143766.446067:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1814 00000100:00100000:3.0:1746143766.446073:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594271488:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143766.466117:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594271488:12345-192.168.202.48@tcp:4:cat.0 Request processed in 20035us (20248us total) trans 21474840464 rc 0/0 00000100:00100000:3.0:1746143766.466127:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1814 00002000:00100000:3.0:1746143766.466137:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2830335) req@ffff8800930d3800 x1830963594271488/t21474840464(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.466159:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3800 with x1830963594271488 ext(2097152->2830335) 00010000:00010000:3.0:1746143766.466168:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.466191:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.466197:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d3800 00000100:00100000:0.0:1746143766.475722:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.475831:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594271616 00000100:00100000:1.0:1746143766.475839:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594271616 00010000:00010000:1.0:1746143766.475872:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.475908:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7282 00000100:00100000:1.0:1746143766.475914:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594271616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.475925:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.475943:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.475954:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.475973:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013061ca00/0xe984082ccd73047b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d4a expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.476268:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.476271:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.476278:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.476285:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.476312:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.476323:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594389504:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.476405:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129d6b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.479218:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594389504:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.479238:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.479272:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594271616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3358us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.479281:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7282 00000100:00100000:0.0:1746143766.481290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.481394:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594271872 00000100:00100000:3.0:1746143766.481401:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594271872 00002000:00100000:3.0:1746143766.481435:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800930d2300 x1830963594271872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.481443:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2300 with x1830963594271872 ext(4194304->4771839) 00002000:00010000:3.0:1746143766.481447:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d2300 00000100:00100000:3.0:1746143766.481462:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6406 00000100:00100000:3.0:1746143766.481467:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594271872:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143766.487918:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594271872:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6443us (6626us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143766.487928:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6406 00002000:00100000:3.0:1746143766.487938:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800930d2300 x1830963594271872/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.487947:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2300 with x1830963594271872 ext(4194304->4771839) 00002000:00010000:3.0:1746143766.487952:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d2300 00000100:00100000:0.0:1746143766.492905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.493014:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594272000 00000100:00100000:2.0:1746143766.493022:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594272000 00000100:00100000:3.0:1746143766.493334:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13588 00000100:00100000:3.0:1746143766.493343:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594272000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.493357:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.493371:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0634800/0xe984082ccd730497 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d66 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.493412:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594389632:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143766.493485:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.494575:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594389632:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143766.494594:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0634800/0xe984082ccd730497 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d66 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.494604:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0634800/0xe984082ccd730497 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d66 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.494659:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0634800, rc 0) 00000100:00100000:3.0:1746143766.495103:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594272000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1760us (2203us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.495110:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13588 00000100:00100000:2.0:1746143766.498794:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.498879:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594272128 00000100:00100000:3.0:1746143766.498992:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594272128 00000100:00100000:3.0:1746143766.499455:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13589 00000100:00100000:3.0:1746143766.499462:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594272128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.499477:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.499490:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0634c00/0xe984082ccd73049e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d6d expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.499538:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594389760:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143766.500842:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.502779:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594389760:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143766.502806:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0634c00/0xe984082ccd73049e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d6d expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.502930:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0634c00/0xe984082ccd73049e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d6d expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.502957:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0634c00, rc 0) 00000100:00100000:3.0:1746143766.503003:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594272128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3541us (4216us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.503011:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13589 00000100:00100000:0.0:1746143766.508696:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.508780:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594272256 00000100:00100000:3.0:1746143766.508788:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594272256 00000100:00100000:3.0:1746143766.508834:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13590 00000100:00100000:3.0:1746143766.508841:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31424:x1830963594272256:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.508856:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.508871:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d74 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.508894:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.508907:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 36 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.508912:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.508914:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.508916:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2183168->2985983] (req 2183168->2985983) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 36 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.508940:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 36 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.508950:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 36 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.508960:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594389888:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.509048:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.509056:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 18 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.509063:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594390016:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.509079:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.511286:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594389888:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.511299:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594390016:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.511321:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2183168->2985983] (req 2183168->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 36 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.511339:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0634e00, rc 0) 00000100:00100000:3.0:1746143766.511372:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31424:x1830963594272256:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2530us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.511378:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13590 00000100:00100000:0.0:1746143766.513976:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.514042:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594272384 00000100:00100000:1.0:1746143766.514050:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594272384 00010000:00010000:1.0:1746143766.514082:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 36 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143766.514119:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7283 00000100:00100000:1.0:1746143766.514126:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594272384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.514167:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.514200:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 36 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.514214:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 36 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.514238:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5c00/0xe984082ccd73044a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d27 expref: 36 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.514259:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.514291:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594272384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 166us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.514297:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7283 00000100:00100000:0.0:1746143766.515719:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.516163:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594272512 00000100:00100000:3.0:1746143766.516168:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594272512 00010000:00010000:3.0:1746143766.516198:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 19 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.516230:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7284 00000100:00100000:3.0:1746143766.516235:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594272512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.516245:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.516259:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 19 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.516268:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 19 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.516284:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0f0600/0xe984082ccd730435 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d12 expref: 19 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.516306:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.516309:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.516315:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 34 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.516322:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 34 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.516348:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 34 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.516357:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594390144:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143766.516422:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.518523:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594390144:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143766.518539:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.518570:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594272512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2334us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.518578:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7284 00000100:00100000:0.0:1746143766.520290:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.520474:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594272768 00000100:00100000:3.0:1746143766.520481:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594272768 00002000:00100000:3.0:1746143766.520513:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2187263) req@ffff8800930d0a80 x1830963594272768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.520521:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0a80 with x1830963594272768 ext(2183168->2187263) 00002000:00010000:3.0:1746143766.520525:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0a80 00000100:00100000:3.0:1746143766.520541:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6407 00000100:00100000:3.0:1746143766.520547:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594272768:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143766.520674:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594272768:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 127us (535us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143766.520681:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6407 00002000:00100000:3.0:1746143766.520686:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2187263) req@ffff8800930d0a80 x1830963594272768/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.520692:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0a80 with x1830963594272768 ext(2183168->2187263) 00002000:00010000:3.0:1746143766.520695:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0a80 00000100:00100000:0.0:1746143766.532902:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.533002:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594273024 00000100:00100000:1.0:1746143766.533010:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594273024 00002000:00100000:1.0:1746143766.533046:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (2981888->2985983) req@ffff8800930d1880 x1830963594273024/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.533055:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1880 with x1830963594273024 ext(2981888->2985983) 00002000:00010000:1.0:1746143766.533060:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d1880 00000100:00100000:1.0:1746143766.533092:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6408 00000100:00100000:1.0:1746143766.533098:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594273024:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143766.533288:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594273024:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 189us (393us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143766.533294:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6408 00002000:00100000:1.0:1746143766.533299:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (2981888->2985983) req@ffff8800930d1880 x1830963594273024/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.533306:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1880 with x1830963594273024 ext(2981888->2985983) 00002000:00010000:1.0:1746143766.533309:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d1880 00000100:00100000:0.0:1746143766.543506:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.543609:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594273280 00000100:00100000:2.0:1746143766.543617:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594273280 00000100:00100000:2.0:1746143766.543671:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9231 00000100:00100000:2.0:1746143766.543677:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31431:x1830963594273280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.543699:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.543713:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d000/0xe984082ccd7304ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d7b expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.543810:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543820:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543830:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543840:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543845:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543849:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543940:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d600/0xe984082ccd7304c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543948:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d600/0xe984082ccd7304c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.543956:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d600/0xe984082ccd7304c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143766.543963:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143766.544030:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544035:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544040:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544045:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013061d200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143766.544049:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544054:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544063:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143766.544065:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143766.544068:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544072:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d200/0xe984082ccd7304b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544103:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544109:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544117:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544120:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013061d400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143766.544122:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544126:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544131:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484b00) 00010000:00010000:2.0:1746143766.544133:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143766.544135:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.544183:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7304ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.548304:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d000/0xe984082ccd7304ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d7b expref: 25 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.548329:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d600/0xe984082ccd7304c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d7b expref: 24 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.548337:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.548339:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143766.548342:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061d600, rc 0) 00000100:00100000:2.0:1746143766.548410:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31431:x1830963594273280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4731us (4910us total) trans 8589943567 rc 0/0 00000100:00100000:2.0:1746143766.548418:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9231 00000100:00100000:0.0:1746143766.558425:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.558462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.558500:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.558511:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594273408 00000100:00100000:2.0:1746143766.558516:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594273536 00000100:00100000:3.0:1746143766.558519:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594273408 00000100:00100000:2.0:1746143766.558519:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594273536 00000100:00100000:2.0:1746143766.558561:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594273664 00000100:00100000:2.0:1746143766.558563:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594273664 00000100:00100000:3.0:1746143766.558571:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 737 00000100:00100000:2.0:1746143766.558575:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13591 00000100:00100000:3.0:1746143766.558579:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594273408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143766.558584:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594273536:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143766.558584:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13592 00000100:00100000:0.0:1746143766.558589:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594273664:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.558597:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.558598:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.558598:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.558611:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d82 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.558611:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009066be00/0xe984082ccd7304cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d89 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.558619:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d600/0xe984082ccd7304c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d7b expref: 24 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.558626:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.558627:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.558634:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.558644:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.558645:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.558648:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.558653:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061de00, rc 0) 00000100:00100000:0.0:1746143766.558663:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594390272:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143766.558692:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594273536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.558693:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594273408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.558697:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13591 00000100:00100000:3.0:1746143766.558698:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 737 00000100:00100000:0.0:1746143766.558714:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1480 going to sleep for 11 seconds 00002000:00010000:2.0:1746143766.563340:0:21542:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143765 -> 1746143766 00002000:00010000:2.0:1746143766.563346:0:21542:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143765 -> 1746143766 00002000:00010000:2.0:1746143766.563348:0:21542:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143765 -> 1746143766 00000100:00100000:2.0:1746143766.563370:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594390272:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.563394:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009066be00/0xe984082ccd7304cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d89 expref: 19 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.563411:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009066be00/0xe984082ccd7304cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d89 expref: 19 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.563436:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009066be00, rc 0) 00000100:00100000:2.0:1746143766.563483:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594273664:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4892us (4982us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.563490:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13592 00000100:00100000:2.0:1746143766.571359:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.571359:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.571470:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594273920 00000100:00100000:3.0:1746143766.571478:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594273920 00000100:00100000:3.0:1746143766.571524:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9232 00000100:00100000:3.0:1746143766.571531:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31433:x1830963594273920:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.571552:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.571566:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635000/0xe984082ccd7304dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d90 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.571659:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571670:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571680:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571691:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571697:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571707:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571799:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635a00/0xe984082ccd7304f2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571807:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635a00/0xe984082ccd7304f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571813:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635a00/0xe984082ccd7304f2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143766.571821:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.571886:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571892:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571901:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571906:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0635200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.571909:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571914:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571924:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143766.571926:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.571929:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571933:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635200/0xe984082ccd7304e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571956:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571961:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571965:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571969:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0635800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143766.571971:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571976:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571985:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442c00) 00010000:00010000:3.0:1746143766.571987:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143766.571989:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.571994:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635800/0xe984082ccd7304eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.572024:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635000/0xe984082ccd7304dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d90 expref: 26 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.572034:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635a00/0xe984082ccd7304f2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d90 expref: 25 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.572040:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.572042:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143766.572044:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0635a00, rc 0) 00000100:00100000:3.0:1746143766.572095:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31433:x1830963594273920:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 563us (741us total) trans 8589943568 rc 0/0 00000100:00100000:3.0:1746143766.572101:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9232 00000100:00100000:3.0:1746143766.572120:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594274176 00000100:00100000:3.0:1746143766.572123:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594274176 00002000:00100000:3.0:1746143766.572164:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1892351) req@ffff88012fc13100 x1830963594274176/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.572173:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13100 with x1830963594274176 ext(1048576->1892351) 00002000:00010000:3.0:1746143766.572185:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13100 00000100:00100000:3.0:1746143766.572199:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6409 00000100:00100000:3.0:1746143766.572204:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594274176:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.577295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.578522:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594274176:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6313us (7165us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746143766.578532:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6409 00002000:00100000:3.0:1746143766.578541:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1892351) req@ffff88012fc13100 x1830963594274176/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.578550:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13100 with x1830963594274176 ext(1048576->1892351) 00002000:00010000:3.0:1746143766.578555:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13100 00000100:00100000:1.0:1746143766.578566:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594274304 00000100:00100000:1.0:1746143766.578572:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594274304 00000100:00100000:1.0:1746143766.578622:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 738 00000100:00100000:1.0:1746143766.578629:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594274304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.578639:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.578658:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0635a00/0xe984082ccd7304f2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d90 expref: 25 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.578882:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143766.578887:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.578918:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963594274304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 290us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.578924:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 738 00000100:00100000:0.0:1746143766.589940:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.589993:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594274560 00000100:00100000:3.0:1746143766.590001:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594274560 00002000:00100000:3.0:1746143766.590033:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012fc11c00 x1830963594274560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.590039:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11c00 with x1830963594274560 ext(2097152->3145727) 00002000:00010000:3.0:1746143766.590042:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc11c00 00000100:00100000:3.0:1746143766.590065:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6410 00000100:00100000:3.0:1746143766.590071:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594274560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143766.599290:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594274560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9209us (9348us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.599301:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6410 00002000:00100000:3.0:1746143766.599312:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012fc11c00 x1830963594274560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.599320:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11c00 with x1830963594274560 ext(2097152->3145727) 00002000:00010000:3.0:1746143766.599325:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc11c00 00000100:00100000:0.0:1746143766.602637:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.602734:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594274688 00000100:00100000:2.0:1746143766.602742:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594274688 00000100:00100000:2.0:1746143766.602779:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13593 00000100:00100000:2.0:1746143766.602785:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31431:x1830963594274688:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.602799:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.602814:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d97 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.602837:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 34 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.602844:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.602846:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.602849:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.602872:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 34 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.602887:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 34 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.602898:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594390400:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.603633:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.605052:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594390400:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.605076:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.605087:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061c600, rc 0) 00000100:00100000:2.0:1746143766.605127:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31431:x1830963594274688:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2341us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.605134:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13593 00000100:00100000:0.0:1746143766.608389:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.608602:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594274816 00000100:00100000:3.0:1746143766.608611:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594274816 00002000:00100000:3.0:1746143766.608648:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2985983) req@ffff88012fc12d80 x1830963594274816/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.608658:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12d80 with x1830963594274816 ext(2183168->2985983) 00010000:00010000:3.0:1746143766.608665:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 35 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.608677:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 35 pid: 15784 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.608684:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc12d80 00000100:00100000:3.0:1746143766.608714:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1815 00000100:00100000:3.0:1746143766.608721:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594274816:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143766.619910:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594274816:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 11181us (11522us total) trans 17179873142 rc 0/0 00000100:00100000:3.0:1746143766.619921:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1815 00002000:00100000:3.0:1746143766.619931:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2985983) req@ffff88012fc12d80 x1830963594274816/t17179873142(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.619939:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12d80 with x1830963594274816 ext(2183168->2985983) 00010000:00010000:3.0:1746143766.619947:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.619961:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.619972:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc12d80 00000100:00100000:0.0:1746143766.624584:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.624688:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594274944 00000100:00100000:1.0:1746143766.624696:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594274944 00010000:00010000:1.0:1746143766.624728:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.624765:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7285 00000100:00100000:1.0:1746143766.624772:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594274944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.624782:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.624799:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.624809:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.624825:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0634e00/0xe984082ccd7304a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2985983) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d74 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.624856:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.624858:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.624864:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.624871:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.624899:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 18 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.624910:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594390528:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.625664:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.627520:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594390528:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.627538:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.627569:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963594274944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2797us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.627577:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7285 00000100:00100000:0.0:1746143766.633419:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.633462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.633491:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.633513:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594275200 00000100:00100000:2.0:1746143766.633520:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594275200 00000100:00100000:0.0:1746143766.633529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.633555:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13594 00000100:00100000:2.0:1746143766.633562:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31433:x1830963594275200:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143766.633576:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.633589:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7d9e expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.633612:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.633614:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594275328 00000100:00100000:3.0:1746143766.633618:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594275328 00000100:00100000:1.0:1746143766.633618:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594275584 00000100:00100000:1.0:1746143766.633622:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594275584 00010000:00010000:2.0:1746143766.633623:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.633628:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.633630:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.633633:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143766.633642:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012fc13800 x1830963594275328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.633642:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012fc10a80 x1830963594275584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.633649:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13800 with x1830963594275328 ext(2097152->3145727) 00002000:00100000:1.0:1746143766.633649:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10a80 with x1830963594275584 ext(3145728->4194303) 00002000:00010000:1.0:1746143766.633651:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc10a80 00002000:00010000:3.0:1746143766.633652:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13800 00010000:00010000:2.0:1746143766.633656:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.633666:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 25 pid: 15784 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.633674:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594275840 00000100:00100000:2.0:1746143766.633676:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594390656:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.633677:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594275840 00002000:00100000:3.0:1746143766.633689:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012fc13480 x1830963594275840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.633694:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13480 with x1830963594275840 ext(3145728->4194303) 00010000:00010000:3.0:1746143766.633698:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 26 pid: 15784 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.633708:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 26 pid: 15784 timeout: 945 lvb_type: 1 00002000:00010000:3.0:1746143766.633714:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc13480 00000100:00100000:1.0:1746143766.633714:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6411 00000100:00100000:1.0:1746143766.633720:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594275328:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143766.633723:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6412 00000100:00100000:2.0:1746143766.633728:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594275584:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143766.633738:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1816 00000100:00100000:3.0:1746143766.633744:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594275840:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:2.0:1746143766.635090:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.635101:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 20 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.635111:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594390784:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.635186:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.639723:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594390656:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.639734:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594390784:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.639759:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 27 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.639774:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061dc00, rc 0) 00000100:00100000:2.0:1746143766.639815:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31433:x1830963594275200:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6253us (6404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.639823:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13594 00000100:00100000:1.0:1746143766.640125:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594275328:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 6403us (6660us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.640133:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6411 00002000:00100000:1.0:1746143766.640159:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012fc13800 x1830963594275328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.640168:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13800 with x1830963594275328 ext(2097152->3145727) 00002000:00010000:1.0:1746143766.640173:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc13800 00000100:00100000:0.0:1746143766.640610:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.640666:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594275968 00000100:00100000:1.0:1746143766.640670:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594275968 00010000:00010000:1.0:1746143766.640689:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 21 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.640710:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7286 00000100:00100000:1.0:1746143766.640714:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594275968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.640721:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.640734:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 21 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.640740:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 21 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.640755:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013061cc00/0xe984082ccd730490 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d5f expref: 21 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.640850:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.641910:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594275968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1190us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.641917:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7286 00000100:00100000:3.0:1746143766.646795:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594275840:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 13041us (13256us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.646864:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1816 00002000:00100000:3.0:1746143766.646875:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012fc13480 x1830963594275840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.646884:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13480 with x1830963594275840 ext(3145728->4194303) 00010000:00010000:3.0:1746143766.646893:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 25 pid: 15784 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.646905:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 25 pid: 15784 timeout: 945 lvb_type: 1 00002000:00010000:3.0:1746143766.646911:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc13480 00000100:00100000:0.0:1746143766.647317:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.647357:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594276096 00000100:00100000:2.0:1746143766.647363:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594276096 00000100:00100000:2.0:1746143766.647391:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13595 00000100:00100000:2.0:1746143766.647397:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31431:x1830963594276096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.647408:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.647420:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7da5 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.647440:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.647442:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.647448:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.647461:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 26 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.647476:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061d400, rc 0) 00000100:00100000:2.0:1746143766.647496:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31431:x1830963594276096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 100us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.647501:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13595 00000100:00100000:3.0:1746143766.647824:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594275584:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14094us (14331us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.647830:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6412 00002000:00100000:3.0:1746143766.647835:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012fc10a80 x1830963594275584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.647841:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10a80 with x1830963594275584 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.647844:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc10a80 00000100:00100000:0.0:1746143766.650220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.650324:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594276224 00000100:00100000:1.0:1746143766.650330:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594276224 00010000:00010000:1.0:1746143766.650356:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 26 pid: 15784 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143766.650392:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7287 00000100:00100000:1.0:1746143766.650398:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594276224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.650410:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.650429:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 26 pid: 15784 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.650439:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 26 pid: 15784 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.650455:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013061de00/0xe984082ccd7304d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d82 expref: 26 pid: 15784 timeout: 945 lvb_type: 1 00010000:00010000:1.0:1746143766.650730:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.650733:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.650739:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.651318:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.651348:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 25 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.651358:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594390912:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.651432:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.653426:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.653480:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594276480 00000100:00100000:3.0:1746143766.653486:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594276480 00002000:00100000:3.0:1746143766.653518:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800949f3480 x1830963594276480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.653527:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3480 with x1830963594276480 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.653532:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f3480 00000100:00100000:3.0:1746143766.653561:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6413 00000100:00100000:3.0:1746143766.653568:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594276480:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143766.653800:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.653851:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594276736 00000100:00100000:2.0:1746143766.653855:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594276736 00002000:00100000:2.0:1746143766.653872:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2895872->2899967) req@ffff8800949f3b80 x1830963594276736/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.653878:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3b80 with x1830963594276736 ext(2895872->2899967) 00002000:00010000:2.0:1746143766.653882:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f3b80 00000100:00100000:2.0:1746143766.653895:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6414 00000100:00100000:2.0:1746143766.653900:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594276736:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143766.653911:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594390912:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.653927:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.653959:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594276224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3560us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.653967:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7287 00000100:00100000:2.0:1746143766.653998:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594276736:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 98us (199us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143766.654004:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6414 00002000:00100000:2.0:1746143766.654009:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2895872->2899967) req@ffff8800949f3b80 x1830963594276736/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.654015:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3b80 with x1830963594276736 ext(2895872->2899967) 00002000:00010000:2.0:1746143766.654017:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f3b80 00000100:00100000:0.0:1746143766.660894:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.661033:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594276864 00000100:00100000:2.0:1746143766.661041:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594276864 00000100:00100000:2.0:1746143766.661089:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13596 00000100:00100000:2.0:1746143766.661095:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31433:x1830963594276864:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143766.661111:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.661125:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7dac expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.661189:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.661196:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.661197:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.661200:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->2490367] (req 2097152->2490367) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.661225:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.661236:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 20 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.661246:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594391040:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.661311:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.662072:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594276480:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8503us (8648us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.662080:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6413 00002000:00100000:3.0:1746143766.662089:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800949f3480 x1830963594276480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.662097:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f3480 with x1830963594276480 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.662100:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f3480 00000100:00100000:2.0:1746143766.663309:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594391040:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.663329:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->2490367] (req 2097152->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.663341:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061d000, rc 0) 00000100:00100000:2.0:1746143766.663376:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31433:x1830963594276864:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2281us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.663382:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13596 00000100:00100000:0.0:1746143766.665503:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.665765:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.665820:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594277120 00000100:00100000:2.0:1746143766.665827:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594277120 00000100:00100000:1.0:1746143766.665837:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594276992 00000100:00100000:1.0:1746143766.665841:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594276992 00010000:00010000:1.0:1746143766.665861:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.665865:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13597 00000100:00100000:2.0:1746143766.665871:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31431:x1830963594277120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.665882:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.665893:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7db3 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.665897:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7288 00000100:00100000:1.0:1746143766.665903:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594276992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.665911:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.665913:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.665915:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.665920:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.665936:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.665937:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.665945:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061c400, rc 0) 00010000:00010000:1.0:1746143766.665952:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.665966:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013061c600/0xe984082ccd730500 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d97 expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.665980:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143766.665981:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31431:x1830963594277120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 109us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143766.665981:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143766.665986:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13597 00010000:00010000:1.0:1746143766.665986:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.665993:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.666015:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.666031:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594391168:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.666075:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.671961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.672115:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594391168:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.672132:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.672214:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5a26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594276992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6311us (6715us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.672224:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7288 00000100:00100000:0.0:1746143766.672277:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.672292:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594277376 00000100:00100000:0.0:1746143766.672297:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594277376 00002000:00100000:0.0:1746143766.672328:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800949f0000 x1830963594277376/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.672337:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0000 with x1830963594277376 ext(3145728->4194303) 00002000:00010000:0.0:1746143766.672341:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0000 00000100:00100000:0.0:1746143766.672352:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594277632 00000100:00100000:0.0:1746143766.672354:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594277632 00002000:00100000:0.0:1746143766.672364:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2486272->2490367) req@ffff8800949f1c00 x1830963594277632/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.672370:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963594277632 ext(2486272->2490367) 00002000:00010000:0.0:1746143766.672373:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:3.0:1746143766.672379:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6415 00000100:00100000:2.0:1746143766.672387:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6416 00000100:00100000:3.0:1746143766.672388:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594277376:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143766.672394:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594277632:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143766.672591:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594277632:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 197us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143766.672601:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6416 00002000:00100000:2.0:1746143766.672606:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2486272->2490367) req@ffff8800949f1c00 x1830963594277632/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.672612:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1c00 with x1830963594277632 ext(2486272->2490367) 00002000:00010000:2.0:1746143766.672615:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1c00 00000100:00100000:2.0:1746143766.675218:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.675727:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594277888 00000100:00100000:1.0:1746143766.675735:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594277888 00000100:00100000:1.0:1746143766.675780:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3974 00000100:00100000:1.0:1746143766.675788:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31433:x1830963594277888:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143766.675982:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31433:x1830963594277888:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 195us (769us total) trans 8589943569 rc 0/0 00000100:00100000:1.0:1746143766.675989:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3974 00000100:00100000:2.0:1746143766.680839:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594277376:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8446us (8876us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.680849:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6415 00002000:00100000:2.0:1746143766.680858:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800949f0000 x1830963594277376/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.680878:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0000 with x1830963594277376 ext(3145728->4194303) 00002000:00010000:2.0:1746143766.680884:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f0000 00000100:00100000:0.0:1746143766.684582:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.684631:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.684695:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594278016 00000100:00100000:3.0:1746143766.684702:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594278016 00000100:00100000:3.0:1746143766.684747:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594278144 00000100:00100000:3.0:1746143766.684752:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594278144 00000100:00100000:0.0:1746143766.684763:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13598 00000100:00100000:0.0:1746143766.684770:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594278016:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143766.684773:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13599 00000100:00100000:3.0:1746143766.684779:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594278144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.684785:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.684785:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.684796:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd730523 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7dc1 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.684796:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009066a800/0xe984082ccd73052a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7dba expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.684820:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009066a800/0xe984082ccd73052a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dba expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.684828:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009066a800/0xe984082ccd73052a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dba expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.684855:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009066a800, rc 0) 00010000:00010000:3.0:1746143766.685001:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd730523 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dc1 expref: 21 pid: 2839 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143766.685002:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594278016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 232us (426us total) trans 0 rc 301/301 00010000:00010000:3.0:1746143766.685009:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd730523 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dc1 expref: 21 pid: 2839 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143766.685009:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13598 00010000:00010000:3.0:1746143766.685023:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4000, rc 0) 00000100:00100000:3.0:1746143766.685040:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594278144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 262us (409us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.685045:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13599 00000100:00100000:0.0:1746143766.687963:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.688067:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594278400 00000100:00100000:2.0:1746143766.688073:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594278400 00002000:00100000:2.0:1746143766.688107:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800949f1500 x1830963594278400/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.688117:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1500 with x1830963594278400 ext(4194304->4771839) 00002000:00010000:2.0:1746143766.688122:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1500 00000100:00100000:2.0:1746143766.688167:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6417 00000100:00100000:2.0:1746143766.688183:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594278400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.694231:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594278400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6050us (6267us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143766.694244:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6417 00002000:00100000:2.0:1746143766.694254:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800949f1500 x1830963594278400/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.694263:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1500 with x1830963594278400 ext(4194304->4771839) 00002000:00010000:2.0:1746143766.694268:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f1500 00000100:00100000:0.0:1746143766.697507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.697581:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594278528 00000100:00100000:3.0:1746143766.697589:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594278528 00000100:00100000:3.0:1746143766.697644:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13600 00000100:00100000:3.0:1746143766.697652:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594278528:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.697666:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.697681:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730531 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7dc8 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.697707:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730531 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dc8 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.697717:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730531 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dc8 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.697730:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4000, rc 0) 00000100:00100000:0.0:1746143766.697777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.697784:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594278528:12345-192.168.202.48@tcp:101:cat.0 Request processed in 133us (287us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.697790:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13600 00000100:00100000:3.0:1746143766.697801:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594278656 00000100:00100000:3.0:1746143766.697804:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594278656 00000100:00100000:3.0:1746143766.697817:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13601 00000100:00100000:3.0:1746143766.697822:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594278656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.697829:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.697847:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900e4400/0xe984082ccd730538 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7dcf expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.697861:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4400/0xe984082ccd730538 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dcf expref: 21 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.697868:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4400/0xe984082ccd730538 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dcf expref: 21 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.697879:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4400, rc 0) 00000100:00100000:3.0:1746143766.697901:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594278656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 78us (126us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.697906:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13601 00000100:00100000:0.0:1746143766.700357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.700688:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594278784 00000100:00100000:3.0:1746143766.700696:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594278784 00000100:00100000:3.0:1746143766.700761:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13602 00000100:00100000:3.0:1746143766.700769:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594278784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.700786:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.700801:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900e4600/0xe984082ccd73053f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7dd6 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.700830:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4600/0xe984082ccd73053f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dd6 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.700841:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4600/0xe984082ccd73053f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dd6 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.700851:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4600, rc 0) 00000100:00100000:3.0:1746143766.700916:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594278784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 146us (1386us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.700922:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13602 00000100:00100000:0.0:1746143766.701463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.701631:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594278912 00000100:00100000:2.0:1746143766.701637:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594278912 00000100:00100000:2.0:1746143766.701687:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13603 00000100:00100000:2.0:1746143766.701694:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594278912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.701703:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.701714:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013061c000/0xe984082ccd730546 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ddd expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.701734:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013061c000/0xe984082ccd730546 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ddd expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.701743:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013061c000/0xe984082ccd730546 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ddd expref: 21 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.701775:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061c000, rc 0) 00000100:00100000:2.0:1746143766.701807:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594278912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 113us (343us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.701813:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13603 00000100:00100000:0.0:1746143766.709094:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.709211:0:14766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594279168 00000100:00100000:3.0:1746143766.709219:0:14766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594279168 00000100:00100000:3.0:1746143766.709830:0:14766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3975 00000100:00100000:3.0:1746143766.709839:0:14766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6454450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31431:x1830963594279168:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143766.710034:0:14766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6454450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31431:x1830963594279168:12345-192.168.202.48@tcp:35:cat.0 Request processed in 196us (946us total) trans 8589943570 rc 0/0 00000100:00100000:3.0:1746143766.710041:0:14766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3975 00000100:00100000:0.0:1746143766.714685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.714898:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594279296 00000100:00100000:3.0:1746143766.714906:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594279296 00000100:00100000:3.0:1746143766.715132:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13604 00000100:00100000:3.0:1746143766.715181:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31435:x1830963594279296:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.715196:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.715210:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7de4 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.715235:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.715242:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143766.715243:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143766.715246:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 37 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.715272:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 19 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.715283:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 19 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.715293:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594391296:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.715372:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.717838:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.717906:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594391296:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.717924:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 37 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.717944:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4800, rc 0) 00000100:00100000:3.0:1746143766.717994:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:31435:x1830963594279296:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2854us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.718002:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13604 00000100:00100000:2.0:1746143766.718291:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594279424 00000100:00100000:2.0:1746143766.718297:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594279424 00002000:00100000:2.0:1746143766.718329:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2490367) req@ffff88009ff6c700 x1830963594279424/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.718337:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963594279424 ext(2097152->2490367) 00010000:00010000:2.0:1746143766.718343:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 20 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.718353:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 20 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143766.718359:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6c700 00000100:00100000:2.0:1746143766.718373:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1817 00000100:00100000:2.0:1746143766.718377:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594279424:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143766.722947:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594279424:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4559us (5105us total) trans 17179873143 rc 0/0 00000100:00100000:2.0:1746143766.722958:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1817 00002000:00100000:2.0:1746143766.722968:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2490367) req@ffff88009ff6c700 x1830963594279424/t17179873143(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.722977:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963594279424 ext(2097152->2490367) 00010000:00010000:2.0:1746143766.722986:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.722999:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143766.723005:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6c700 00000100:00100000:0.0:1746143766.725226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.725261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.725291:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.725521:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594279808 00000100:00100000:1.0:1746143766.725528:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594279808 00010000:00010000:1.0:1746143766.725556:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.725582:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7289 00000100:00100000:1.0:1746143766.725588:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594279808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.725600:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.725617:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.725627:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.725645:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013061d000/0xe984082ccd730515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2490367) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7dac expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.725662:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.725663:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.725668:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 36 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.725679:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 36 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.725704:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 36 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.725714:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594391424:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143766.725740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.725803:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594279552 00000100:00100000:3.0:1746143766.725806:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594279552 00000100:00100000:3.0:1746143766.725835:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594279680 00000100:00100000:3.0:1746143766.725837:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594279680 00000100:00100000:2.0:1746143766.725840:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594279936 00000100:00100000:2.0:1746143766.725843:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594279936 00000100:00100000:3.0:1746143766.725854:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13605 00000100:00100000:2.0:1746143766.725858:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13606 00000100:00100000:3.0:1746143766.725859:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594279552:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143766.725863:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594279680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143766.725876:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.725876:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.725887:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730554 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7deb expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.725887:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08000/0xe984082ccd73055b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7df2 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.725903:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08000/0xe984082ccd73055b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7df2 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.725910:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c08000/0xe984082ccd73055b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7df2 expref: 23 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143766.725912:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594391552:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.725919:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c08000, rc 0) 00000100:00100000:2.0:1746143766.725946:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594279680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 82us (684us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.725951:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13606 00000100:00100000:3.0:1746143766.725955:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.725973:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13607 00000100:00100000:2.0:1746143766.725977:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594279936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.725984:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.725989:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4c09e00/0xe984082ccd730562 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7df9 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.726007:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c09e00/0xe984082ccd730562 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7df9 expref: 38 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.726018:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c09e00/0xe984082ccd730562 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7df9 expref: 38 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.726025:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09e00, rc 0) 00000100:00100000:2.0:1746143766.726039:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594279936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 62us (299us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.726044:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13607 00000100:00100000:1.0:1746143766.726123:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.727274:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594391552:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143766.727292:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730554 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7deb expref: 21 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.727302:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730554 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7deb expref: 21 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.727326:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4400, rc 0) 00000100:00100000:3.0:1746143766.727359:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594279552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1498us (2137us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.727368:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13605 00000100:00100000:1.0:1746143766.727401:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594391424:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.727411:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.727426:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594279808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1838us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.727432:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7289 00000100:00100000:0.0:1746143766.727696:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.727812:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594280192 00000100:00100000:2.0:1746143766.727816:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594280192 00002000:00100000:2.0:1746143766.727840:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2928640->2932735) req@ffff88009ff6e300 x1830963594280192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.727847:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963594280192 ext(2928640->2932735) 00002000:00010000:2.0:1746143766.727851:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6e300 00000100:00100000:2.0:1746143766.727863:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6418 00000100:00100000:2.0:1746143766.727868:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594280192:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143766.728082:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594280192:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 212us (385us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143766.728088:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6418 00002000:00100000:2.0:1746143766.728092:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2928640->2932735) req@ffff88009ff6e300 x1830963594280192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.728098:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e300 with x1830963594280192 ext(2928640->2932735) 00002000:00010000:2.0:1746143766.728101:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6e300 00000100:00100000:0.0:1746143766.731879:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.732069:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594280320 00000100:00100000:3.0:1746143766.732076:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594280320 00000100:00100000:3.0:1746143766.732123:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13608 00000100:00100000:3.0:1746143766.732130:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31435:x1830963594280320:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.732168:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.732191:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e00 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.732218:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.732231:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143766.732232:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143766.732235:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3583999] (req 3145728->3583999) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.732262:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.732273:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.732283:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594391680:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.732377:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.732871:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.732912:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594280448 00000100:00100000:2.0:1746143766.732917:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594280448 00000100:00100000:2.0:1746143766.732936:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13609 00000100:00100000:2.0:1746143766.732941:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31440:x1830963594280448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.732948:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.732955:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e07 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.732968:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.732974:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.732975:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.732978:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.732990:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.732996:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.733003:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594391808:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.733026:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.733536:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594391680:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.733554:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->3583999] (req 3145728->3583999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.733566:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0635600, rc 0) 00000100:00100000:3.0:1746143766.733602:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31435:x1830963594280320:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1472us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.733608:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13608 00000100:00100000:2.0:1746143766.734077:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594391808:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.734089:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.734104:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013061d600, rc 0) 00000100:00100000:2.0:1746143766.734135:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31440:x1830963594280448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1193us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.734182:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13609 00000100:00100000:0.0:1746143766.734424:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.734524:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594280576 00000100:00100000:3.0:1746143766.734528:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594280576 00002000:00100000:3.0:1746143766.734552:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1892352->2097151) req@ffff88009ff6f800 x1830963594280576/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.734567:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f800 with x1830963594280576 ext(1892352->2097151) 00010000:00010000:3.0:1746143766.734573:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.734582:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.734587:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6f800 00000100:00100000:3.0:1746143766.734599:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1818 00000100:00100000:3.0:1746143766.734604:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594280576:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143766.737015:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.737113:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594280704 00000100:00100000:1.0:1746143766.737119:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594280704 00010000:00010000:1.0:1746143766.737164:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.737203:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7290 00000100:00100000:1.0:1746143766.737210:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594280704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.737221:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.737236:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.737252:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.737270:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013061d400/0xe984082ccd73050e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7da5 expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.737286:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.737287:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.737293:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.737301:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.737325:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.737335:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594391936:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.737381:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.738439:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594280576:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3832us (4012us total) trans 21474840465 rc 0/0 00000100:00100000:3.0:1746143766.738446:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1818 00002000:00100000:3.0:1746143766.738453:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1892352->2097151) req@ffff88009ff6f800 x1830963594280576/t21474840465(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.738459:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f800 with x1830963594280576 ext(1892352->2097151) 00010000:00010000:3.0:1746143766.738464:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.738472:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.738476:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6f800 00000100:00100000:1.0:1746143766.739561:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594391936:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.739577:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.739701:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594280704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2490us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.739710:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7290 00000100:00100000:0.0:1746143766.743691:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.744285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.744464:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594281088 00000100:00100000:1.0:1746143766.744471:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594281088 00010000:00010000:1.0:1746143766.744501:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 26 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.744544:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7291 00000100:00100000:1.0:1746143766.744551:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594281088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.744564:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.744583:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 26 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.744594:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 26 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.744613:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba31e00/0xe984082ccd730474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d43 expref: 26 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.744674:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.744676:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.744683:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.744691:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 21 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.744696:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594280960 00000100:00100000:3.0:1746143766.744700:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594280960 00010000:00010000:1.0:1746143766.744718:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143766.744726:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3579904->3583999) req@ffff88009ff6f100 x1830963594280960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143766.744727:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594392064:192.168.202.48@tcp:105: 00002000:00100000:3.0:1746143766.744735:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f100 with x1830963594280960 ext(3579904->3583999) 00002000:00010000:3.0:1746143766.744739:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6f100 00000100:00100000:3.0:1746143766.744784:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6419 00000100:00100000:3.0:1746143766.744790:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594280960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143766.744966:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5139f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.745024:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594280960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 233us (1342us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143766.745029:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6419 00002000:00100000:3.0:1746143766.745034:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3579904->3583999) req@ffff88009ff6f100 x1830963594280960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.745039:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f100 with x1830963594280960 ext(3579904->3583999) 00002000:00010000:3.0:1746143766.745042:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6f100 00000100:00100000:1.0:1746143766.748447:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594392064:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.748466:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.748510:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594281088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3958us (4225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.748518:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7291 00000100:00100000:0.0:1746143766.750834:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.750937:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594281344 00000100:00100000:3.0:1746143766.750943:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594281344 00002000:00100000:3.0:1746143766.750980:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009c274380 x1830963594281344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.750989:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274380 with x1830963594281344 ext(1048576->2097151) 00002000:00010000:3.0:1746143766.750994:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c274380 00000100:00100000:3.0:1746143766.751025:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6420 00000100:00100000:3.0:1746143766.751031:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594281344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143766.759038:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594281344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7998us (8202us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.759051:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6420 00002000:00100000:3.0:1746143766.759060:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009c274380 x1830963594281344/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.759069:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274380 with x1830963594281344 ext(1048576->2097151) 00002000:00010000:3.0:1746143766.759074:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c274380 00000100:00100000:0.0:1746143766.765839:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.765949:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594281472 00000100:00100000:2.0:1746143766.765956:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594281472 00000100:00100000:2.0:1746143766.766003:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13610 00000100:00100000:2.0:1746143766.766009:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31440:x1830963594281472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.766024:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.766039:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e0e expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.766063:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.766070:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.766071:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.766074:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.766098:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 24 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.766107:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 24 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.766121:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594392192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.766492:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.768613:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.768666:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594281600 00000100:00100000:3.0:1746143766.768671:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594281600 00002000:00100000:3.0:1746143766.768742:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2895872->3145727) req@ffff88009c275500 x1830963594281600/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.768750:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275500 with x1830963594281600 ext(2895872->3145727) 00010000:00010000:3.0:1746143766.768756:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.768768:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.768773:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c275500 00000100:00100000:3.0:1746143766.768788:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1819 00000100:00100000:3.0:1746143766.768794:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594281600:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143766.768855:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594392192:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.768873:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 23 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.768886:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4200, rc 0) 00000100:00100000:2.0:1746143766.768936:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31440:x1830963594281472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2927us (3103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.768943:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13610 00000100:00100000:0.0:1746143766.769657:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.769722:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594281728 00000100:00100000:3.0:1746143766.769726:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594281728 00000100:00100000:3.0:1746143766.769747:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9233 00000100:00100000:3.0:1746143766.769752:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31442:x1830963594281728:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143766.769764:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.769776:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd73057e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e15 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.769819:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769829:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769837:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769859:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769864:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769869:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769959:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769968:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 256 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.769973:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.769994:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 256 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.770002:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 256 pid: 16090 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.770011:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594392320:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.770069:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.771534:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594392320:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.771552:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:0.0:1746143766.771605:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.771677:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594281984 00000100:00100000:1.0:1746143766.771681:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594281984 00000100:00100000:1.0:1746143766.771707:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3976 00000100:00100000:1.0:1746143766.771713:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:27138:x1830963594281984:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143766.771850:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:27138:x1830963594281984:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 136us (245us total) trans 8589943571 rc 0/0 00000100:00100000:1.0:1746143766.771856:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3976 00000100:00100000:3.0:1746143766.773221:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963594281600:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4423us (4610us total) trans 21474840466 rc 0/0 00000100:00100000:3.0:1746143766.773230:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1819 00000100:00100000:0.0:1746143766.773231:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143766.773238:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2895872->3145727) req@ffff88009c275500 x1830963594281600/t21474840466(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.773246:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275500 with x1830963594281600 ext(2895872->3145727) 00010000:00010000:3.0:1746143766.773253:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.773263:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.773269:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c275500 00000100:00100000:1.0:1746143766.773293:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594282112 00000100:00100000:1.0:1746143766.773297:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594282112 00010000:00010000:1.0:1746143766.773313:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 258 pid: 16090 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.773341:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7292 00000100:00100000:1.0:1746143766.773346:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1965:x1830963594282112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.773355:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.773468:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 258 pid: 16090 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.773479:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 258 pid: 16090 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.773500:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061da00/0xe984082ccd730466 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d3c expref: 258 pid: 16090 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.773511:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143766.773515:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.773523:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.773528:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143766.773554:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.773569:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773575:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:1.0:1746143766.773581:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1965:x1830963594282112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 235us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.773586:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7292 00000004:00200000:2.0:1746143766.773604:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:2.0:1746143766.773608:0:2976:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143766.773620:0:2976:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773629:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773641:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773770:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773777:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773782:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130c08000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143766.773786:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773792:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773800:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143766.773802:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143766.773805:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773809:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c08000/0xe984082ccd730585 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773834:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773839:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773844:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773847:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ef26000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143766.773850:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773854:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773860:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442300) 00010000:00010000:2.0:1746143766.773862:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143766.773864:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773868:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26000/0xe984082ccd73058c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.773892:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd73057e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.773901:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.773906:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.773912:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143766.773913:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ef26200, rc 0) 00000100:00100000:2.0:1746143766.773947:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31442:x1830963594281728:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4194us (4289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.773953:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9233 00000100:00100000:0.0:1746143766.775005:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.775072:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594282240 00000100:00100000:1.0:1746143766.775077:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594282240 00010000:00010000:1.0:1746143766.775095:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.775270:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7293 00000100:00100000:1.0:1746143766.775277:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594282240:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.775285:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.775301:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.775314:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.775327:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013061dc00/0xe984082ccd730507 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2895872->3145727] (req 2895872->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d9e expref: 27 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.775338:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.775340:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.775345:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.775352:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.775374:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.775383:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594392448:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.775443:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.775825:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.776423:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594282368 00000100:00100000:2.0:1746143766.776427:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594282368 00000100:00100000:2.0:1746143766.776463:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13611 00000100:00100000:2.0:1746143766.776469:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594282368:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143766.776482:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.776494:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e1c expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.776506:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.776508:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.776513:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.776522:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 10 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.776529:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4000, rc 0) 00000100:00100000:2.0:1746143766.776557:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594282368:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 89us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.776562:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13611 00000100:00100000:0.0:1746143766.776756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.776914:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.776937:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.777065:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594282496 00000100:00100000:2.0:1746143766.777069:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594282496 00000100:00100000:2.0:1746143766.777209:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594282624 00000100:00100000:2.0:1746143766.777212:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594282624 00000100:00100000:1.0:1746143766.777323:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594282752 00000100:00100000:3.0:1746143766.777327:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13612 00000100:00100000:1.0:1746143766.777327:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594282752 00000100:00100000:3.0:1746143766.777335:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594282496:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143766.777342:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.777350:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e23 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.777352:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13613 00000100:00100000:1.0:1746143766.777357:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594282624:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143766.777361:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.777362:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.777364:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.777367:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.777371:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd7305a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e2a expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.777375:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.777382:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f5de00, rc 0) 00000100:00100000:3.0:1746143766.777401:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594282496:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 68us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.777403:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594392576:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143766.777406:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13612 00000100:00100000:3.0:1746143766.777416:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13614 00000100:00100000:3.0:1746143766.777420:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594282752:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143766.777425:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.777431:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900e4600/0xe984082ccd7305af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e31 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.777437:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e33c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143766.777443:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4600/0xe984082ccd7305af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e31 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.777448:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143766.777450:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4600/0xe984082ccd7305af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e31 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.777460:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4600, rc 0) 00000100:00100000:3.0:1746143766.777473:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594282752:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 52us (535us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143766.777477:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13614 00000100:00100000:0.0:1746143766.778679:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.778929:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594283008 00000100:00100000:3.0:1746143766.778934:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594283008 00002000:00100000:3.0:1746143766.778962:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009c277100 x1830963594283008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.778971:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277100 with x1830963594283008 ext(2097152->3145727) 00002000:00010000:3.0:1746143766.778974:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c277100 00000100:00100000:3.0:1746143766.778987:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6421 00000100:00100000:3.0:1746143766.778993:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594283008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143766.779269:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594392448:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.779286:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.779312:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594282240:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4035us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.779319:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7293 00000100:00100000:1.0:1746143766.779634:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594392576:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143766.779650:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd7305a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e2a expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.779659:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd7305a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e2a expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.779667:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4c00, rc 0) 00000100:00100000:1.0:1746143766.779700:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594282624:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 2342us (2786us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143766.779870:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13613 00000100:00100000:0.0:1746143766.781986:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.782171:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594283264 00000100:00100000:2.0:1746143766.782185:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594283264 00000100:00100000:2.0:1746143766.782231:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9234 00000100:00100000:2.0:1746143766.782238:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31442:x1830963594283264:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143766.782253:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.782268:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7305b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e38 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.782354:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.782365:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.782370:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.782395:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.782404:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 12 pid: 2976 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.782413:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594392704:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.782483:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.787195:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594283008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8195us (8511us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.787204:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6421 00002000:00100000:3.0:1746143766.787214:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009c277100 x1830963594283008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.787223:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277100 with x1830963594283008 ext(2097152->3145727) 00002000:00010000:3.0:1746143766.787227:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c277100 00000100:00100000:2.0:1746143766.787537:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594392704:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.787552:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:1.0:1746143766.788079:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.788137:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594283392 00000100:00100000:0.0:1746143766.788159:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594283392 00010000:00010000:0.0:1746143766.788187:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 13 pid: 2976 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.788216:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7294 00000100:00100000:0.0:1746143766.788222:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594283392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.788233:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.788237:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 13 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.788246:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 13 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.788264:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ef26200/0xe984082ccd730593 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e15 expref: 13 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.788277:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143766.788281:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143766.788288:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143766.788294:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143766.788316:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143766.788335:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594283392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.788340:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7294 00010000:00010000:2.0:1746143766.788364:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143766.788371:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143766.788388:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143766.788506:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013061d400/0xe984082ccd7305b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e38 expref: 13 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.788522:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e38 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.788528:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.788530:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143766.788533:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4c09e00, rc 0) 00000100:00100000:2.0:1746143766.788854:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31442:x1830963594283264:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6616us (6872us total) trans 8589943572 rc 0/0 00000100:00100000:2.0:1746143766.788860:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9234 00000100:00100000:0.0:1746143766.792808:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.792984:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594283648 00000100:00100000:1.0:1746143766.792991:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594283648 00000100:00100000:1.0:1746143766.793054:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13615 00000100:00100000:1.0:1746143766.793061:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:31440:x1830963594283648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.793076:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.793090:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e46 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.793115:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.793121:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.793123:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143766.793126:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 38 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.793186:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.793197:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.793207:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594392832:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143766.793278:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.794715:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.794786:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594283776 00000100:00100000:3.0:1746143766.794791:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594283776 00000100:00100000:3.0:1746143766.794820:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9235 00000100:00100000:3.0:1746143766.794825:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31442:x1830963594283776:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143766.794840:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.794843:0:2976:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143766.794865:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c09e00/0xe984082ccd7305bd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e38 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.794882:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.794886:0:2976:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143766.794895:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800900e4600/0xe984082ccd7305d2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e3f expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.794965:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00000100:00100000:1.0:1746143766.794970:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594392832:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.794974:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.794981:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143766.794990:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143766.794992:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 38 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.795003:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5400, rc 0) 00000100:00100000:1.0:1746143766.795032:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:31440:x1830963594283648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1971us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.795045:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13615 00010000:00010000:3.0:1746143766.795074:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800900e4600/0xe984082ccd7305d2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 14 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.795083:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 13 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.795089:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.795091:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143766.795093:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130c31c00, rc 0) 00000100:00100000:3.0:1746143766.795410:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31442:x1830963594283776:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 583us (698us total) trans 8589943573 rc 0/0 00000100:00100000:3.0:1746143766.795416:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9235 00000100:00100000:2.0:1746143766.795514:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.795569:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594283904 00000100:00100000:3.0:1746143766.795572:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594283904 00002000:00100000:3.0:1746143766.795590:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2928640->3145727) req@ffff88008f3cbb80 x1830963594283904/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.796257:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963594283904 ext(2928640->3145727) 00010000:00010000:3.0:1746143766.796265:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.796275:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.796281:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3cbb80 00000100:00100000:3.0:1746143766.796307:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1820 00000100:00100000:3.0:1746143766.796313:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594283904:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143766.800022:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.800065:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594284032 00000100:00100000:1.0:1746143766.800071:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594284032 00000100:00100000:1.0:1746143766.800101:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9236 00000100:00100000:1.0:1746143766.800107:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31442:x1830963594284032:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143766.800124:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.800158:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4400/0xe984082ccd7305e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e4d expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.800219:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4400/0xe984082ccd7305e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e4d expref: 14 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.800230:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4400/0xe984082ccd7305e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e4d expref: 14 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.800245:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143766.800248:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143766.800251:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4400, rc 0) 00000100:00100000:1.0:1746143766.800285:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31442:x1830963594284032:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 177us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.800291:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9236 00000100:00100000:0.0:1746143766.800844:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.801092:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594284288 00000100:00100000:1.0:1746143766.801097:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594284288 00000100:00100000:1.0:1746143766.801129:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9237 00000100:00100000:1.0:1746143766.801134:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31444:x1830963594284288:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143766.801160:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.801184:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd7305ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e54 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.801269:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801277:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801284:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801292:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801297:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801301:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801378:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801386:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 13 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.801392:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.801413:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 13 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.801423:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 13 pid: 2976 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.801438:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594392960:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143766.802099:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.803697:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.804185:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.804387:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594284416 00000100:00100000:0.0:1746143766.804395:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594284416 00000100:00100000:0.0:1746143766.804424:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594284544 00000100:00100000:0.0:1746143766.804426:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594284544 00000100:00100000:0.0:1746143766.804447:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13616 00000100:00100000:1.0:1746143766.804464:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.804484:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.804497:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.804510:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.804560:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594392960:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.804579:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143766.804943:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594284416:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143766.804978:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.804990:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.804996:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.805004:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.805009:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.805011:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.805013:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.805036:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.805046:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 25 pid: 4581 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143766.805056:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594393088:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143766.805112:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.805120:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 10 pid: 4581 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143766.805127:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594393216:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143766.805169:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.805186:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 22 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.805198:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594393344:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143766.805215:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.805409:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594284672 00000100:00100000:3.0:1746143766.805413:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594284672 00000100:00100000:3.0:1746143766.805431:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594284800 00000100:00100000:3.0:1746143766.805433:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594284800 00000100:00100000:3.0:1746143766.805443:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594284928 00000100:00100000:3.0:1746143766.805444:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594284928 00000100:00100000:3.0:1746143766.805452:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285056 00000100:00100000:3.0:1746143766.805454:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285056 00000100:00100000:3.0:1746143766.805466:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13617 00000100:00100000:3.0:1746143766.805471:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594284544:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143766.805490:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805501:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.805508:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805518:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805523:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.805525:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.805527:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805541:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805548:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 20 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.805551:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.805556:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594393472:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.805582:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805590:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 39 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.805597:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594393600:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.805615:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.805626:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 12 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.805632:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594393728:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.805646:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.805660:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13618 00000100:00100000:3.0:1746143766.805664:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594284672:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143766.805677:0:2839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805693:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805700:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.805706:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 39 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.805711:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.805712:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.805714:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805727:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 39 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.805735:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 39 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.805742:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594393856:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.805764:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143766.805771:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 12 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.805778:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594393984:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.805792:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805799:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 20 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.805806:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594394112:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.805816:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143766.805829:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13619 00000100:00100000:3.0:1746143766.805834:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594284800:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143766.805847:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805859:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.805864:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285184 00010000:00010000:3.0:1746143766.805866:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143766.805868:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285184 00010000:00010000:3.0:1746143766.805871:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.805872:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.805874:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.805885:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.805885:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 14 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.805891:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 12 pid: 2839 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.805898:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594394240:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143766.805905:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7295 00000100:00100000:0.0:1746143766.805910:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594285184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.805917:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.805919:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.805922:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 14 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.805927:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.805931:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 14 pid: 2976 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.805934:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594394368:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143766.805945:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130c31c00/0xe984082ccd7305d9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e3f expref: 14 pid: 2976 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.805958:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143766.805962:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143766.805968:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13620 00010000:00010000:0.0:1746143766.805969:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143766.805974:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594284928:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143766.805974:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143766.805988:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.805997:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.806002:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.806009:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.806014:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143766.806015:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143766.806017:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.806017:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594285184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 107us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.806024:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7295 00010000:00010000:2.0:1746143766.806033:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 22 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.806040:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.806041:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143766.806047:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594394496:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.806048:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143766.806061:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143766.806082:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.806093:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.806100:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594394624:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.806114:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143766.806126:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13621 00000100:00100000:2.0:1746143766.806131:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594285056:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143766.806157:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.806159:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806165:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143766.806166:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.806170:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143766.806171:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143766.806185:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 39 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.806188:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde4e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143766.806190:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746143766.806192:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.806192:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806197:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806205:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.806207:0:9527:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 39 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.806207:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143766.806209:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806214:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4e00/0xe984082ccd730603 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143766.806215:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 20 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.806223:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 20 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.806230:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594394880:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.806241:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143766.806245:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143766.806246:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806250:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806253:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde4200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143766.806255:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806259:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806265:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143766.806267:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.806270:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806274:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd7305f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806281:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806285:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806289:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806292:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde4000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143766.806294:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806299:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806310:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c700) 00010000:00010000:1.0:1746143766.806312:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.806314:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.806318:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd7305fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143766.806346:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24540 going to sleep for 11 seconds 00010000:00010000:1.0:1746143766.806350:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd7305ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e54 expref: 28 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.806356:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd7305ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e54 expref: 28 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.806364:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5c00, rc 0) 00000100:00100000:1.0:1746143766.806387:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31444:x1830963594284288:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5253us (5543us total) trans 8589943574 rc 301/301 00000100:00100000:1.0:1746143766.806393:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9237 00000100:00100000:1.0:1746143766.808429:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594393088:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.808438:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594283904:12345-192.168.202.48@tcp:4:cat.0 Request processed in 12124us (12923us total) trans 17179873144 rc 0/0 00000100:00100000:1.0:1746143766.808440:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594393216:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.808446:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1820 00002000:00100000:3.0:1746143766.808455:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2928640->3145727) req@ffff88008f3cbb80 x1830963594283904/t17179873144(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.808463:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cbb80 with x1830963594283904 ext(2928640->3145727) 00010000:00010000:3.0:1746143766.808470:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 40 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.808480:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 40 pid: 6929 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.808486:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3cbb80 00000100:00100000:2.0:1746143766.808862:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594393472:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.808870:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594393600:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.808875:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594393728:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.808894:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.808945:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594393344:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.808958:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.809217:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594394240:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.809265:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594393856:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.809273:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594393984:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143766.809280:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594394112:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.809296:0:2839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.809312:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594394496:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.809501:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594394624:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143766.809513:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.812353:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.812392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.812661:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285696 00000100:00100000:2.0:1746143766.812667:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285696 00010000:00010000:2.0:1746143766.812694:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 26 pid: 4581 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.812714:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285952 00000100:00100000:2.0:1746143766.812716:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285952 00010000:00010000:2.0:1746143766.812726:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 13 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.812746:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7296 00000100:00100000:2.0:1746143766.812752:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594285696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.812761:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.812779:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 26 pid: 4581 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.812787:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 26 pid: 4581 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.812804:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a034b800/0xe984082ccd73037f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ca2 expref: 26 pid: 4581 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.812826:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.812856:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594285696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 105us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.812863:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7296 00000100:00100000:2.0:1746143766.812876:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7297 00000100:00100000:2.0:1746143766.812880:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1962:x1830963594285952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.812886:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.812898:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 13 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.812905:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 13 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.812916:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73059a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e1c expref: 13 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.813043:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594394880:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.813058:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.813137:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594394368:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143766.813187:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.813464:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.813547:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594285952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 665us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.813553:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7297 00000100:00100000:0.0:1746143766.815625:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.815666:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.815696:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285440 00000100:00100000:2.0:1746143766.815701:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285440 00000100:00100000:0.0:1746143766.815701:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.815727:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.815729:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285824 00000100:00100000:3.0:1746143766.815733:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285824 00000100:00100000:0.0:1746143766.815743:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143766.815753:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 40 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:1.0:1746143766.815753:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286208 00000100:00100000:1.0:1746143766.815756:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286208 00000100:00100000:0.0:1746143766.815761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143766.815774:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 41 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.816349:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 21 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.816590:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.816631:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286464 00000100:00100000:3.0:1746143766.816634:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286464 00010000:00010000:3.0:1746143766.816650:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 23 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.816663:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286720 00000100:00100000:3.0:1746143766.816665:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286720 00010000:00010000:3.0:1746143766.816674:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 24 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.816683:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285312 00000100:00100000:3.0:1746143766.816685:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285312 00010000:00010000:3.0:1746143766.816693:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 13 pid: 4581 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.816702:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7298 00000100:00100000:3.0:1746143766.816708:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594285824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.816717:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.816734:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 41 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.816743:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 41 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.816759:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73043c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7d19 expref: 41 pid: 21542 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.816781:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.816811:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594285824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 102us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.816816:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7298 00000100:00100000:3.0:1746143766.816827:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594285568 00000100:00100000:3.0:1746143766.816829:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594285568 00010000:00010000:3.0:1746143766.816838:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 12 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143766.816844:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.816848:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7299 00000100:00100000:3.0:1746143766.816852:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594286208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143766.816856:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286080 00010000:00010000:3.0:1746143766.816857:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143766.816858:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.816859:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286080 00010000:00010000:3.0:1746143766.816866:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 39 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.816872:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 14 pid: 2839 timeout: 945 lvb_type: 1 00000100:00100000:0.0:1746143766.816872:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143766.816874:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 39 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.816880:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143766.816884:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4c08400/0xe984082ccd7300fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b44 expref: 39 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.816886:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286592 00000100:00100000:2.0:1746143766.816887:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286592 00000100:00100000:0.0:1746143766.816889:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143766.816892:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.816894:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 22 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.816900:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286848 00000100:00100000:2.0:1746143766.816901:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286848 00000100:00100000:3.0:1746143766.816904:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594286208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (1203us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143766.816907:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 23 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.816909:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7299 00000100:00100000:2.0:1746143766.816913:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286976 00000100:00100000:2.0:1746143766.816914:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286976 00000100:00100000:3.0:1746143766.816919:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7300 00000100:00100000:0.0:1746143766.816920:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143766.816921:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.816923:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594285440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143766.816927:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594287104 00010000:00010000:3.0:1746143766.816928:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143766.816928:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594287104 00010000:00010000:2.0:1746143766.816933:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.816934:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 23 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.816941:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 23 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.816941:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7301 00000100:00100000:2.0:1746143766.816945:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594286464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.816951:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5806c00/0xe984082ccd7300ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b36 expref: 23 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.816953:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.816958:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.816963:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.816969:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.816970:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594285440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.816975:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7300 00010000:00010000:2.0:1746143766.816979:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4200/0xe984082ccd730577 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e0e expref: 25 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.816986:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7302 00010000:00010000:2.0:1746143766.816987:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.816991:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594286720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.816996:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143766.817000:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594286464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (1273us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143766.817004:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 24 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.817005:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7301 00010000:00010000:3.0:1746143766.817011:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.817013:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7303 00000100:00100000:2.0:1746143766.817017:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594285312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.817022:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba30200/0xe984082ccd730339 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c86 expref: 23 pid: 8497 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.817022:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.817028:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 14 pid: 4581 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.817029:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.817035:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 14 pid: 4581 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.817043:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594286720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (1298us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143766.817045:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136488800/0xe984082ccd7303da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ccc expref: 14 pid: 4581 timeout: 945 lvb_type: 1 00000100:00100000:3.0:1746143766.817048:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7302 00010000:00010000:2.0:1746143766.817051:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.817053:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.817057:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817063:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.817075:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7304 00000100:00100000:3.0:1746143766.817080:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594285568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.817082:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143766.817085:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.817092:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 12 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.817095:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594285312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.817099:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7303 00010000:00010000:3.0:1746143766.817100:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 12 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.817109:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7305 00010000:00010000:3.0:1746143766.817110:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7bce00/0xe984082ccd72fff8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ad4 expref: 12 pid: 21542 timeout: 945 lvb_type: 1 00000100:00100000:2.0:1746143766.817113:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594286080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.817117:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.817118:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.817118:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.817121:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817124:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 12 pid: 2839 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.817127:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817131:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 12 pid: 2839 timeout: 945 lvb_type: 1 00010000:00010000:2.0:1746143766.817153:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f5de00/0xe984082ccd7305a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e23 expref: 12 pid: 2839 timeout: 945 lvb_type: 1 00010000:00010000:3.0:1746143766.817155:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.817159:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.817170:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594285568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 90us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.817184:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7304 00000100:00100000:2.0:1746143766.817185:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594286080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.817191:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7305 00000100:00100000:3.0:1746143766.817194:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7306 00000100:00100000:3.0:1746143766.817198:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594286592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143766.817200:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7307 00010000:00010000:3.0:1746143766.817204:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143766.817205:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594286848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143766.817210:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.817213:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.817217:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.817221:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.817225:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.817231:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013061c400/0xe984082ccd73051c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7db3 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.817234:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd73040b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7cf6 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.817239:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143766.817241:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.817242:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.817245:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817251:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.817252:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594286592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.817257:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7306 00010000:00010000:2.0:1746143766.817264:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.817267:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7308 00000100:00100000:3.0:1746143766.817271:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594286976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.817276:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143766.817280:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594286848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 75us (398us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143766.817283:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.817285:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7307 00010000:00010000:3.0:1746143766.817290:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.817294:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7309 00000100:00100000:2.0:1746143766.817298:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594287104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.817300:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013061d600/0xe984082ccd730570 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e07 expref: 21 pid: 21542 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.817303:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.817307:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.817308:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.817309:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.817310:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817316:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817316:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.817327:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.817343:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594286976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.817348:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7308 00010000:00010000:3.0:1746143766.817368:0:2839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817375:0:2839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817391:0:2839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817402:0:2839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817409:0:2839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817414:0:2839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c24ea00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143766.817417:0:2839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817425:0:2839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817433:0:2839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.817438:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.817471:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594284672:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 11806us (13007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.817479:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13618 00000100:00100000:3.0:1746143766.817497:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594286336 00000100:00100000:3.0:1746143766.817500:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594286336 00002000:00100000:3.0:1746143766.817520:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3583999) req@ffff8800a5d80000 x1830963594286336/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.817534:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80000 with x1830963594286336 ext(3145728->3583999) 00010000:00010000:3.0:1746143766.817539:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 20 pid: 2839 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.817548:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 20 pid: 2839 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.817554:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80000 00000100:00100000:3.0:1746143766.817571:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1821 00000100:00100000:3.0:1746143766.817576:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594286336:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:0.0:1746143766.817681:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.817688:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817709:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817719:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817730:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817734:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817739:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817744:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009066b600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143766.817746:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817752:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817760:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.817765:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009066b600/0xe984082ccd73060a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.817803:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594284416:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 12863us (14110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.817809:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13616 00010000:00010000:0.0:1746143766.817814:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.817825:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.817831:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.817835:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800957e1800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143766.817837:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.817842:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.817851:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.817856:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800957e1800/0xe984082ccd73061f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817863:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd73054d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7de4 expref: 38 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.817870:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.817871:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143766.817895:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594284800:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 12060us (13410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.817900:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13619 00010000:00010000:2.0:1746143766.817965:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817971:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.817994:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818003:0:23335:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.818012:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594395008:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143766.818363:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143766.818375:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818381:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818392:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818398:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818403:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818408:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f5c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143766.818410:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818415:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818423:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.818428:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f8f5c00/0xe984082ccd730611 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.818466:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594284544:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 12993us (14281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.818471:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13617 00000100:00100000:3.0:1746143766.822979:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594395008:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143766.822999:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.823037:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963594287104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5735us (6113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.823046:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7309 00000100:00100000:0.0:1746143766.825021:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.825112:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594287360 00000100:00100000:2.0:1746143766.825117:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594287360 00002000:00100000:2.0:1746143766.825183:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a5d82d80 x1830963594287360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.825197:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963594287360 ext(2097152->3145727) 00010000:00010000:2.0:1746143766.825205:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.825215:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143766.825221:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82d80 00000100:00100000:2.0:1746143766.825238:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1822 00000100:00100000:2.0:1746143766.825244:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594287360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143766.827698:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594286336:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10116us (10833us total) trans 21474840467 rc 0/0 00000100:00100000:3.0:1746143766.827708:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1821 00002000:00100000:3.0:1746143766.827716:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3583999) req@ffff8800a5d80000 x1830963594286336/t21474840467(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.827724:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80000 with x1830963594286336 ext(3145728->3583999) 00010000:00010000:3.0:1746143766.827731:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.827747:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.827753:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80000 00000100:00100000:1.0:1746143766.830134:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.830188:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594287488 00000100:00100000:2.0:1746143766.830195:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594287488 00000100:00100000:2.0:1746143766.830410:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13622 00000100:00100000:2.0:1746143766.830417:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31444:x1830963594287488:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143766.830431:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.830444:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e5b expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.830466:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.830469:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.830475:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.830478:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2183168->2527231] (req 2183168->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.830495:0:6929:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.830506:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2183168->2527231] (req 2183168->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.830513:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1f800, rc 0) 00000100:00100000:2.0:1746143766.830546:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31444:x1830963594287488:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 129us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.830551:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13622 00000100:00100000:2.0:1746143766.834200:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594287360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8949us (9176us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.834211:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1822 00002000:00100000:2.0:1746143766.834219:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800a5d82d80 x1830963594287360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.834227:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830963594287360 ext(2097152->3145727) 00010000:00010000:2.0:1746143766.834236:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.834247:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143766.834253:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d82d80 00000100:00100000:0.0:1746143766.834784:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.834826:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594287616 00000100:00100000:3.0:1746143766.834832:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594287616 00010000:00010000:3.0:1746143766.834856:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 945 lvb_type: 0 00000100:00100000:3.0:1746143766.834887:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7310 00000100:00100000:3.0:1746143766.834893:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594287616:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143766.834903:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143766.834919:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.834929:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.834948:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0635600/0xe984082ccd730569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3583999) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e00 expref: 22 pid: 2839 timeout: 945 lvb_type: 0 00010000:00010000:3.0:1746143766.834973:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.834975:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.834979:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.834990:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.835009:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143766.835039:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594287616:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 146us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.835045:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7310 00010000:00010000:2.0:1746143766.835155:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835163:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835190:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835198:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835350:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835356:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4c09e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143766.835360:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835367:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835376:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.835382:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4c09e00/0xe984082ccd730626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143766.835432:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594284928:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 29458us (30933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.835439:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13620 00000100:00100000:0.0:1746143766.840411:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.840559:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.840586:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594288000 00000100:00100000:1.0:1746143766.840592:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594288000 00000100:00100000:1.0:1746143766.840641:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9238 00000100:00100000:1.0:1746143766.840648:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31447:x1830963594288000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.840668:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.840684:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4a00/0xe984082ccd730642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e69 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.840776:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840788:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840796:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840806:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840811:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840815:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840899:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840910:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840915:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:1.0:1746143766.840922:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143766.840987:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840992:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.840997:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841002:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde4200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143766.841005:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841010:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841019:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143766.841021:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143766.841024:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841028:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4200/0xe984082ccd730657 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841050:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841058:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841062:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841066:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde5c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143766.841068:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841073:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841079:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143766.841081:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.841083:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.841087:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5c00/0xe984082ccd730649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143766.841253:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594287744 00000100:00100000:2.0:1746143766.841257:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594287744 00000100:00100000:2.0:1746143766.841278:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13623 00000100:00100000:2.0:1746143766.841283:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31440:x1830963594287744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.841291:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.841300:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e62 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143766.841316:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a16, atime: 0x68140a16, ctime: 0x68140a16, blocks: 0x14ad 00010000:00010000:2.0:1746143766.841327:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.841329:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.841334:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.841345:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.841353:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1f600, rc 0) 00000100:00100000:2.0:1746143766.841387:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31440:x1830963594287744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 103us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.841392:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13623 00000100:00100000:2.0:1746143766.841909:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143766.842106:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.842112:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.842117:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.842121:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde4000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143766.842124:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.842132:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.842151:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03cc00) 00010000:00010000:1.0:1746143766.842153:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143766.842155:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.842160:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4000/0xe984082ccd730650 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143766.842206:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4a00/0xe984082ccd730642 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e69 expref: 29 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.842212:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4a00/0xe984082ccd730642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e69 expref: 29 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.842219:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4a00, rc 0) 00000100:00100000:0.0:1746143766.842298:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594288128 00000100:00100000:0.0:1746143766.842302:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594288128 00010000:00010000:0.0:1746143766.842322:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00000100:00100000:0.0:1746143766.842405:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7311 00000100:00100000:0.0:1746143766.842410:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1962:x1830963594288128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143766.842418:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143766.842430:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.842439:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.842450:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5400/0xe984082ccd7305cb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e46 expref: 37 pid: 15784 timeout: 945 lvb_type: 0 00010000:00010000:0.0:1746143766.842461:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.842463:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.842466:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.842472:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143766.842485:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.842540:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31447:x1830963594288000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1892us (1980us total) trans 8589943575 rc 301/301 00000100:00100000:1.0:1746143766.842545:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9238 00010000:00010000:3.0:1746143766.842548:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842554:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842569:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842575:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842581:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842586:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b1e400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143766.842588:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842598:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842606:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.842607:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143766.842612:0:9527:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842618:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.842645:0:9527:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 18 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.842655:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594395136:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143766.842762:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.842924:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1962:x1830963594288128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 512us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.842930:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7311 00000100:00100000:0.0:1746143766.847107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847193:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847212:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594288512 00000100:00100000:0.0:1746143766.847218:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594288512 00000100:00100000:3.0:1746143766.847260:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594288384 00000100:00100000:0.0:1746143766.847262:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13624 00000100:00100000:3.0:1746143766.847264:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594288384 00000100:00100000:0.0:1746143766.847269:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594288512:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143766.847283:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746143766.847293:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a5d80e00 x1830963594288384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746143766.847297:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e70 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143766.847301:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830963594288384 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.847304:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80e00 00002000:00010000:0.0:1746143766.847316:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a15, atime: 0x68140a14, ctime: 0x68140a15, blocks: 0x811 00000100:00100000:3.0:1746143766.847322:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6422 00000100:00100000:3.0:1746143766.847328:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594288384:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:0.0:1746143766.847330:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847332:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847340:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847352:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 26 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847362:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4400, rc 0) 00000100:00100000:0.0:1746143766.847393:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594288512:12345-192.168.202.48@tcp:101:cat.0 Request processed in 124us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.847398:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13624 00000100:00100000:0.0:1746143766.847423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847433:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594288640 00000100:00100000:0.0:1746143766.847435:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594288640 00000100:00100000:0.0:1746143766.847447:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13625 00000100:00100000:0.0:1746143766.847451:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594288640:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143766.847458:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.847467:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e77 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143766.847479:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a14, atime: 0x68140a14, ctime: 0x68140a14, blocks: 0x81f 00010000:00010000:0.0:1746143766.847485:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847486:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847490:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847498:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847505:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4800, rc 0) 00000100:00100000:0.0:1746143766.847517:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594288640:12345-192.168.202.48@tcp:101:cat.0 Request processed in 65us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.847521:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13625 00000100:00100000:0.0:1746143766.847555:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847563:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594288768 00000100:00100000:0.0:1746143766.847565:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594288768 00000100:00100000:0.0:1746143766.847577:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13626 00000100:00100000:0.0:1746143766.847581:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594288768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143766.847586:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.847592:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e7e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143766.847600:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a15, atime: 0x68140a15, ctime: 0x68140a15, blocks: 0x821 00010000:00010000:0.0:1746143766.847608:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847609:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847613:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847621:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 21 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847627:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4000, rc 0) 00000100:00100000:0.0:1746143766.847640:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594288768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.847645:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13626 00000100:00100000:0.0:1746143766.847669:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847677:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594288896 00000100:00100000:0.0:1746143766.847679:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594288896 00000100:00100000:0.0:1746143766.847690:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13627 00000100:00100000:0.0:1746143766.847694:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594288896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143766.847699:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.847706:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e85 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143766.847715:0:4581:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a16, atime: 0x68140a16, ctime: 0x68140a16, blocks: 0x821 00010000:00010000:0.0:1746143766.847721:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847722:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143766.847725:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847732:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143766.847739:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009066ae00, rc 0) 00000100:00100000:0.0:1746143766.847752:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594288896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143766.847756:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13627 00000100:00100000:0.0:1746143766.847788:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847796:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594289152 00000100:00100000:0.0:1746143766.847799:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594289152 00000100:00100000:0.0:1746143766.847813:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13628 00000100:00100000:0.0:1746143766.847817:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594289152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143766.847822:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143766.847828:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009066a000/0xe984082ccd730688 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e93 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143766.847855:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594395264:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143766.847900:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143766.847928:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847986:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.847996:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594289408 00000100:00100000:0.0:1746143766.847999:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594289408 00002000:00100000:0.0:1746143766.848011:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2187263) req@ffff8800a5d82a00 x1830963594289408/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.848019:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963594289408 ext(2183168->2187263) 00002000:00010000:0.0:1746143766.848022:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:0.0:1746143766.848030:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6423 00000100:00100000:0.0:1746143766.848035:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594289408:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143766.848101:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594289408:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 65us (115us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143766.848107:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6423 00002000:00100000:0.0:1746143766.848111:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2187263) req@ffff8800a5d82a00 x1830963594289408/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.848117:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830963594289408 ext(2183168->2187263) 00002000:00010000:0.0:1746143766.848120:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:1.0:1746143766.848338:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594289024 00000100:00100000:1.0:1746143766.848342:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594289024 00000100:00100000:1.0:1746143766.848370:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13629 00000100:00100000:1.0:1746143766.848375:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594289024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.848381:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.848387:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e8c expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.848402:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.848403:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.848407:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.848416:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 28 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.848423:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4e00, rc 0) 00000100:00100000:1.0:1746143766.848441:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594289024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.848446:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13629 00000100:00100000:3.0:1746143766.848450:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594395136:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143766.848467:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.848474:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1e400/0xe984082ccd730634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.848505:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594285056:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 42373us (43992us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143766.848511:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13621 00000100:00100000:2.0:1746143766.855965:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594395264:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143766.855991:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009066a000/0xe984082ccd730688 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e93 expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.856007:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009066a000/0xe984082ccd730688 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e93 expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.856031:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009066a000, rc 0) 00000100:00100000:2.0:1746143766.856452:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594289152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8633us (8662us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143766.856460:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13628 00000100:00100000:0.0:1746143766.856478:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.856500:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594289664 00000100:00100000:2.0:1746143766.856505:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594289664 00000100:00100000:2.0:1746143766.856539:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9239 00000100:00100000:2.0:1746143766.856544:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31442:x1830963594289664:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:2.0:1746143766.856576:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143766.856590:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4400/0xe984082ccd7305e7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e4d expref: 13 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.856600:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143766.856603:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143766.856623:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31442:x1830963594289664:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 79us (144us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746143766.856627:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9239 00000100:00100000:1.0:1746143766.856804:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.856889:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594289920 00000100:00100000:3.0:1746143766.856892:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594289920 00002000:00100000:3.0:1746143766.856913:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2523136->2527231) req@ffff88008f0ad180 x1830963594289920/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.856921:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad180 with x1830963594289920 ext(2523136->2527231) 00002000:00010000:3.0:1746143766.856925:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad180 00000100:00100000:3.0:1746143766.856949:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6424 00000100:00100000:3.0:1746143766.856954:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594289920:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143766.857169:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594289920:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 214us (365us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143766.857185:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6424 00002000:00100000:3.0:1746143766.857190:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (2523136->2527231) req@ffff88008f0ad180 x1830963594289920/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.857195:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad180 with x1830963594289920 ext(2523136->2527231) 00002000:00010000:3.0:1746143766.857197:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad180 00000100:00100000:2.0:1746143766.857352:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594288384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10024us (10251us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.857358:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6422 00002000:00100000:2.0:1746143766.857363:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800a5d80e00 x1830963594288384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.857370:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830963594288384 ext(3145728->4194303) 00002000:00010000:2.0:1746143766.857373:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80e00 00000100:00100000:0.0:1746143766.860613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.860641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.860775:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290176 00000100:00100000:1.0:1746143766.860786:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290176 00000100:00100000:1.0:1746143766.860829:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290432 00000100:00100000:1.0:1746143766.860831:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290432 00000100:00100000:1.0:1746143766.860846:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3977 00000100:00100000:1.0:1746143766.860853:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31442:x1830963594290176:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143766.860868:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3978 00000100:00100000:3.0:1746143766.860875:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31444:x1830963594290432:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143766.861021:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.861100:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290560 00000100:00100000:2.0:1746143766.861104:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290560 00000100:00100000:2.0:1746143766.861135:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13630 00000100:00100000:2.0:1746143766.861155:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31440:x1830963594290560:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.861163:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.861184:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7e9a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.861203:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.861208:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.861210:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143766.861212:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.861235:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 20 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.861244:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 20 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.861254:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594395392:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143766.861315:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.861421:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31442:x1830963594290176:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 568us (813us total) trans 8589943577 rc 0/0 00000100:00100000:1.0:1746143766.861428:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3977 00000100:00100000:2.0:1746143766.861872:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31444:x1830963594290432:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 996us (1228us total) trans 8589943576 rc 0/0 00000100:00100000:2.0:1746143766.861878:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3978 00000100:00100000:0.0:1746143766.865693:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.865722:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.865754:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594290688 00000100:00100000:3.0:1746143766.865761:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594290688 00002000:00100000:3.0:1746143766.865800:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2527231) req@ffff88009ff6e680 x1830963594290688/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.865808:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e680 with x1830963594290688 ext(2183168->2527231) 00010000:00010000:3.0:1746143766.865815:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 21 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:2.0:1746143766.865819:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594395392:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143766.865829:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 21 pid: 6929 timeout: 945 lvb_type: 0 00002000:00010000:3.0:1746143766.865834:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6e680 00010000:00010000:2.0:1746143766.865841:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 37 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143766.865854:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1823 00010000:00010000:2.0:1746143766.865855:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b1fe00, rc 0) 00000100:00100000:3.0:1746143766.865860:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594290688:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143766.865905:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:31440:x1830963594290560:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4764us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.865912:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13630 00000100:00100000:2.0:1746143766.866237:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291072 00000100:00100000:2.0:1746143766.866240:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291072 00000100:00100000:2.0:1746143766.866264:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3979 00000100:00100000:2.0:1746143766.866269:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31442:x1830963594291072:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143766.866471:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31442:x1830963594291072:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 201us (748us total) trans 8589943578 rc 0/0 00000100:00100000:2.0:1746143766.866476:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3979 00000100:00100000:2.0:1746143766.868297:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.868366:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.868392:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.868422:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.868575:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291200 00000100:00100000:1.0:1746143766.868581:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291200 00002000:00100000:1.0:1746143766.868611:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009cdc0700 x1830963594291200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.868625:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0700 with x1830963594291200 ext(0->1048575) 00002000:00010000:1.0:1746143766.868628:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0700 00000100:00100000:1.0:1746143766.868641:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291456 00000100:00100000:1.0:1746143766.868643:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291456 00002000:00100000:1.0:1746143766.868666:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8801305c8a80 x1830963594291456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.868673:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8a80 with x1830963594291456 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.868675:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8a80 00000100:00100000:1.0:1746143766.868685:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291968 00000100:00100000:1.0:1746143766.868687:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291968 00002000:00100000:1.0:1746143766.868695:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305c8380 x1830963594291968/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143766.868893:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594291584 00000100:00100000:3.0:1746143766.868896:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594291584 00002000:00100000:3.0:1746143766.868911:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8801305cb100 x1830963594291584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.868917:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb100 with x1830963594291584 ext(1048576->2097151) 00002000:00010000:3.0:1746143766.868919:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cb100 00000100:00100000:3.0:1746143766.868931:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6425 00000100:00100000:3.0:1746143766.868937:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594291200:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.869048:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6426 00000100:00100000:0.0:1746143766.869055:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963594291456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.869239:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6427 00000100:00100000:0.0:1746143766.869244:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963594291584:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143766.869823:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8380 with x1830963594291968 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.869827:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8380 00000100:00100000:1.0:1746143766.869839:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6428 00000100:00100000:1.0:1746143766.869853:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594291968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.881427:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594291584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12174us (12995us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143766.881436:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6427 00002000:00100000:2.0:1746143766.881445:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8801305cb100 x1830963594291584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.881455:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305cb100 with x1830963594291584 ext(1048576->2097151) 00002000:00010000:2.0:1746143766.881459:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305cb100 00000100:00100000:2.0:1746143766.901402:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594290688:12345-192.168.202.48@tcp:4:cat.0 Request processed in 35533us (35707us total) trans 17179873145 rc 0/0 00000100:00100000:2.0:1746143766.901414:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1823 00002000:00100000:2.0:1746143766.901425:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2183168->2527231) req@ffff88009ff6e680 x1830963594290688/t17179873145(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/448 e 0 to 0 dl 1746143777 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.901433:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6e680 with x1830963594290688 ext(2183168->2527231) 00010000:00010000:2.0:1746143766.901607:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 25 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:2.0:1746143766.901619:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 25 pid: 6929 timeout: 945 lvb_type: 0 00002000:00010000:2.0:1746143766.901625:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6e680 00000100:00100000:0.0:1746143766.901807:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594291456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 32751us (33439us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143766.901814:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6426 00002000:00100000:0.0:1746143766.901820:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8801305c8a80 x1830963594291456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.901833:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8a80 with x1830963594291456 ext(1048576->2097151) 00002000:00010000:0.0:1746143766.901836:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305c8a80 00000100:00100000:1.0:1746143766.904854:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594291968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 35001us (36452us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.904865:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6428 00002000:00100000:1.0:1746143766.904874:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8801305c8380 x1830963594291968/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.904882:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305c8380 with x1830963594291968 ext(1048576->2097151) 00002000:00010000:1.0:1746143766.904887:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305c8380 00000100:00100000:3.0:1746143766.911764:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594291200:12345-192.168.202.48@tcp:3:cat.0 Request processed in 42818us (43461us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.911774:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6425 00002000:00100000:3.0:1746143766.911783:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009cdc0700 x1830963594291200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.911791:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc0700 with x1830963594291200 ext(0->1048575) 00002000:00010000:3.0:1746143766.911797:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cdc0700 00000100:00100000:0.0:1746143766.912089:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.912389:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292096 00000100:00100000:1.0:1746143766.912396:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292096 00010000:00010000:1.0:1746143766.912422:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 23 pid: 6929 timeout: 945 lvb_type: 0 00000100:00100000:1.0:1746143766.912442:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7312 00000100:00100000:1.0:1746143766.912447:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594292096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143766.912457:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143766.912474:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 23 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.912482:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 23 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.912499:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1f800/0xe984082ccd73063b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2527231) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e5b expref: 23 pid: 6929 timeout: 945 lvb_type: 0 00010000:00010000:1.0:1746143766.912525:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.912526:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.912533:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.912539:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.912565:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 36 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143766.912578:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594395520:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143766.912642:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143766.920803:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594395520:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143766.920822:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143766.920868:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594292096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8419us (8778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.920877:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7312 00000100:00100000:0.0:1746143766.923210:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143766.923325:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292352 00000100:00100000:3.0:1746143766.923332:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292352 00002000:00100000:3.0:1746143766.923365:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6ce00 x1830963594292352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.923374:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963594292352 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.923378:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ce00 00000100:00100000:3.0:1746143766.923672:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6429 00000100:00100000:3.0:1746143766.923679:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594292352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.935669:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.935852:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292608 00000100:00100000:1.0:1746143766.935859:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292608 00002000:00100000:1.0:1746143766.935894:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009ff6ca80 x1830963594292608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.935904:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963594292608 ext(2097152->3145727) 00002000:00010000:1.0:1746143766.935908:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ca80 00000100:00100000:1.0:1746143766.935924:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6430 00000100:00100000:1.0:1746143766.935930:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594292608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143766.941708:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594292352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18022us (18495us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.941718:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6429 00002000:00100000:3.0:1746143766.941728:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6ce00 x1830963594292352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.941737:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963594292352 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.941742:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ce00 00000100:00100000:1.0:1746143766.944799:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594292608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8861us (9130us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.944809:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6430 00002000:00100000:1.0:1746143766.944819:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009ff6ca80 x1830963594292608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.944828:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963594292608 ext(2097152->3145727) 00002000:00010000:1.0:1746143766.944833:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ca80 00000100:00100000:0.0:1746143766.947085:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.947164:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.947195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.947228:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.947286:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292864 00000100:00100000:2.0:1746143766.947293:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292864 00000100:00100000:2.0:1746143766.947323:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594293120 00000100:00100000:2.0:1746143766.947324:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594293120 00000100:00100000:2.0:1746143766.947335:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292736 00000100:00100000:2.0:1746143766.947336:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292736 00000100:00100000:2.0:1746143766.947344:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594292992 00000100:00100000:2.0:1746143766.947345:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594292992 00000100:00100000:2.0:1746143766.947356:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13631 00000100:00100000:2.0:1746143766.947362:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594292864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.947377:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.947393:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ea8 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.947412:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.947414:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.947421:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.947435:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.947445:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5a00, rc 0) 00000100:00100000:2.0:1746143766.947476:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594292864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 114us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.947482:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13631 00000100:00100000:2.0:1746143766.947495:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13632 00000100:00100000:2.0:1746143766.947499:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594293120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.947505:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.947512:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7eb6 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.947522:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.947524:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.947527:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143766.947538:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143766.947703:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13633 00000100:00100000:1.0:1746143766.947711:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594292736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.947717:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.947723:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ea1 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.947733:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.947735:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.947739:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.947747:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.947754:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c58e200, rc 0) 00000100:00100000:1.0:1746143766.947769:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594292736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 61us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.947774:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13633 00000100:00100000:1.0:1746143766.947783:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13634 00000100:00100000:1.0:1746143766.947787:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594292992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143766.947792:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143766.947797:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7eaf expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143766.947805:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.947806:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143766.947810:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 39 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.947818:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 39 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143766.947824:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c58e600, rc 0) 00000100:00100000:1.0:1746143766.947835:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594292992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 47us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143766.947839:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13634 00010000:00010000:2.0:1746143766.948578:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5c00, rc 0) 00000100:00100000:2.0:1746143766.948601:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594293120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1101us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.948607:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13632 00000100:00100000:0.0:1746143766.954829:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.956509:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.956733:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594293504 00000100:00100000:0.0:1746143766.956741:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594293504 00002000:00100000:0.0:1746143766.956776:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88008f0ad500 x1830963594293504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.956786:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad500 with x1830963594293504 ext(4194304->4771839) 00002000:00010000:0.0:1746143766.956790:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ad500 00000100:00100000:0.0:1746143766.956822:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6431 00000100:00100000:0.0:1746143766.956828:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594293504:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143766.957281:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594293248 00000100:00100000:2.0:1746143766.957286:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594293248 00000100:00100000:2.0:1746143766.957308:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13635 00000100:00100000:2.0:1746143766.957313:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31447:x1830963594293248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143766.957322:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143766.957334:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ebd expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.957352:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.957354:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143766.957359:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.957371:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143766.957380:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5e00, rc 0) 00000100:00100000:2.0:1746143766.957417:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31447:x1830963594293248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 103us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143766.957423:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13635 00000100:00100000:0.0:1746143766.972115:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.972165:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143766.972891:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594293504:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16060us (16390us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143766.972901:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6431 00002000:00100000:2.0:1746143766.972911:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88008f0ad500 x1830963594293504/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.972920:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad500 with x1830963594293504 ext(4194304->4771839) 00002000:00010000:2.0:1746143766.972924:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ad500 00000100:00100000:3.0:1746143766.974235:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594294144 00000100:00100000:3.0:1746143766.974243:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594294144 00000100:00100000:2.0:1746143766.974291:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594293760 00000100:00100000:2.0:1746143766.974295:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594293760 00002000:00100000:2.0:1746143766.974318:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0ad880 x1830963594293760/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143766.974326:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963594293760 ext(2097152->3145727) 00002000:00010000:2.0:1746143766.974329:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad880 00000100:00100000:3.0:1746143766.974754:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9240 00000100:00100000:3.0:1746143766.974761:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31451:x1830963594294144:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143766.974775:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143766.974788:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fa00/0xe984082ccd7306c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ec4 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.974861:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.974873:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143766.974882:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143766.974892:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143766.974982:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fa00/0xe984082ccd7306c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 260 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.974999:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 259 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143766.975005:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143766.975007:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143766.975010:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a7fc00, rc 0) 00000100:00100000:3.0:1746143766.975034:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:31451:x1830963594294144:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 275us (2927us total) trans 8589943579 rc 0/0 00000100:00100000:3.0:1746143766.975039:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9240 00000100:00100000:0.0:1746143766.975784:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143766.975803:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594294272 00000100:00100000:0.0:1746143766.975806:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594294272 00002000:00100000:0.0:1746143766.975832:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009c276a00 x1830963594294272/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143766.975840:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276a00 with x1830963594294272 ext(3145728->4194303) 00002000:00010000:0.0:1746143766.975844:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c276a00 00000100:00100000:0.0:1746143766.975857:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6432 00000100:00100000:3.0:1746143766.975935:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6433 00000100:00100000:3.0:1746143766.975941:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963594294272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143766.976018:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963594293760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143766.976211:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143766.976222:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594294528 00000100:00100000:1.0:1746143766.976224:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594294528 00002000:00100000:1.0:1746143766.976240:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ae300 x1830963594294528/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/0 e 0 to 0 dl 1746143777 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.976246:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963594294528 ext(3145728->4194303) 00002000:00010000:1.0:1746143766.976249:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:1.0:1746143766.976257:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6434 00000100:00100000:1.0:1746143766.976262:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594294528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143766.988915:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594294528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12645us (12696us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.988926:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6434 00002000:00100000:1.0:1746143766.988937:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ae300 x1830963594294528/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.988951:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae300 with x1830963594294528 ext(3145728->4194303) 00002000:00010000:1.0:1746143766.988956:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae300 00000100:00100000:1.0:1746143766.992255:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594293760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16380us (20078us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143766.992266:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6432 00002000:00100000:1.0:1746143766.992277:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0ad880 x1830963594293760/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143766.992286:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ad880 with x1830963594293760 ext(2097152->3145727) 00002000:00010000:1.0:1746143766.992291:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ad880 00000100:00100000:3.0:1746143766.996705:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1962:x1830963594294272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20753us (20911us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143766.996717:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6433 00002000:00100000:3.0:1746143766.996729:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009c276a00 x1830963594294272/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:162/0 lens 488/440 e 0 to 0 dl 1746143777 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143766.996739:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276a00 with x1830963594294272 ext(3145728->4194303) 00002000:00010000:3.0:1746143766.996744:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c276a00 00000100:00100000:0.0:1746143767.006135:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.006306:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594294784 00000100:00100000:3.0:1746143767.006317:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594294784 00002000:00100000:3.0:1746143767.006362:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009c274a80 x1830963594294784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.006372:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274a80 with x1830963594294784 ext(4194304->4771839) 00002000:00010000:3.0:1746143767.006376:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c274a80 00000100:00100000:3.0:1746143767.006402:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6435 00000100:00100000:3.0:1746143767.006412:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594294784:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.014713:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594294784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8282us (8564us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143767.014726:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6435 00002000:00100000:3.0:1746143767.014738:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009c274a80 x1830963594294784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.014747:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c274a80 with x1830963594294784 ext(4194304->4771839) 00002000:00010000:3.0:1746143767.014752:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c274a80 00000100:00100000:0.0:1746143767.024351:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.024979:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295040 00000100:00100000:2.0:1746143767.024988:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295040 00000100:00100000:1.0:1746143767.025503:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3980 00000100:00100000:1.0:1746143767.025511:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31447:x1830963594295040:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:1.0:1746143767.026135:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:31447:x1830963594295040:12345-192.168.202.48@tcp:35:cat.0 Request processed in 624us (1792us total) trans 8589943580 rc 0/0 00000100:00100000:1.0:1746143767.026163:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3980 00000100:00100000:1.0:1746143767.041380:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.041480:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295168 00000100:00100000:3.0:1746143767.041489:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295168 00000100:00100000:2.0:1746143767.042859:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13636 00000100:00100000:2.0:1746143767.042870:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31451:x1830963594295168:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143767.042887:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.042901:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ecb expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.042927:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.042934:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.042944:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.042946:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.042949:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.042972:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.042984:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 25 pid: 8497 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.042994:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594395648:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.043091:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 27 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.043100:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 27 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.043107:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594395776:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.043125:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.045848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.045902:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295296 00000100:00100000:1.0:1746143767.045908:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295296 00010000:00010000:1.0:1746143767.045935:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 26 pid: 8497 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.045972:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7313 00000100:00100000:1.0:1746143767.045979:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594295296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.045989:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.046008:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 26 pid: 8497 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.046018:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 26 pid: 8497 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.046039:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.046079:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594395776:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143767.046080:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594295296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.046086:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7313 00010000:00010000:2.0:1746143767.046089:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5c00/0xe984082ccd7306a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eb6 expref: 26 pid: 8497 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.046107:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594395648:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.046126:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.046135:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4a00, rc 0) 00000100:00100000:2.0:1746143767.046167:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31451:x1830963594295168:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3300us (4795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.046182:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13636 00000100:00100000:0.0:1746143767.046658:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.047273:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295424 00000100:00100000:3.0:1746143767.047277:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295424 00010000:00010000:3.0:1746143767.047293:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.047356:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7314 00000100:00100000:3.0:1746143767.047362:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594295424:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.047370:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.047381:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.047391:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.047553:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009066ae00/0xe984082ccd730681 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e85 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.047576:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.047578:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.047670:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.047680:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.047706:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.047717:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594395904:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143767.047787:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.049695:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.049743:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594395904:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143767.049760:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.049792:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594295424:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2429us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.049801:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7314 00000100:00100000:2.0:1746143767.049852:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295680 00000100:00100000:2.0:1746143767.049857:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295680 00002000:00100000:2.0:1746143767.049889:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1748992->1753087) req@ffff88009c276d80 x1830963594295680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.049897:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276d80 with x1830963594295680 ext(1748992->1753087) 00002000:00010000:2.0:1746143767.049900:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c276d80 00000100:00100000:2.0:1746143767.049929:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6436 00000100:00100000:2.0:1746143767.049934:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594295680:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143767.050047:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594295680:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 113us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143767.050052:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6436 00002000:00100000:2.0:1746143767.050057:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1748992->1753087) req@ffff88009c276d80 x1830963594295680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.050063:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276d80 with x1830963594295680 ext(1748992->1753087) 00002000:00010000:2.0:1746143767.050066:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c276d80 00000100:00100000:0.0:1746143767.056421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.056536:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295808 00000100:00100000:2.0:1746143767.056544:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295808 00000100:00100000:2.0:1746143767.056597:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13637 00000100:00100000:2.0:1746143767.056604:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31451:x1830963594295808:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143767.056620:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.056635:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ed2 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.056660:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.056668:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.056674:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.056676:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.056679:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.056703:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 26 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.056714:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 26 pid: 15784 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.056724:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594396032:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.056900:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.056909:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.056917:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594396160:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.056939:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.059008:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594396032:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.059015:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594396160:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.059031:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->2420735] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.059049:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4200, rc 0) 00000100:00100000:2.0:1746143767.059089:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31451:x1830963594295808:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2484us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.059096:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13637 00000100:00100000:0.0:1746143767.061072:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.061368:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594295936 00000100:00100000:3.0:1746143767.061376:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594295936 00010000:00010000:3.0:1746143767.061403:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.061430:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7315 00000100:00100000:3.0:1746143767.061436:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594295936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.061447:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.061465:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.061475:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.061493:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b1f600/0xe984082ccd730665 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e62 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.061509:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.061550:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594295936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 113us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.061559:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7315 00000100:00100000:0.0:1746143767.064345:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.064484:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594296064 00000100:00100000:3.0:1746143767.064491:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594296064 00010000:00010000:3.0:1746143767.064519:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 27 pid: 15784 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.065302:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7316 00000100:00100000:3.0:1746143767.065311:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594296064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.065324:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.065342:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 27 pid: 15784 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.065353:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 27 pid: 15784 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.065373:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4e00/0xe984082ccd73068f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e8c expref: 27 pid: 15784 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.065385:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.065387:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.065393:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.065400:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.065429:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.065441:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594396288:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143767.065519:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.067820:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594396288:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143767.067839:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.067872:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594296064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2561us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.067880:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7316 00000100:00100000:0.0:1746143767.070400:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.070725:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594296320 00000100:00100000:1.0:1746143767.070732:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594296320 00002000:00100000:1.0:1746143767.070770:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2416640->2420735) req@ffff88009ca6f480 x1830963594296320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.070779:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6f480 with x1830963594296320 ext(2416640->2420735) 00002000:00010000:1.0:1746143767.070783:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6f480 00000100:00100000:1.0:1746143767.070815:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6437 00000100:00100000:1.0:1746143767.070821:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594296320:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143767.071052:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594296320:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 230us (658us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143767.071059:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6437 00002000:00100000:1.0:1746143767.071065:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2416640->2420735) req@ffff88009ca6f480 x1830963594296320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.071071:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6f480 with x1830963594296320 ext(2416640->2420735) 00002000:00010000:1.0:1746143767.071074:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6f480 00000100:00100000:0.0:1746143767.083672:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.083742:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594296576 00000100:00100000:2.0:1746143767.083750:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594296576 00000100:00100000:2.0:1746143767.083804:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9241 00000100:00100000:2.0:1746143767.083811:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:31456:x1830963594296576:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143767.083836:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.083851:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5000/0xe984082ccd7306e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ed9 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.083952:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.083963:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.083973:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.083983:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.083988:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.083994:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084090:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5200/0xe984082ccd7306f8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084098:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5200/0xe984082ccd7306f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084104:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5200/0xe984082ccd7306f8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143767.084112:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143767.084228:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084235:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084244:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084249:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde4600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143767.084252:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084258:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084267:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143767.084269:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143767.084272:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084277:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4600/0xe984082ccd7306ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084304:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084309:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084314:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084318:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde4800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143767.084320:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084325:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084334:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484b00) 00010000:00010000:2.0:1746143767.084336:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143767.084338:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084342:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd7306f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.084378:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5000/0xe984082ccd7306e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed9 expref: 33 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.084391:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5200/0xe984082ccd7306f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed9 expref: 32 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.084396:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143767.084399:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143767.084401:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5200, rc 0) 00000100:00100000:2.0:1746143767.084441:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31456:x1830963594296576:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 631us (777us total) trans 8589943581 rc 0/0 00000100:00100000:2.0:1746143767.084447:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9241 00000100:00100000:0.0:1746143767.087567:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.087615:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594296704 00000100:00100000:3.0:1746143767.087623:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594296704 00000100:00100000:3.0:1746143767.087674:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 739 00000100:00100000:3.0:1746143767.087681:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1965:x1830963594296704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.087693:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.087714:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5200/0xe984082ccd7306f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed9 expref: 32 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.087742:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.087746:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.087789:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594296704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.087796:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 739 00000100:00100000:0.0:1746143767.103606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.103857:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594296832 00000100:00100000:2.0:1746143767.103866:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594296832 00000100:00100000:2.0:1746143767.104108:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13638 00000100:00100000:2.0:1746143767.104116:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31456:x1830963594296832:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143767.104131:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.104181:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ee0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.104212:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.104220:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.104225:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.104227:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.104230:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3305472->3670015] (req 3305472->3670015) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.104256:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.104267:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.104277:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594396416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.104363:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 38 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.104371:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 38 pid: 4581 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.104377:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594396544:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.104394:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.109870:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594396416:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.109881:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594396544:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.109905:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3305472->3670015] (req 3305472->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.109919:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5800, rc 0) 00000100:00100000:2.0:1746143767.109971:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31456:x1830963594296832:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5856us (6371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.109981:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13638 00000100:00100000:0.0:1746143767.110409:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.110450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.110528:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594296960 00000100:00100000:3.0:1746143767.110534:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594296960 00010000:00010000:3.0:1746143767.110557:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 39 pid: 4581 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.110571:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594297088 00000100:00100000:1.0:1746143767.110576:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594297088 00000100:00100000:3.0:1746143767.110583:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7317 00000100:00100000:3.0:1746143767.110589:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594296960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.110590:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.110598:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143767.110609:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7318 00000100:00100000:1.0:1746143767.110614:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594297088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.110615:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 39 pid: 4581 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.110621:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.110623:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 39 pid: 4581 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.110631:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.110642:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b1fe00/0xe984082ccd730696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e9a expref: 39 pid: 4581 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.110647:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.110659:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5e00/0xe984082ccd7306b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ebd expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.110926:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.110928:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.110934:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.110941:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.110950:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143767.110966:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.110976:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594396672:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143767.110985:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594297088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 369us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.110991:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7318 00000100:00100000:3.0:1746143767.112166:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.113897:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594396672:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143767.113914:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.113925:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.114097:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594297344 00000100:00100000:1.0:1746143767.114103:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594297344 00002000:00100000:1.0:1746143767.114135:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3305472->3309567) req@ffff88009ca6d180 x1830963594297344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.114165:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d180 with x1830963594297344 ext(3305472->3309567) 00002000:00010000:1.0:1746143767.114169:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6d180 00000100:00100000:1.0:1746143767.114206:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6438 00000100:00100000:1.0:1746143767.114213:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594297344:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143767.114337:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594297344:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143767.114343:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6438 00002000:00100000:1.0:1746143767.114348:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3305472->3309567) req@ffff88009ca6d180 x1830963594297344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.114355:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d180 with x1830963594297344 ext(3305472->3309567) 00002000:00010000:1.0:1746143767.114357:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6d180 00000100:00100000:3.0:1746143767.115004:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594296960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4250us (4430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.115013:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7317 00000100:00100000:0.0:1746143767.117783:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.118122:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.118255:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594297472 00000100:00100000:2.0:1746143767.118263:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594297472 00000100:00100000:2.0:1746143767.118297:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13639 00000100:00100000:2.0:1746143767.118303:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594297472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.118317:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.118329:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde4800/0xe984082ccd73070d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ee7 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.118370:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594396800:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143767.118433:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.118618:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594297728 00000100:00100000:3.0:1746143767.118622:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594297728 00002000:00100000:3.0:1746143767.118644:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3665920->3670015) req@ffff88009ca6d880 x1830963594297728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.118652:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d880 with x1830963594297728 ext(3665920->3670015) 00002000:00010000:3.0:1746143767.118656:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6d880 00000100:00100000:3.0:1746143767.118676:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6439 00000100:00100000:3.0:1746143767.118682:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594297728:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143767.118796:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594297728:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 114us (673us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143767.118802:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6439 00002000:00100000:3.0:1746143767.118807:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3665920->3670015) req@ffff88009ca6d880 x1830963594297728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.118814:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6d880 with x1830963594297728 ext(3665920->3670015) 00002000:00010000:3.0:1746143767.118816:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6d880 00000100:00100000:2.0:1746143767.120795:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594396800:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143767.120819:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde4800/0xe984082ccd73070d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee7 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.120831:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde4800/0xe984082ccd73070d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee7 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.120883:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4800, rc 0) 00000100:00100000:2.0:1746143767.121032:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594297472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2727us (3253us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143767.121038:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13639 00000100:00100000:0.0:1746143767.122582:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.122727:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594297984 00000100:00100000:1.0:1746143767.122734:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594297984 00000100:00100000:1.0:1746143767.122780:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3981 00000100:00100000:1.0:1746143767.122786:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31456:x1830963594297984:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143767.122967:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31456:x1830963594297984:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 181us (388us total) trans 8589943582 rc 0/0 00000100:00100000:1.0:1746143767.122973:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3981 00000100:00100000:0.0:1746143767.130083:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.130135:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.130198:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594298368 00000100:00100000:1.0:1746143767.130206:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594298368 00002000:00100000:1.0:1746143767.130246:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009ca6c380 x1830963594298368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.130254:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c380 with x1830963594298368 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.130258:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c380 00000100:00100000:1.0:1746143767.130274:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594298496 00000100:00100000:1.0:1746143767.130276:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594298496 00002000:00100000:1.0:1746143767.130286:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ca6e300 x1830963594298496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.130294:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e300 with x1830963594298496 ext(0->1048575) 00002000:00010000:1.0:1746143767.130296:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6e300 00000100:00100000:1.0:1746143767.130358:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6440 00000100:00100000:3.0:1746143767.130363:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6441 00000100:00100000:1.0:1746143767.130365:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594298368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.130369:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594298496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143767.134696:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.134732:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.135807:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594298880 00000100:00100000:1.0:1746143767.135816:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594298880 00002000:00100000:1.0:1746143767.135854:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc24000 x1830963594298880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.135863:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24000 with x1830963594298880 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.135867:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc24000 00000100:00100000:1.0:1746143767.135898:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594299008 00000100:00100000:1.0:1746143767.135901:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594299008 00002000:00100000:1.0:1746143767.135915:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1748991) req@ffff88012fc24700 x1830963594299008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.135921:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24700 with x1830963594299008 ext(1048576->1748991) 00002000:00010000:1.0:1746143767.135924:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc24700 00000100:00100000:1.0:1746143767.135938:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6442 00000100:00100000:1.0:1746143767.135945:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594298880:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143767.136084:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6443 00000100:00100000:2.0:1746143767.136091:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594299008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.141920:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594298496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11542us (11776us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143767.141933:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6441 00002000:00100000:3.0:1746143767.141942:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ca6e300 x1830963594298496/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.141952:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e300 with x1830963594298496 ext(0->1048575) 00002000:00010000:3.0:1746143767.141957:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6e300 00000100:00100000:1.0:1746143767.152215:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594298368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20858us (21147us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.152225:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6440 00002000:00100000:1.0:1746143767.152235:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009ca6c380 x1830963594298368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.152250:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c380 with x1830963594298368 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.152254:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c380 00000100:00100000:2.0:1746143767.152509:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594299008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16417us (17774us total) trans 0 rc 700416/700416 00000100:00100000:2.0:1746143767.152516:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6443 00002000:00100000:2.0:1746143767.152521:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1748991) req@ffff88012fc24700 x1830963594299008/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.152528:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24700 with x1830963594299008 ext(1048576->1748991) 00002000:00010000:2.0:1746143767.152532:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc24700 00000100:00100000:1.0:1746143767.154488:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1962:x1830963594298880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18538us (19794us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.154497:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6442 00002000:00100000:1.0:1746143767.154505:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc24000 x1830963594298880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.154513:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24000 with x1830963594298880 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.154518:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc24000 00000100:00100000:0.0:1746143767.169822:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.169891:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594299264 00000100:00100000:1.0:1746143767.169899:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594299264 00002000:00100000:1.0:1746143767.169938:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2420736->3145727) req@ffff88012fc26d80 x1830963594299264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.169947:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc26d80 with x1830963594299264 ext(2420736->3145727) 00002000:00010000:1.0:1746143767.169952:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc26d80 00000100:00100000:1.0:1746143767.170420:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6444 00000100:00100000:1.0:1746143767.170429:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594299264:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.179586:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594299264:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9151us (9764us total) trans 0 rc 724992/724992 00000100:00100000:1.0:1746143767.179595:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6444 00002000:00100000:1.0:1746143767.179608:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2420736->3145727) req@ffff88012fc26d80 x1830963594299264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 724992/724992 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.179616:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc26d80 with x1830963594299264 ext(2420736->3145727) 00002000:00010000:1.0:1746143767.179622:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc26d80 00000100:00100000:0.0:1746143767.182893:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.183079:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594299392 00000100:00100000:2.0:1746143767.183087:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594299392 00000100:00100000:3.0:1746143767.183334:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13640 00000100:00100000:3.0:1746143767.183342:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:31460:x1830963594299392:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.183357:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.183372:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7eee expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.183395:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.183402:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143767.183403:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143767.183406:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.183430:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.183440:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 22 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.183450:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594396928:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.183994:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.184575:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594396928:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.184593:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.184604:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a7fe00, rc 0) 00000100:00100000:3.0:1746143767.184627:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:31460:x1830963594299392:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1287us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.184633:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13640 00000100:00100000:0.0:1746143767.185553:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.185627:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594299520 00000100:00100000:1.0:1746143767.185632:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594299520 00002000:00100000:1.0:1746143767.185660:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3305472->3670015) req@ffff88012fc25880 x1830963594299520/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.185672:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25880 with x1830963594299520 ext(3305472->3670015) 00010000:00010000:1.0:1746143767.185679:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 23 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.185690:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 23 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.185696:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc25880 00000100:00100000:1.0:1746143767.185853:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1824 00000100:00100000:1.0:1746143767.185859:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594299520:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143767.190503:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594299520:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 4636us (4945us total) trans 17179873146 rc 0/0 00000100:00100000:1.0:1746143767.190515:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1824 00002000:00100000:1.0:1746143767.190524:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3305472->3670015) req@ffff88012fc25880 x1830963594299520/t17179873146(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.190533:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25880 with x1830963594299520 ext(3305472->3670015) 00010000:00010000:1.0:1746143767.190541:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.190555:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.190562:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc25880 00000100:00100000:0.0:1746143767.192830:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.193119:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594299648 00000100:00100000:3.0:1746143767.193126:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594299648 00010000:00010000:3.0:1746143767.193186:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.193212:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7319 00000100:00100000:3.0:1746143767.193218:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594299648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.193229:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.193246:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.193255:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.193276:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5800/0xe984082ccd730706 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3670015) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ee0 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.193299:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.193301:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.193307:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.193314:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.193710:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 38 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.193721:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594397056:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143767.194263:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.196638:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594397056:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143767.196658:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.196699:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594299648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3480us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.196708:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7319 00000100:00100000:0.0:1746143767.206322:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.206358:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.206384:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594300032 00000100:00100000:1.0:1746143767.206391:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594300032 00000100:00100000:0.0:1746143767.206397:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:1.0:1746143767.206429:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012fc27b80 x1830963594300032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143767.206552:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594300160 00000100:00100000:2.0:1746143767.206556:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594300160 00002000:00100000:2.0:1746143767.206574:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012fc25f80 x1830963594300160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.206583:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25f80 with x1830963594300160 ext(3145728->4194303) 00002000:00010000:2.0:1746143767.206587:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc25f80 00000100:00100000:2.0:1746143767.206612:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594300416 00000100:00100000:2.0:1746143767.206614:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594300416 00002000:00100000:2.0:1746143767.206625:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012fc24380 x1830963594300416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.206632:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24380 with x1830963594300416 ext(3145728->4194303) 00002000:00010000:2.0:1746143767.206635:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc24380 00000100:00100000:2.0:1746143767.206648:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6445 00000100:00100000:2.0:1746143767.206654:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594300160:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143767.206663:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc27b80 with x1830963594300032 ext(2097152->3145727) 00002000:00010000:1.0:1746143767.206666:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc27b80 00000100:00100000:3.0:1746143767.206747:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6446 00000100:00100000:3.0:1746143767.206754:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594300416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.207266:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6447 00000100:00100000:1.0:1746143767.207272:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594300032:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143767.223370:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594300160:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16708us (17002us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143767.223380:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6445 00002000:00100000:2.0:1746143767.223390:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012fc25f80 x1830963594300160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.223397:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25f80 with x1830963594300160 ext(3145728->4194303) 00002000:00010000:2.0:1746143767.223402:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc25f80 00000100:00100000:1.0:1746143767.224778:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594300032:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17502us (18458us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.224786:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6447 00002000:00100000:1.0:1746143767.224792:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012fc27b80 x1830963594300032/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.224799:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc27b80 with x1830963594300032 ext(2097152->3145727) 00002000:00010000:1.0:1746143767.224803:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc27b80 00000100:00100000:3.0:1746143767.225904:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594300416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19146us (19500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143767.225917:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6446 00002000:00100000:3.0:1746143767.225923:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012fc24380 x1830963594300416/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.225931:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24380 with x1830963594300416 ext(3145728->4194303) 00002000:00010000:3.0:1746143767.225934:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc24380 00000100:00100000:0.0:1746143767.233043:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.233114:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594300672 00000100:00100000:3.0:1746143767.233121:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594300672 00002000:00100000:3.0:1746143767.233181:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012fc24a80 x1830963594300672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.233190:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24a80 with x1830963594300672 ext(4194304->4771839) 00002000:00010000:3.0:1746143767.233195:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc24a80 00000100:00100000:3.0:1746143767.233220:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6448 00000100:00100000:3.0:1746143767.233226:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594300672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.239135:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594300672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5901us (6091us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143767.239275:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6448 00002000:00100000:3.0:1746143767.239286:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012fc24a80 x1830963594300672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.239295:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24a80 with x1830963594300672 ext(4194304->4771839) 00002000:00010000:3.0:1746143767.239299:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc24a80 00000100:00100000:0.0:1746143767.251628:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.252543:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594300928 00000100:00100000:2.0:1746143767.252550:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594300928 00000100:00100000:2.0:1746143767.252609:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9242 00000100:00100000:2.0:1746143767.252616:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31467:x1830963594300928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.252634:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.252649:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30200/0xe984082ccd73071b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ef5 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.252743:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252754:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252763:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252774:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252779:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252784:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252871:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd730730 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252880:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd730730 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252885:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd730730 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143767.252893:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143767.252964:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252970:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252974:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252979:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde5800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143767.252982:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252987:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.252995:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143767.252997:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143767.253000:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253004:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5800/0xe984082ccd730722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253032:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253036:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253041:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253045:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bde5e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143767.253047:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253051:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253057:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093484900) 00010000:00010000:2.0:1746143767.253059:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143767.253061:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253065:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730729 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143767.253098:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30200/0xe984082ccd73071b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ef5 expref: 35 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.253109:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd730730 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ef5 expref: 34 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.253114:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143767.253116:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143767.253118:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4800, rc 0) 00000100:00100000:2.0:1746143767.253603:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:31467:x1830963594300928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 987us (1979us total) trans 8589943583 rc 0/0 00000100:00100000:2.0:1746143767.253609:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9242 00000100:00100000:0.0:1746143767.255500:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.256036:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594301056 00000100:00100000:3.0:1746143767.256042:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594301056 00000100:00100000:3.0:1746143767.256081:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 740 00000100:00100000:3.0:1746143767.256085:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1963:x1830963594301056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.256094:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.256109:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde4800/0xe984082ccd730730 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ef5 expref: 34 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.256124:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.256127:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.256198:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:1963:x1830963594301056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.256204:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 740 00000100:00100000:2.0:1746143767.256459:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.256487:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594301184 00000100:00100000:3.0:1746143767.256490:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594301184 00000100:00100000:3.0:1746143767.256504:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13641 00000100:00100000:3.0:1746143767.256507:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594301184:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143767.256513:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143767.256517:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.256526:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a7fa00/0xe984082ccd73073e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7efc expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.256547:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.256554:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594397184:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143767.256563:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594301312 00000100:00100000:2.0:1746143767.256566:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594301312 00000100:00100000:2.0:1746143767.256586:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594301440 00000100:00100000:2.0:1746143767.256589:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594301440 00000100:00100000:2.0:1746143767.256602:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13642 00000100:00100000:2.0:1746143767.256607:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594301312:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143767.256611:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143767.256614:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.256620:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde5600/0xe984082ccd730745 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f03 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.256625:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13643 00000100:00100000:3.0:1746143767.256628:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594301440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.256633:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.256639:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f0a expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.256641:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397312:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143767.256646:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.256647:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.256652:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.256662:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.256671:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed02200, rc 0) 00000100:00100000:2.0:1746143767.256862:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.256880:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594301440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 251us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.256884:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13643 00002000:00010000:3.0:1746143767.258358:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143766 -> 1746143767 00000100:00100000:3.0:1746143767.258375:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594397184:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143767.258393:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a7fa00/0xe984082ccd73073e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7efc expref: 29 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.258400:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a7fa00/0xe984082ccd73073e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7efc expref: 29 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.258407:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a7fa00, rc 0) 00000100:00100000:3.0:1746143767.258439:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594301184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1930us (1980us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143767.258443:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13641 00002000:00010000:2.0:1746143767.259613:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143766 -> 1746143767 00000100:00100000:2.0:1746143767.259625:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397312:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143767.259642:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5600/0xe984082ccd730745 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f03 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.259651:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5600/0xe984082ccd730745 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f03 expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.259659:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5600, rc 0) 00000100:00100000:2.0:1746143767.259693:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594301312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3085us (3179us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143767.259698:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13642 00000100:00100000:0.0:1746143767.268750:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.268805:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594301568 00000100:00100000:2.0:1746143767.268813:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594301568 00000100:00100000:2.0:1746143767.268859:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13644 00000100:00100000:2.0:1746143767.268866:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31467:x1830963594301568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.268881:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.268895:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f11 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.268920:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.268926:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.268928:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.268931:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.268953:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.268964:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 23 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.268974:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397440:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.269052:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.270416:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397440:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.270436:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.270447:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5400, rc 0) 00000100:00100000:2.0:1746143767.270485:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31467:x1830963594301568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1618us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.270491:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13644 00000100:00100000:2.0:1746143767.271363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.271983:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594301696 00000100:00100000:3.0:1746143767.271989:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594301696 00002000:00100000:3.0:1746143767.272023:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1748992->2097151) req@ffff88012f186d80 x1830963594301696/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.272031:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186d80 with x1830963594301696 ext(1748992->2097151) 00010000:00010000:3.0:1746143767.272037:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.272047:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:3.0:1746143767.272053:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f186d80 00000100:00100000:3.0:1746143767.272082:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1825 00000100:00100000:3.0:1746143767.272088:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594301696:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143767.275967:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594301696:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3870us (4596us total) trans 21474840468 rc 0/0 00000100:00100000:3.0:1746143767.275976:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1825 00002000:00100000:3.0:1746143767.275985:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1748992->2097151) req@ffff88012f186d80 x1830963594301696/t21474840468(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.275993:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186d80 with x1830963594301696 ext(1748992->2097151) 00010000:00010000:3.0:1746143767.276001:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 26 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.276013:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 26 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:3.0:1746143767.276020:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f186d80 00000100:00100000:0.0:1746143767.278731:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.278793:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594301824 00000100:00100000:3.0:1746143767.278800:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594301824 00010000:00010000:3.0:1746143767.278830:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 26 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.278873:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7320 00000100:00100000:3.0:1746143767.278879:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594301824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.278889:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.278907:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 26 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.278916:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 26 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.278933:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4a00/0xe984082ccd7306d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ecb expref: 26 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.278959:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.278961:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.278967:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.278975:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.279001:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.279011:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594397568:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143767.279080:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.280433:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594397568:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143767.280449:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.280920:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594301824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2038us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.280929:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7320 00000100:00100000:2.0:1746143767.282930:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.283093:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594302080 00000100:00100000:3.0:1746143767.283099:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594302080 00002000:00100000:3.0:1746143767.283134:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012f186a00 x1830963594302080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.283160:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186a00 with x1830963594302080 ext(1048576->2097151) 00002000:00010000:3.0:1746143767.283164:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f186a00 00000100:00100000:3.0:1746143767.283202:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6449 00000100:00100000:3.0:1746143767.283208:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594302080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.291465:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594302080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8249us (8530us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143767.291475:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6449 00002000:00100000:3.0:1746143767.291485:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012f186a00 x1830963594302080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.291493:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f186a00 with x1830963594302080 ext(1048576->2097151) 00002000:00010000:3.0:1746143767.291498:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f186a00 00000100:00100000:0.0:1746143767.296602:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.296750:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594302208 00000100:00100000:2.0:1746143767.296760:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594302208 00000100:00100000:2.0:1746143767.296833:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13645 00000100:00100000:2.0:1746143767.296842:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31467:x1830963594302208:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.296860:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.296884:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f18 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.296915:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.296923:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.296925:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.296928:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.296958:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.296970:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 24 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.296982:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397696:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.297089:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.299348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.299492:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397696:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.299518:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.299533:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5000, rc 0) 00000100:00100000:2.0:1746143767.299578:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31467:x1830963594302208:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2735us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.299585:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13645 00000100:00100000:3.0:1746143767.299687:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594302336 00000100:00100000:3.0:1746143767.299694:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594302336 00002000:00100000:3.0:1746143767.299731:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2420735) req@ffff88009bfe2d80 x1830963594302336/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.299739:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2d80 with x1830963594302336 ext(2097152->2420735) 00010000:00010000:3.0:1746143767.299747:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.299759:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 25 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:3.0:1746143767.299765:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe2d80 00000100:00100000:3.0:1746143767.299806:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1826 00000100:00100000:3.0:1746143767.299815:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594302336:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143767.307215:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594302336:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7391us (7862us total) trans 21474840469 rc 0/0 00000100:00100000:3.0:1746143767.307227:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1826 00002000:00100000:3.0:1746143767.307239:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->2420735) req@ffff88009bfe2d80 x1830963594302336/t21474840469(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.307247:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2d80 with x1830963594302336 ext(2097152->2420735) 00010000:00010000:3.0:1746143767.307257:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.307271:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:3.0:1746143767.307277:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe2d80 00000100:00100000:0.0:1746143767.314561:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.314771:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594302464 00000100:00100000:3.0:1746143767.314781:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594302464 00010000:00010000:3.0:1746143767.314818:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.314879:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7321 00000100:00100000:3.0:1746143767.314888:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594302464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.314902:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.314924:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.314935:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.314956:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd7306dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ed2 expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.316380:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.316383:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.316391:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.316399:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.316430:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.316438:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594397824:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143767.316507:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.322076:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594397824:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143767.322095:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.322369:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594302464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7481us (7815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.322378:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7321 00000100:00100000:0.0:1746143767.326237:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.326296:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594302720 00000100:00100000:3.0:1746143767.326304:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594302720 00002000:00100000:3.0:1746143767.326338:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009bfe0e00 x1830963594302720/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.326346:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830963594302720 ext(2097152->3145727) 00002000:00010000:3.0:1746143767.326350:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0e00 00000100:00100000:3.0:1746143767.326365:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6450 00000100:00100000:3.0:1746143767.326370:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594302720:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.326746:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.326773:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.328008:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.328462:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594302976 00000100:00100000:2.0:1746143767.328468:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594302976 00002000:00100000:2.0:1746143767.328495:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0af800 x1830963594302976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.328509:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af800 with x1830963594302976 ext(3145728->4194303) 00002000:00010000:2.0:1746143767.328513:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0af800 00000100:00100000:2.0:1746143767.328533:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303360 00000100:00100000:2.0:1746143767.328536:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303360 00002000:00100000:2.0:1746143767.328549:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f0adf80 x1830963594303360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.328555:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adf80 with x1830963594303360 ext(3145728->4194303) 00002000:00010000:2.0:1746143767.328558:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adf80 00000100:00100000:2.0:1746143767.328579:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303232 00000100:00100000:2.0:1746143767.328581:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303232 00002000:00100000:2.0:1746143767.328592:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0aea00 x1830963594303232/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.328597:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aea00 with x1830963594303232 ext(2097152->3145727) 00000100:00100000:3.0:1746143767.328599:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6451 00002000:00010000:2.0:1746143767.328599:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0aea00 00000100:00100000:3.0:1746143767.328607:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963594302976:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143767.328612:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6452 00000100:00100000:2.0:1746143767.328617:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594303360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.328948:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6453 00000100:00100000:3.0:1746143767.328954:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594303232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143767.336606:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.336781:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303616 00000100:00100000:2.0:1746143767.336790:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303616 00000100:00100000:2.0:1746143767.336842:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13646 00000100:00100000:2.0:1746143767.336849:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31463:x1830963594303616:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143767.336865:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.336879:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f1f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.336907:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.336919:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.336924:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.336927:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.336929:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [831488->1048575] (req 831488->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.336953:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.336963:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 27 pid: 12618 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.336973:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397952:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.337053:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.337060:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 31 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.337067:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594398080:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.337085:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.338101:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963594302720:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11726us (11867us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143767.338108:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6450 00002000:00100000:2.0:1746143767.338115:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009bfe0e00 x1830963594302720/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.338123:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0e00 with x1830963594302720 ext(2097152->3145727) 00002000:00010000:2.0:1746143767.338126:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0e00 00000100:00100000:2.0:1746143767.342257:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594303360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13632us (15474us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143767.342268:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6452 00002000:00100000:2.0:1746143767.342278:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f0adf80 x1830963594303360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.342286:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adf80 with x1830963594303360 ext(3145728->4194303) 00002000:00010000:2.0:1746143767.342292:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adf80 00000100:00100000:2.0:1746143767.345721:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594397952:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.345732:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594398080:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.345756:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [831488->1048575] (req 831488->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.345770:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4200, rc 0) 00000100:00100000:2.0:1746143767.345816:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31463:x1830963594303616:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8967us (9217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.345823:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13646 00000100:00100000:3.0:1746143767.346253:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594303232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17297us (18244us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143767.346261:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6453 00002000:00100000:3.0:1746143767.346513:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0aea00 x1830963594303232/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.346522:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aea00 with x1830963594303232 ext(2097152->3145727) 00002000:00010000:3.0:1746143767.346528:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0aea00 00000100:00100000:0.0:1746143767.347904:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.347937:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.348214:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303744 00000100:00100000:3.0:1746143767.348220:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303744 00010000:00010000:3.0:1746143767.348245:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 27 pid: 12618 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.348865:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594302976:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20258us (22119us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143767.348873:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6451 00002000:00100000:2.0:1746143767.348880:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0af800 x1830963594302976/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.348887:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af800 with x1830963594302976 ext(3145728->4194303) 00002000:00010000:2.0:1746143767.348890:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0af800 00000100:00100000:3.0:1746143767.348939:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594303872 00000100:00100000:3.0:1746143767.348941:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594303872 00010000:00010000:3.0:1746143767.348952:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746143767.349039:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.349115:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7322 00000100:00100000:3.0:1746143767.349122:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594303744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.349132:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143767.349137:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7323 00000100:00100000:1.0:1746143767.349157:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594303872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.349162:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 27 pid: 12618 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.349164:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.349182:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.349183:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 27 pid: 12618 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.349192:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.349207:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c58e200/0xe984082ccd7306ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea1 expref: 27 pid: 12618 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.349212:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd73066c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e70 expref: 28 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.349223:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.349224:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.349230:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.349242:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.349290:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143767.349305:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.349310:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594303872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 154us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.349315:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7323 00000100:00100000:3.0:1746143767.349316:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594398208:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143767.349356:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.349382:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304128 00000100:00100000:3.0:1746143767.349384:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304128 00000100:00100000:3.0:1746143767.349403:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9243 00000100:00100000:3.0:1746143767.349407:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+33:31469:x1830963594304128:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143767.349423:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.349434:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03c00/0xe984082ccd730768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f26 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.349509:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349518:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349525:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349535:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349543:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349549:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349633:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd73077d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349641:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd73077d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349646:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd73077d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143767.349654:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143767.349720:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349726:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349731:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349736:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed03a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143767.349740:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349746:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349753:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143767.349756:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143767.349759:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349763:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03a00/0xe984082ccd73076f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349771:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349775:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349778:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349782:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed03800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143767.349784:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349788:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349793:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442b00) 00010000:00010000:3.0:1746143767.349794:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143767.349796:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349800:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730776 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143767.349825:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03c00/0xe984082ccd730768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f26 expref: 36 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.349838:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd73077d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f26 expref: 35 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.349843:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.349845:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143767.349847:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed03600, rc 0) 00000100:00100000:3.0:1746143767.349883:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:31469:x1830963594304128:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 475us (844us total) trans 8589943584 rc 0/0 00000100:00100000:3.0:1746143767.349888:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9243 00000100:00100000:0.0:1746143767.351582:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.352403:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304384 00000100:00100000:2.0:1746143767.352408:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304384 00002000:00100000:2.0:1746143767.352443:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (831488->835583) req@ffff88009bfe3480 x1830963594304384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.352451:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830963594304384 ext(831488->835583) 00002000:00010000:2.0:1746143767.352455:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3480 00000100:00100000:2.0:1746143767.352472:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6454 00000100:00100000:2.0:1746143767.352477:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594304384:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143767.352619:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594304384:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 140us (1041us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143767.352624:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6454 00002000:00100000:2.0:1746143767.352629:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (831488->835583) req@ffff88009bfe3480 x1830963594304384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.352636:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3480 with x1830963594304384 ext(831488->835583) 00002000:00010000:2.0:1746143767.352638:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe3480 00000100:00100000:3.0:1746143767.352788:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594398208:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143767.352806:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.352827:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594303744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3705us (4927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.352834:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7322 00000100:00100000:0.0:1746143767.357615:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.357668:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.357684:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304512 00000100:00100000:3.0:1746143767.357692:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304512 00000100:00100000:3.0:1746143767.357735:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 741 00000100:00100000:3.0:1746143767.357743:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:1963:x1830963594304512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.357754:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.357774:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd73077d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f26 expref: 35 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.357787:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304640 00010000:00010000:3.0:1746143767.357790:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00000100:00100000:2.0:1746143767.357791:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304640 00010000:00010000:3.0:1746143767.357793:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.357820:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13647 00000100:00100000:2.0:1746143767.357825:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:31463:x1830963594304640:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:3.0:1746143767.357829:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:1963:x1830963594304512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.357836:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 741 00010000:00010000:2.0:1746143767.357837:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.357848:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f2d expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.357867:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.357874:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 40 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.357880:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.357881:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.357884:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->1810431] (req 1048576->1810431) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.357905:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 40 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.357915:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 40 pid: 8497 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.357925:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594398336:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.357984:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 24 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.357995:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 24 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.358003:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594398464:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.358021:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.359595:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.359650:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.359696:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304768 00000100:00100000:2.0:1746143767.359700:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304768 00000100:00100000:2.0:1746143767.359717:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594304896 00000100:00100000:2.0:1746143767.359718:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594304896 00000100:00100000:2.0:1746143767.359726:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13648 00000100:00100000:2.0:1746143767.359730:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594304768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.359738:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.359746:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4400/0xe984082ccd730792 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f34 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.359773:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594398592:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143767.359823:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.359838:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13649 00000100:00100000:2.0:1746143767.359843:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31469:x1830963594304896:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143767.359849:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.359856:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f3b expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.359868:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 30 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.359879:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.359880:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.359883:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1757184->1937407] (req 1757184->1937407) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.359897:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 30 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.359905:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.359912:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594398720:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.359930:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.360224:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.360339:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.360464:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305024 00000100:00100000:0.0:1746143767.360467:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305024 00000100:00100000:0.0:1746143767.360483:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305152 00000100:00100000:0.0:1746143767.360484:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305152 00000100:00100000:0.0:1746143767.360495:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13650 00000100:00100000:0.0:1746143767.360499:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594305024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143767.360506:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.360512:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bead200/0xe984082ccd7307a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f42 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.360520:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.360527:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bead200/0xe984082ccd7307a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f42 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.360535:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bead200/0xe984082ccd7307a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f42 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.360556:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bead200, rc 0) 00000100:00100000:0.0:1746143767.360575:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594305024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 75us (351us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143767.360579:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13650 00000100:00100000:0.0:1746143767.360590:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13651 00000100:00100000:0.0:1746143767.360594:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594305152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143767.360599:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.360604:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f49 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.360612:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.360613:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.360618:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 27 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.360628:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 27 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.360635:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beadc00, rc 0) 00000100:00100000:0.0:1746143767.360646:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594305152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.360649:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13651 00000100:00100000:2.0:1746143767.360850:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594398336:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.360858:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594398464:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.360874:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->1810431] (req 1048576->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.360882:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5600, rc 0) 00000100:00100000:2.0:1746143767.360963:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:31463:x1830963594304640:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3137us (3295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.360968:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13647 00000100:00100000:3.0:1746143767.361813:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594398720:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.361825:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1757184->1937407] (req 1757184->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.361834:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4600, rc 0) 00000100:00100000:3.0:1746143767.361862:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:31469:x1830963594304896:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2018us (2210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.361867:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13649 00002000:00010000:2.0:1746143767.361917:0:8496:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime: 1746143765 -> 1746143767 00002000:00010000:2.0:1746143767.361921:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143764 -> 1746143767 00002000:00010000:2.0:1746143767.361923:0:8496:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime: 1746143765 -> 1746143767 00000100:00100000:2.0:1746143767.361937:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594398592:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143767.361949:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4400/0xe984082ccd730792 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f34 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.361957:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4400/0xe984082ccd730792 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f34 expref: 29 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.361967:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4400, rc 0) 00000100:00100000:2.0:1746143767.361981:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594304768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2251us (2388us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143767.361986:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13648 00000100:00100000:0.0:1746143767.363321:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.363358:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.363422:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305280 00000100:00100000:3.0:1746143767.363428:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305280 00010000:00010000:3.0:1746143767.363454:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 40 pid: 8497 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.363517:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305408 00000100:00100000:3.0:1746143767.363520:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305408 00010000:00010000:3.0:1746143767.363530:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 25 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.363698:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7324 00000100:00100000:3.0:1746143767.363705:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594305280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.363716:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.363732:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 40 pid: 8497 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.363741:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 40 pid: 8497 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.363757:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5a00/0xe984082ccd73069d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ea8 expref: 40 pid: 8497 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.363772:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.363816:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7325 00000100:00100000:1.0:1746143767.363823:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594305408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.363830:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.363838:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 25 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.363845:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 25 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.363855:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4800/0xe984082ccd730673 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e77 expref: 25 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.363871:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.363873:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.363879:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 39 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.363886:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 39 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.363909:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 39 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.363917:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594398848:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143767.364817:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594305280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1109us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.364823:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7324 00000100:00100000:0.0:1746143767.365552:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.365597:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.365641:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.365828:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305536 00000100:00100000:3.0:1746143767.365833:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305536 00010000:00010000:3.0:1746143767.365849:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 28 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.365872:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7326 00000100:00100000:3.0:1746143767.365877:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594305536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.365885:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.365899:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 28 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.365908:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 28 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.365922:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd730753 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f11 expref: 28 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.365932:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.365934:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.365938:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.365945:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.365966:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.365974:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594398976:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143767.366235:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594305792 00000100:00100000:1.0:1746143767.366238:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594305792 00002000:00100000:1.0:1746143767.366259:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880094c0e300 x1830963594305792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.366267:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e300 with x1830963594305792 ext(4194304->4771839) 00002000:00010000:1.0:1746143767.366270:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0e300 00000100:00100000:3.0:1746143767.366553:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.366674:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6455 00000100:00100000:1.0:1746143767.366680:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594305792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143767.366724:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.366788:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306048 00000100:00100000:3.0:1746143767.366791:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306048 00002000:00100000:3.0:1746143767.366806:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->831487) req@ffff880094c0f800 x1830963594306048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.366812:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f800 with x1830963594306048 ext(0->831487) 00002000:00010000:3.0:1746143767.366816:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0f800 00000100:00100000:3.0:1746143767.366828:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6456 00000100:00100000:3.0:1746143767.366833:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594306048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.368308:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594398848:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143767.368323:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.368556:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594398976:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143767.368566:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.369009:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594305408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5184us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.369093:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594305536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3215us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.369109:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7325 00000100:00100000:2.0:1746143767.369180:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7326 00000100:00100000:2.0:1746143767.369226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.370114:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306304 00000100:00100000:3.0:1746143767.370121:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306304 00002000:00100000:3.0:1746143767.370177:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1757184->1761279) req@ffff8800949f0380 x1830963594306304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.370192:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0380 with x1830963594306304 ext(1757184->1761279) 00002000:00010000:3.0:1746143767.370196:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0380 00000100:00100000:3.0:1746143767.370212:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6457 00000100:00100000:3.0:1746143767.370219:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594306304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.370337:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594306304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 118us (1110us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143767.370343:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6457 00002000:00100000:3.0:1746143767.370347:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1757184->1761279) req@ffff8800949f0380 x1830963594306304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.370353:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0380 with x1830963594306304 ext(1757184->1761279) 00002000:00010000:3.0:1746143767.370355:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0380 00000100:00100000:0.0:1746143767.376969:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.377231:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306560 00000100:00100000:3.0:1746143767.377239:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306560 00002000:00100000:3.0:1746143767.377273:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1806336->1810431) req@ffff880094c0ea00 x1830963594306560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.377282:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963594306560 ext(1806336->1810431) 00002000:00010000:3.0:1746143767.377286:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ea00 00000100:00100000:3.0:1746143767.377303:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6458 00000100:00100000:3.0:1746143767.377308:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594306560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143767.377459:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594306560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 149us (494us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143767.377464:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6458 00002000:00100000:3.0:1746143767.377470:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1806336->1810431) req@ffff880094c0ea00 x1830963594306560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.377476:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ea00 with x1830963594306560 ext(1806336->1810431) 00002000:00010000:3.0:1746143767.377479:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ea00 00000100:00100000:1.0:1746143767.377630:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594305792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10949us (11987us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746143767.377640:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6455 00002000:00100000:1.0:1746143767.377645:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880094c0e300 x1830963594305792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.377652:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e300 with x1830963594305792 ext(4194304->4771839) 00002000:00010000:1.0:1746143767.377655:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0e300 00000100:00100000:2.0:1746143767.377944:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594306048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11110us (11219us total) trans 0 rc 831488/831488 00000100:00100000:2.0:1746143767.377950:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6456 00002000:00100000:2.0:1746143767.377954:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->831487) req@ffff880094c0f800 x1830963594306048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.377960:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f800 with x1830963594306048 ext(0->831487) 00002000:00010000:2.0:1746143767.377963:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0f800 00000100:00100000:0.0:1746143767.380213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.381127:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.381165:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.381220:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306816 00000100:00100000:2.0:1746143767.381227:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306816 00000100:00100000:2.0:1746143767.381261:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3982 00000100:00100000:2.0:1746143767.381267:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+34:31469:x1830963594306816:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143767.381530:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594306944 00000100:00100000:3.0:1746143767.381534:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594306944 00000100:00100000:3.0:1746143767.381554:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307072 00000100:00100000:3.0:1746143767.381555:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307072 00000100:00100000:3.0:1746143767.381567:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13652 00000100:00100000:3.0:1746143767.381571:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594306944:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.381579:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.381592:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ed02e00/0xe984082ccd7307ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f50 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.381635:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594399104:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143767.382405:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.382426:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13653 00000100:00100000:3.0:1746143767.382432:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594307072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.382590:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.382601:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed03600/0xe984082ccd7307b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f57 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.382642:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:31469:x1830963594306816:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1374us (2434us total) trans 8589943585 rc 0/0 00000100:00100000:2.0:1746143767.382650:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3982 00000100:00100000:3.0:1746143767.382697:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594399232:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143767.382718:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.384697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.385027:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307328 00000100:00100000:2.0:1746143767.385034:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307328 00002000:00100000:2.0:1746143767.385066:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1810432->2097151) req@ffff880094c0fb80 x1830963594307328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.385074:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0fb80 with x1830963594307328 ext(1810432->2097151) 00002000:00010000:2.0:1746143767.385079:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0fb80 00000100:00100000:2.0:1746143767.385109:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6459 00000100:00100000:2.0:1746143767.385116:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594307328:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143767.389780:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594399104:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143767.389811:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed02e00/0xe984082ccd7307ae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f50 expref: 28 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.389823:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed02e00/0xe984082ccd7307ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f50 expref: 28 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.389837:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed02e00, rc 0) 00000100:00100000:2.0:1746143767.389878:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594306944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8305us (8752us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143767.389889:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13652 00002000:00010000:3.0:1746143767.389949:0:8497:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime: 1746143764 -> 1746143767 00002000:00010000:3.0:1746143767.389952:0:8497:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143764 -> 1746143767 00002000:00010000:3.0:1746143767.389954:0:8497:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime: 1746143764 -> 1746143767 00000100:00100000:3.0:1746143767.389963:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594399232:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143767.389977:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed03600/0xe984082ccd7307b5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f57 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.389985:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed03600/0xe984082ccd7307b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f57 expref: 25 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.390000:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed03600, rc 0) 00000100:00100000:3.0:1746143767.390017:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594307072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7586us (8852us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143767.390022:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13653 00000100:00100000:0.0:1746143767.391113:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594307328:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5995us (6419us total) trans 0 rc 286720/286720 00000100:00100000:0.0:1746143767.391121:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6459 00002000:00100000:0.0:1746143767.391129:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1810432->2097151) req@ffff880094c0fb80 x1830963594307328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 286720/286720 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.391137:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0fb80 with x1830963594307328 ext(1810432->2097151) 00002000:00010000:0.0:1746143767.391157:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0fb80 00000100:00100000:0.0:1746143767.393565:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.393598:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.393616:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307456 00000100:00100000:3.0:1746143767.393624:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307456 00000100:00100000:3.0:1746143767.393654:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307584 00000100:00100000:3.0:1746143767.393655:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307584 00000100:00100000:3.0:1746143767.393669:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13654 00000100:00100000:2.0:1746143767.393674:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13655 00000100:00100000:3.0:1746143767.393675:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594307456:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143767.393680:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963594307584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.393687:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.393687:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.393699:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ed03800/0xe984082ccd7307bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f5e expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.393699:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba31e00/0xe984082ccd7307c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f65 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.393734:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594399488:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143767.393734:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594399360:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143767.393796:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.393913:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.395366:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.395415:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594399488:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143767.395439:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ed03800/0xe984082ccd7307bc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f5e expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.395450:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ed03800/0xe984082ccd7307bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f5e expref: 28 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.395459:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed03800, rc 0) 00000100:00100000:2.0:1746143767.395461:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307712 00000100:00100000:2.0:1746143767.395465:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307712 00000100:00100000:3.0:1746143767.395488:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594307456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1812us (1926us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143767.395493:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13654 00000100:00100000:2.0:1746143767.395510:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13656 00000100:00100000:2.0:1746143767.395596:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31472:x1830963594307712:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.395608:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.395617:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f6c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.395634:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.395641:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.395643:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.395646:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.395667:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 26 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.395677:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 26 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.395686:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594399616:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.395733:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.396026:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594399360:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143767.396043:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ba31e00/0xe984082ccd7307c3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f65 expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.396052:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba31e00/0xe984082ccd7307c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f65 expref: 25 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.396217:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba31e00, rc 0) 00000100:00100000:2.0:1746143767.396241:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1962:x1830963594307584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2561us (2643us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143767.396247:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13655 00000100:00100000:2.0:1746143767.398898:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594399616:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.398921:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.398935:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5a00, rc 0) 00000100:00100000:2.0:1746143767.399008:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31472:x1830963594307712:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3492us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.399019:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13656 00000100:00100000:0.0:1746143767.401549:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.401595:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.401661:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594308096 00000100:00100000:1.0:1746143767.401668:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594308096 00002000:00100000:1.0:1746143767.401702:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1757184->1937407) req@ffff880094c0c700 x1830963594308096/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.401711:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c700 with x1830963594308096 ext(1757184->1937407) 00010000:00010000:1.0:1746143767.401718:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.401730:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 27 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.401737:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0c700 00000100:00100000:2.0:1746143767.401741:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594307968 00000100:00100000:2.0:1746143767.401745:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594307968 00000100:00100000:1.0:1746143767.401752:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1827 00000100:00100000:1.0:1746143767.401758:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594308096:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143767.401774:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3983 00000100:00100000:2.0:1746143767.401780:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+35:31467:x1830963594307968:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143767.401929:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:31467:x1830963594307968:12345-192.168.202.48@tcp:35:cat.0 Request processed in 148us (386us total) trans 8589943586 rc 0/0 00000100:00100000:2.0:1746143767.401935:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3983 00000100:00100000:1.0:1746143767.404558:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594308096:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2794us (2956us total) trans 21474840470 rc 0/0 00000100:00100000:1.0:1746143767.404567:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1827 00002000:00100000:1.0:1746143767.404575:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1757184->1937407) req@ffff880094c0c700 x1830963594308096/t21474840470(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.404583:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c700 with x1830963594308096 ext(1757184->1937407) 00010000:00010000:1.0:1746143767.404591:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.404603:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.404609:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c0c700 00000100:00100000:0.0:1746143767.406477:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.406564:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594308224 00000100:00100000:2.0:1746143767.406571:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594308224 00010000:00010000:2.0:1746143767.406596:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.406630:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7327 00000100:00100000:2.0:1746143767.406636:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594308224:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143767.406647:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143767.406660:0:23335:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143766 -> 1746143767 00002000:00010000:2.0:1746143767.406663:0:23335:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143766 -> 1746143767 00010000:00010000:2.0:1746143767.406667:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.406676:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.406693:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4600/0xe984082ccd730799 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->1937407) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f3b expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.406704:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.406706:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.406712:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.406719:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.406744:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.406754:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594399744:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143767.406826:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.410940:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594399744:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143767.410959:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.411006:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c29050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594308224:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4369us (4532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.411014:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7327 00000100:00100000:0.0:1746143767.411893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.412494:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594308480 00000100:00100000:1.0:1746143767.412500:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594308480 00002000:00100000:1.0:1746143767.412533:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880094c0d880 x1830963594308480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.412542:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963594308480 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.412546:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:1.0:1746143767.412562:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6460 00000100:00100000:1.0:1746143767.412568:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594308480:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.421091:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594308480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8515us (9190us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.421780:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6460 00002000:00100000:1.0:1746143767.421791:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880094c0d880 x1830963594308480/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.421799:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d880 with x1830963594308480 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.421804:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d880 00000100:00100000:1.0:1746143767.430302:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.430395:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594308736 00000100:00100000:2.0:1746143767.430403:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594308736 00000100:00100000:1.0:1746143767.430415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143767.430443:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f0aca80 x1830963594308736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.430453:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aca80 with x1830963594308736 ext(2097152->3145727) 00002000:00010000:2.0:1746143767.430457:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0aca80 00000100:00100000:0.0:1746143767.430931:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594308992 00000100:00100000:0.0:1746143767.430936:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594308992 00000100:00100000:2.0:1746143767.430937:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6461 00000100:00100000:2.0:1746143767.430943:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1963:x1830963594308736:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:0.0:1746143767.430951:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ae680 x1830963594308992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.430958:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae680 with x1830963594308992 ext(3145728->4194303) 00002000:00010000:0.0:1746143767.430960:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae680 00000100:00100000:0.0:1746143767.430979:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6462 00000100:00100000:0.0:1746143767.430983:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594308992:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143767.441209:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594308736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10258us (10905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143767.441219:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6461 00002000:00100000:2.0:1746143767.441229:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f0aca80 x1830963594308736/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.441238:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aca80 with x1830963594308736 ext(2097152->3145727) 00002000:00010000:2.0:1746143767.441243:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0aca80 00000100:00100000:1.0:1746143767.441611:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594308992:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10626us (11195us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.441617:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6462 00002000:00100000:1.0:1746143767.441623:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ae680 x1830963594308992/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.441629:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ae680 with x1830963594308992 ext(3145728->4194303) 00002000:00010000:1.0:1746143767.441700:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ae680 00000100:00100000:0.0:1746143767.448541:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.448623:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594309248 00000100:00100000:1.0:1746143767.448631:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594309248 00002000:00100000:1.0:1746143767.448664:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880094c0df80 x1830963594309248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.448673:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0df80 with x1830963594309248 ext(4194304->4771839) 00002000:00010000:1.0:1746143767.448677:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0df80 00000100:00100000:1.0:1746143767.448755:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6463 00000100:00100000:1.0:1746143767.448761:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594309248:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.452816:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594309248:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4047us (4275us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746143767.452825:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6463 00002000:00100000:1.0:1746143767.452834:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880094c0df80 x1830963594309248/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.452844:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0df80 with x1830963594309248 ext(4194304->4771839) 00002000:00010000:1.0:1746143767.452848:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0df80 00000100:00100000:0.0:1746143767.611739:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.611790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.611827:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594309632 00000100:00100000:0.0:1746143767.611833:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594309632 00000100:00100000:0.0:1746143767.611865:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13657 00000100:00100000:0.0:1746143767.611872:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31484:x1830963594309632:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143767.611886:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.611900:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f7a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.611923:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 29 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.611930:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.611932:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.611935:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1933312->2027519] (req 1933312->2027519) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 29 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.611960:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 29 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.611970:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 29 pid: 6929 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.611980:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594399872:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.612070:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.612162:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594309504 00000100:00100000:3.0:1746143767.612194:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594309504 00000100:00100000:3.0:1746143767.612220:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9244 00000100:00100000:3.0:1746143767.612225:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+36:31483:x1830963594309504:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143767.612240:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.612250:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd7307d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f73 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.612335:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612344:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612353:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612363:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612367:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612372:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612459:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd7307ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612467:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd7307ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612473:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd7307ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143767.612488:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143767.612560:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612566:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612570:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612575:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed03800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143767.612578:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612584:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612593:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143767.612595:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143767.612603:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612612:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd7307df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612645:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612649:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612654:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612658:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed03600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143767.612660:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612664:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612669:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442500) 00010000:00010000:3.0:1746143767.612671:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143767.612673:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612677:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd7307e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.612707:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd7307d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f73 expref: 39 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.612720:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd7307ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f73 expref: 38 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.612730:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.612732:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143767.612734:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed02600, rc 0) 00000100:00100000:3.0:1746143767.612767:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:31483:x1830963594309504:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 541us (1035us total) trans 8589943587 rc 0/0 00000100:00100000:3.0:1746143767.612773:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9244 00000100:00100000:2.0:1746143767.616089:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594399872:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.616116:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1933312->2027519] (req 1933312->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 29 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.616130:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beac200, rc 0) 00000100:00100000:2.0:1746143767.616207:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31484:x1830963594309632:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4334us (4415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.616214:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13657 00000100:00100000:2.0:1746143767.616697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.617209:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594309888 00000100:00100000:0.0:1746143767.617215:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594309888 00000100:00100000:0.0:1746143767.617252:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 742 00000100:00100000:0.0:1746143767.617258:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:1962:x1830963594309888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.617268:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.617286:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd7307ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f73 expref: 38 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.617313:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.617317:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.617337:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:1962:x1830963594309888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.617343:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 742 00000100:00100000:2.0:1746143767.617412:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.617500:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594309760 00000100:00100000:1.0:1746143767.617504:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594309760 00010000:00010000:1.0:1746143767.617523:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 29 pid: 6929 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.617540:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7328 00000100:00100000:1.0:1746143767.617545:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594309760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.617553:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.617746:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 29 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.617756:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 29 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.617768:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5a00/0xe984082ccd7307ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f6c expref: 29 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.617822:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.617824:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.617830:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.617837:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.617861:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 28 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.617875:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594400000:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143767.618261:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.621093:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.621234:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594400000:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143767.621251:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.621297:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594309760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3750us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.621305:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7328 00000100:00100000:1.0:1746143767.621378:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594310144 00000100:00100000:1.0:1746143767.621383:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594310144 00002000:00100000:1.0:1746143767.621414:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1933312->1937407) req@ffff880094c11500 x1830963594310144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.621422:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963594310144 ext(1933312->1937407) 00002000:00010000:1.0:1746143767.621426:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c11500 00000100:00100000:1.0:1746143767.621438:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6464 00000100:00100000:1.0:1746143767.621443:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594310144:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143767.621547:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594310144:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 103us (461us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143767.621551:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6464 00002000:00100000:1.0:1746143767.621555:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1933312->1937407) req@ffff880094c11500 x1830963594310144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.621561:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11500 with x1830963594310144 ext(1933312->1937407) 00002000:00010000:1.0:1746143767.621563:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c11500 00000100:00100000:0.0:1746143767.622791:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.622828:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.622854:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594310528 00000100:00100000:0.0:1746143767.622858:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594310528 00000100:00100000:0.0:1746143767.622880:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9245 00000100:00100000:0.0:1746143767.622885:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+37:31488:x1830963594310528:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143767.622898:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.622915:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009beace00/0xe984082ccd7307fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f88 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.623322:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594310272 00010000:00010000:0.0:1746143767.623375:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623386:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623396:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143767.623398:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594310272 00010000:00010000:0.0:1746143767.623406:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623411:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623416:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143767.623417:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13658 00000100:00100000:3.0:1746143767.623421:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31483:x1830963594310272:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143767.623429:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.623437:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f81 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.623451:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.623458:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 38 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.623464:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.623465:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.623468:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1425408->1585151] (req 1425408->1585151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.623489:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 38 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.623499:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 38 pid: 12618 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746143767.623506:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead800/0xe984082ccd730817 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143767.623509:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594400128:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143767.623513:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead800/0xe984082ccd730817 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623518:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead800/0xe984082ccd730817 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:0.0:1746143767.623528:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143767.623559:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 25 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.623565:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 25 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.623572:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594400256:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.623587:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143767.623592:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623598:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623602:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623607:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bead000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143767.623611:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623616:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623625:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143767.623628:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143767.623631:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623635:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead000/0xe984082ccd730802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623653:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623658:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623662:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623669:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bead400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143767.623671:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623676:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623682:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1ff500) 00010000:00010000:0.0:1746143767.623684:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143767.623686:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623691:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead400/0xe984082ccd730809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.623723:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009beace00/0xe984082ccd7307fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f88 expref: 40 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.623732:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead800/0xe984082ccd730817 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f88 expref: 39 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.623738:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.623740:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143767.623742:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bead800, rc 0) 00000100:00100000:0.0:1746143767.623763:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:31488:x1830963594310528:12345-192.168.202.48@tcp:101:cat.0 Request processed in 878us (935us total) trans 8589943588 rc 0/0 00000100:00100000:0.0:1746143767.623769:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9245 00000100:00100000:0.0:1746143767.632946:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.633026:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.633069:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594310784 00000100:00100000:2.0:1746143767.633077:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594310784 00002000:00100000:2.0:1746143767.633119:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (2023424->2027519) req@ffff880094c13480 x1830963594310784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.633129:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13480 with x1830963594310784 ext(2023424->2027519) 00002000:00010000:2.0:1746143767.633133:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13480 00000100:00100000:2.0:1746143767.633192:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6465 00000100:00100000:2.0:1746143767.633199:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594310784:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143767.633345:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.633372:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594310912 00000100:00100000:1.0:1746143767.633374:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594311040 00000100:00100000:0.0:1746143767.633374:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594310912 00000100:00100000:1.0:1746143767.633378:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594311040 00010000:00010000:1.0:1746143767.633394:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 39 pid: 12618 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746143767.633399:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 743 00000100:00100000:0.0:1746143767.633404:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:1963:x1830963594310912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.633411:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143767.633416:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7329 00000100:00100000:1.0:1746143767.633422:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594311040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.633428:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.633429:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bead800/0xe984082ccd730817 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f88 expref: 39 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.633443:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 39 pid: 12618 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746143767.633444:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.633448:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143767.633452:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 39 pid: 12618 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.633465:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.633482:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594311040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.633482:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:1963:x1830963594310912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 77us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.633487:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 743 00000100:00100000:2.0:1746143767.633841:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594310784:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 642us (903us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143767.633846:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6465 00002000:00100000:2.0:1746143767.633851:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (2023424->2027519) req@ffff880094c13480 x1830963594310784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143767.633855:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7329 00002000:00100000:2.0:1746143767.633857:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13480 with x1830963594310784 ext(2023424->2027519) 00002000:00010000:2.0:1746143767.633859:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c13480 00010000:00010000:3.0:1746143767.634370:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c58e600/0xe984082ccd7306b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eaf expref: 38 pid: 12618 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.634394:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594400128:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.634406:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594400256:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.634426:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1425408->1585151] (req 1425408->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.634435:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed03400, rc 0) 00000100:00100000:3.0:1746143767.634454:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31483:x1830963594310272:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11032us (11665us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.634464:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13658 00000100:00100000:0.0:1746143767.634921:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.634947:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.634968:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.634982:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594311168 00000100:00100000:0.0:1746143767.634986:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594311168 00000100:00100000:0.0:1746143767.635004:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13659 00000100:00100000:0.0:1746143767.635009:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594311168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143767.635017:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.635027:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bead400/0xe984082ccd730825 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f8f expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.635060:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594400384:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143767.635179:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594311424 00000100:00100000:3.0:1746143767.635183:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594311424 00000100:00100000:2.0:1746143767.635196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.635208:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594311552 00000100:00100000:3.0:1746143767.635210:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594311552 00000100:00100000:3.0:1746143767.635225:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13660 00000100:00100000:3.0:1746143767.635230:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594311424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.635237:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143767.635239:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13661 00010000:00010000:3.0:1746143767.635245:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed03000/0xe984082ccd73082c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f96 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.635247:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594311552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143767.635254:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.635260:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c24fc00/0xe984082ccd730833 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7f9d expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.635266:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594400512:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143767.635271:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.635276:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c24fc00/0xe984082ccd730833 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f9d expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.635284:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c24fc00/0xe984082ccd730833 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f9d expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143767.635456:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.635483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.635495:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594311680 00000100:00100000:2.0:1746143767.635497:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594311680 00000100:00100000:2.0:1746143767.635517:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13662 00000100:00100000:2.0:1746143767.635521:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594311680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143767.635604:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c24fc00, rc 0) 00000100:00100000:1.0:1746143767.635622:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594311552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 377us (427us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143767.635627:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13661 00000100:00100000:1.0:1746143767.635645:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594311296 00000100:00100000:1.0:1746143767.635648:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594311296 00010000:00010000:1.0:1746143767.635658:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 27 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746143767.635883:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32000 going to sleep for 11 seconds 00010000:00010000:2.0:1746143767.635994:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.636118:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd73083a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fa4 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.636129:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7330 00000100:00100000:1.0:1746143767.636154:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594311296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.636161:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.636188:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 27 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.636197:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 27 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.636211:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800900e4000/0xe984082ccd73067a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7e7e expref: 27 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746143767.637905:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594400384:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143767.637925:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bead400/0xe984082ccd730825 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f8f expref: 31 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.637935:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bead400/0xe984082ccd730825 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f8f expref: 31 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.637943:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bead400, rc 0) 00000100:00100000:3.0:1746143767.637957:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594400512:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143767.637972:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594311168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2962us (3024us total) trans 0 rc 301/301 00010000:00010000:3.0:1746143767.637973:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed03000/0xe984082ccd73082c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f96 expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143767.637978:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13659 00010000:00010000:3.0:1746143767.637982:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed03000/0xe984082ccd73082c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f96 expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.637989:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed03000, rc 0) 00000100:00100000:3.0:1746143767.638005:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594311424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2775us (3036us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143767.638011:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13660 00000100:00100000:2.0:1746143767.638114:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594400640:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143767.638254:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00010000:00010000:1.0:1746143767.638315:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.638317:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.638323:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.638330:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.638356:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.638363:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594400768:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143767.638388:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.643119:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f0adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594400768:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143767.643161:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.643210:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594311296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7072us (8289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.643214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.643219:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7330 00000100:00100000:2.0:1746143767.643266:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594400640:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143767.643288:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd73083a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fa4 expref: 29 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.643301:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5400/0xe984082ccd73083a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fa4 expref: 29 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143767.643343:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594311936 00000100:00100000:3.0:1746143767.643349:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594311936 00002000:00100000:3.0:1746143767.643375:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1425408->1429503) req@ffff880094c11880 x1830963594311936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.643383:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963594311936 ext(1425408->1429503) 00002000:00010000:3.0:1746143767.643387:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11880 00010000:00010000:2.0:1746143767.643398:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5400, rc 0) 00000100:00100000:3.0:1746143767.643399:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6466 00000100:00100000:3.0:1746143767.643404:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594311936:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143767.643425:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594311680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7902us (7942us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143767.643430:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13662 00000100:00100000:3.0:1746143767.643508:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594311936:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 104us (295us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143767.643514:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6466 00002000:00100000:3.0:1746143767.643518:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1425408->1429503) req@ffff880094c11880 x1830963594311936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.643525:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c11880 with x1830963594311936 ext(1425408->1429503) 00002000:00010000:3.0:1746143767.643528:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c11880 00000100:00100000:0.0:1746143767.645577:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.646303:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594312064 00000100:00100000:2.0:1746143767.646310:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594312064 00000100:00100000:2.0:1746143767.646350:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13663 00000100:00100000:2.0:1746143767.646355:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31488:x1830963594312064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.646370:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.646384:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fab expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.646411:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.646418:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.646419:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.646422:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.646450:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.646460:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 27 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.646470:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594400896:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.646540:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.646617:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.646697:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594312320 00000100:00100000:2.0:1746143767.646700:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594312320 00002000:00100000:2.0:1746143767.646722:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1581056->1585151) req@ffff88008f0adc00 x1830963594312320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.646729:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adc00 with x1830963594312320 ext(1581056->1585151) 00002000:00010000:2.0:1746143767.646733:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adc00 00000100:00100000:2.0:1746143767.646745:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6467 00000100:00100000:2.0:1746143767.646750:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594312320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143767.646861:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594312320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 110us (244us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143767.646867:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6467 00002000:00100000:2.0:1746143767.646872:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1581056->1585151) req@ffff88008f0adc00 x1830963594312320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.646878:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0adc00 with x1830963594312320 ext(1581056->1585151) 00002000:00010000:2.0:1746143767.646881:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0adc00 00000100:00100000:2.0:1746143767.648956:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594400896:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.648978:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.648993:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde4c00, rc 0) 00000100:00100000:2.0:1746143767.649042:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31488:x1830963594312064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2686us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.649049:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13663 00000100:00100000:0.0:1746143767.649622:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.649659:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.649668:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594312704 00000100:00100000:2.0:1746143767.649673:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594312704 00000100:00100000:2.0:1746143767.649699:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3984 00000100:00100000:2.0:1746143767.649704:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:31483:x1830963594312704:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143767.649713:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594312576 00000100:00100000:1.0:1746143767.649717:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594312576 00000100:00100000:2.0:1746143767.649865:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:31483:x1830963594312704:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 160us (243us total) trans 8589943589 rc 0/0 00000100:00100000:2.0:1746143767.649871:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3984 00002000:00100000:1.0:1746143767.649921:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (831488->1048575) req@ffff880094c13b80 x1830963594312576/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.649930:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13b80 with x1830963594312576 ext(831488->1048575) 00010000:00010000:1.0:1746143767.649936:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 28 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.649946:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 28 pid: 4582 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.649952:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c13b80 00000100:00100000:1.0:1746143767.649969:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1828 00000100:00100000:1.0:1746143767.649975:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594312576:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143767.656809:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594312576:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 6826us (7141us total) trans 21474840471 rc 0/0 00000100:00100000:1.0:1746143767.656819:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1828 00002000:00100000:1.0:1746143767.656828:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (831488->1048575) req@ffff880094c13b80 x1830963594312576/t21474840471(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.656838:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c13b80 with x1830963594312576 ext(831488->1048575) 00010000:00010000:1.0:1746143767.656846:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.656858:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.656864:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094c13b80 00000100:00100000:0.0:1746143767.659852:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.659930:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594312832 00000100:00100000:1.0:1746143767.659937:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594312832 00010000:00010000:1.0:1746143767.659965:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.659996:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7331 00000100:00100000:1.0:1746143767.660003:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594312832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.660015:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.660034:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.660049:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.660067:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4200/0xe984082ccd730761 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 831488->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f1f expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.660098:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.660100:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.660106:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.660113:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.660174:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.660186:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594401024:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143767.660651:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.665401:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.665469:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.665526:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594312960 00000100:00100000:3.0:1746143767.665533:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594312960 00000100:00100000:3.0:1746143767.665580:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 225 00000100:00100000:3.0:1746143767.665588:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1965:x1830963594312960:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143767.665637:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1965:x1830963594312960:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.665643:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 225 00000100:00100000:0.0:1746143767.665815:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.665832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.665845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.665906:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594313216 00000100:00100000:2.0:1746143767.665910:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594313216 00000100:00100000:2.0:1746143767.665932:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594313088 00000100:00100000:2.0:1746143767.665934:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594313088 00000100:00100000:2.0:1746143767.665946:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 235 00000100:00100000:2.0:1746143767.665950:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594313216:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1746143767.665983:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594313216:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.665988:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 235 00000100:00100000:2.0:1746143767.665997:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 236 00000100:00100000:2.0:1746143767.666001:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1965:x1830963594313088:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:2.0:1746143767.666019:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1965:x1830963594313088:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 18us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.666024:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 236 00000100:00100000:3.0:1746143767.666157:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594313472 00000100:00100000:3.0:1746143767.666161:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594313472 00000100:00100000:3.0:1746143767.666563:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594313344 00000100:00100000:3.0:1746143767.666566:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594313344 00000100:00100000:3.0:1746143767.666593:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 388 00000100:00100000:3.0:1746143767.666598:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594313472:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143767.666624:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594313472:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 26us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.666629:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 388 00000100:00100000:3.0:1746143767.666638:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 389 00000100:00100000:3.0:1746143767.666642:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594313344:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143767.666659:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594313344:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 17us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.666663:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 389 00000100:00100000:0.0:1746143767.666944:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.667094:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594401024:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143767.667111:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.667159:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594312832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7156us (7312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.667177:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7331 00000100:00100000:1.0:1746143767.667197:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594313728 00000100:00100000:1.0:1746143767.667200:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594313728 00002000:00100000:1.0:1746143767.667221:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012fc10700 x1830963594313728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.667230:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10700 with x1830963594313728 ext(0->1048575) 00002000:00010000:1.0:1746143767.667233:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10700 00000100:00100000:1.0:1746143767.667254:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6468 00000100:00100000:1.0:1746143767.667258:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594313728:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.675029:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594313728:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7761us (8080us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.675040:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6468 00002000:00100000:1.0:1746143767.675050:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012fc10700 x1830963594313728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.675058:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10700 with x1830963594313728 ext(0->1048575) 00002000:00010000:1.0:1746143767.675064:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc10700 00000100:00100000:0.0:1746143767.682495:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.682721:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594313856 00000100:00100000:1.0:1746143767.682728:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594313856 00000100:00100000:1.0:1746143767.682773:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13664 00000100:00100000:1.0:1746143767.682780:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31488:x1830963594313856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143767.682794:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.682807:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fb2 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.682830:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 37 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.682841:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143767.682842:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143767.682845:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 25 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.682867:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 37 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.682875:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 37 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.682885:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594401152:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143767.683323:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.684555:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594401152:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143767.684576:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 25 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.684588:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c24ea00, rc 0) 00000100:00100000:1.0:1746143767.684615:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31488:x1830963594313856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1835us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.684621:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13664 00000100:00100000:0.0:1746143767.685339:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.685582:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594313984 00000100:00100000:1.0:1746143767.685587:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594313984 00002000:00100000:1.0:1746143767.685617:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1810431) req@ffff88012fc11880 x1830963594313984/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.685631:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11880 with x1830963594313984 ext(1048576->1810431) 00010000:00010000:1.0:1746143767.685639:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 38 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.685650:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 38 pid: 4582 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.685656:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc11880 00000100:00100000:1.0:1746143767.686314:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1829 00000100:00100000:1.0:1746143767.686321:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594313984:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143767.700702:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594313984:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 14373us (15356us total) trans 17179873147 rc 0/0 00000100:00100000:1.0:1746143767.700712:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1829 00002000:00100000:1.0:1746143767.700722:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1810431) req@ffff88012fc11880 x1830963594313984/t17179873147(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.700729:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11880 with x1830963594313984 ext(1048576->1810431) 00010000:00010000:1.0:1746143767.700737:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.700750:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.700756:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fc11880 00000100:00100000:0.0:1746143767.705398:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.705499:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594314112 00000100:00100000:1.0:1746143767.705507:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594314112 00010000:00010000:1.0:1746143767.705537:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.705563:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7332 00000100:00100000:1.0:1746143767.705570:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594314112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.705582:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.705599:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.705608:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.705625:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bde5600/0xe984082ccd73078b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1810431) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f2d expref: 40 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.705777:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.705779:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.705786:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 24 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.705793:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 24 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.705822:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 24 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.705831:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594401280:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143767.705998:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.707593:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594401280:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143767.707610:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.707636:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594314112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2066us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.707644:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7332 00000100:00100000:2.0:1746143767.712084:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.712121:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.712158:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.712261:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.712281:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594314752 00000100:00100000:2.0:1746143767.712287:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594314752 00000100:00100000:2.0:1746143767.712318:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594314880 00000100:00100000:2.0:1746143767.712320:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594314880 00000100:00100000:2.0:1746143767.712347:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13665 00000100:00100000:2.0:1746143767.712353:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594314752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.712369:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.712383:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fb9 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.712403:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.712405:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.712413:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.712428:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.712438:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792200, rc 0) 00000100:00100000:2.0:1746143767.712479:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594314752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 120us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.712486:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13665 00000100:00100000:2.0:1746143767.712500:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13666 00000100:00100000:2.0:1746143767.712505:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594314880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.712512:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.712520:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fc0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.712531:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.712532:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.712536:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.712545:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.712551:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792400, rc 0) 00000100:00100000:2.0:1746143767.712566:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594314880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 61us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.712571:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13666 00000100:00100000:2.0:1746143767.712586:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594314496 00000100:00100000:2.0:1746143767.712589:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594314496 00002000:00100000:2.0:1746143767.712608:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009bfe1c00 x1830963594314496/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 504/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.712617:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963594314496 ext(1048576->2097151) 00002000:00010000:2.0:1746143767.712621:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:2.0:1746143767.712632:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594314368 00000100:00100000:2.0:1746143767.712634:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594314368 00002000:00100000:2.0:1746143767.712643:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009bfe2300 x1830963594314368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.712649:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2300 with x1830963594314368 ext(1048576->2097151) 00002000:00010000:2.0:1746143767.712651:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2300 00000100:00100000:2.0:1746143767.712666:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6469 00000100:00100000:2.0:1746143767.712670:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594314496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.713328:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6470 00000100:00100000:1.0:1746143767.713337:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594314368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143767.717535:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.717560:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594315008 00000100:00100000:0.0:1746143767.717567:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594315008 00000100:00100000:0.0:1746143767.717604:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13667 00000100:00100000:0.0:1746143767.717611:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594315008:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143767.717626:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.717640:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009beada00/0xe984082ccd73085d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fc7 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.717682:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594401408:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143767.717754:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32000 going to sleep for 11 seconds 00002000:00010000:1.0:1746143767.719604:0:8496:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143765 -> 1746143767 00002000:00010000:1.0:1746143767.719610:0:8496:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143765 -> 1746143767 00002000:00010000:1.0:1746143767.719611:0:8496:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143765 -> 1746143767 00000100:00100000:1.0:1746143767.719625:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594401408:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143767.719648:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009beada00/0xe984082ccd73085d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc7 expref: 41 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.719660:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009beada00/0xe984082ccd73085d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc7 expref: 41 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.719687:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beada00, rc 0) 00000100:00100000:1.0:1746143767.719725:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594315008:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2113us (2198us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143767.719732:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13667 00000100:00100000:1.0:1746143767.725560:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594314368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12217us (13430us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.725570:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6470 00002000:00100000:1.0:1746143767.725719:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009bfe2300 x1830963594314368/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.725729:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2300 with x1830963594314368 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.725734:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2300 00000100:00100000:0.0:1746143767.729069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.729216:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594314496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16536us (17130us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746143767.729226:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6469 00002000:00100000:2.0:1746143767.729235:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009bfe1c00 x1830963594314496/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 504/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.729244:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1c00 with x1830963594314496 ext(1048576->2097151) 00002000:00010000:2.0:1746143767.729248:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1c00 00000100:00100000:0.0:1746143767.729725:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.729886:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594315264 00000100:00100000:2.0:1746143767.729892:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594315264 00002000:00100000:2.0:1746143767.729920:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012fc12680 x1830963594315264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143767.729927:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963594315264 ext(0->1048575) 00002000:00010000:2.0:1746143767.729930:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc12680 00000100:00100000:1.0:1746143767.730772:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594315520 00000100:00100000:1.0:1746143767.730777:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594315520 00002000:00100000:1.0:1746143767.730799:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012fc10e00 x1830963594315520/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.730806:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10e00 with x1830963594315520 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.730810:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc10e00 00000100:00100000:1.0:1746143767.730832:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6471 00000100:00100000:1.0:1746143767.730839:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594315264:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.732081:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6472 00000100:00100000:1.0:1746143767.732089:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594315520:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143767.742331:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.742736:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594315648 00000100:00100000:3.0:1746143767.742744:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594315648 00000100:00100000:3.0:1746143767.742785:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13668 00000100:00100000:3.0:1746143767.742791:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31488:x1830963594315648:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.742805:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.742817:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fce expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.742838:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.742845:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143767.742847:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143767.742850:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 30 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.742878:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 31 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.742887:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 31 pid: 6929 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.742896:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594401536:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.742958:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143767.743789:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594315264:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12949us (14726us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.743798:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6471 00002000:00100000:1.0:1746143767.743806:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012fc12680 x1830963594315264/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.743813:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc12680 with x1830963594315264 ext(0->1048575) 00002000:00010000:1.0:1746143767.743817:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc12680 00000100:00100000:1.0:1746143767.747489:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594315520:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15393us (17756us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.747503:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6472 00002000:00100000:1.0:1746143767.747513:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012fc10e00 x1830963594315520/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.747521:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc10e00 with x1830963594315520 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.747526:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc10e00 00000100:00100000:2.0:1746143767.748038:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594401536:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.748060:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 30 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.748074:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800900e4400, rc 0) 00000100:00100000:2.0:1746143767.748501:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:31488:x1830963594315648:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5708us (6175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.748508:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13668 00000100:00100000:0.0:1746143767.749911:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.750170:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594315776 00000100:00100000:1.0:1746143767.750178:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594315776 00002000:00100000:1.0:1746143767.750215:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1933312->2027519) req@ffff88009b852d80 x1830963594315776/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.750223:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963594315776 ext(1933312->2027519) 00010000:00010000:1.0:1746143767.750231:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 30 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.750243:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 30 pid: 6929 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.750250:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b852d80 00000100:00100000:1.0:1746143767.750278:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1830 00000100:00100000:1.0:1746143767.750284:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594315776:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143767.757063:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594315776:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6771us (7147us total) trans 21474840472 rc 0/0 00000100:00100000:1.0:1746143767.757076:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1830 00002000:00100000:1.0:1746143767.757086:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1933312->2027519) req@ffff88009b852d80 x1830963594315776/t21474840472(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.757100:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b852d80 with x1830963594315776 ext(1933312->2027519) 00010000:00010000:1.0:1746143767.757109:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 32 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.757123:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 32 pid: 6929 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.757129:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b852d80 00000100:00100000:0.0:1746143767.758465:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.758534:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594315904 00000100:00100000:2.0:1746143767.758540:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594315904 00000100:00100000:2.0:1746143767.758566:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13669 00000100:00100000:2.0:1746143767.758571:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:31493:x1830963594315904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.758584:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.758597:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fd5 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.758623:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.758630:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.758632:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143767.758635:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 41 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.758657:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.758667:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 24 pid: 6929 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.758676:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594401664:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.758747:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.759268:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.759329:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594316032 00000100:00100000:1.0:1746143767.759333:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594316032 00010000:00010000:1.0:1746143767.759349:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 32 pid: 6929 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.759371:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7333 00000100:00100000:1.0:1746143767.759377:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594316032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.759384:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.759400:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 32 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.759407:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 32 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.759420:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009beac200/0xe984082ccd7307d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1933312->2027519) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f7a expref: 32 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.759441:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.759444:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.759449:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 29 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.759455:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 29 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.759473:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 29 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.759482:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594401792:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143767.759524:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.760228:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594401664:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.760245:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 41 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.760254:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792c00, rc 0) 00000100:00100000:2.0:1746143767.760278:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:31493:x1830963594315904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1706us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.760285:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13669 00000100:00100000:0.0:1746143767.760552:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.760596:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594316160 00000100:00100000:1.0:1746143767.760600:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594316160 00002000:00100000:1.0:1746143767.760622:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1425408->1585151) req@ffff88009b850a80 x1830963594316160/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.760630:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850a80 with x1830963594316160 ext(1425408->1585151) 00010000:00010000:1.0:1746143767.760634:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 25 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.760642:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 25 pid: 6929 timeout: 946 lvb_type: 0 00002000:00010000:1.0:1746143767.760647:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b850a80 00000100:00100000:1.0:1746143767.760671:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1831 00000100:00100000:1.0:1746143767.760677:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594316160:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143767.760744:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594401792:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143767.760754:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.760850:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594316032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1472us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.760855:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7333 00000100:00100000:0.0:1746143767.763336:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594316160:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2654us (2779us total) trans 17179873148 rc 0/0 00000100:00100000:0.0:1746143767.763344:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1831 00002000:00100000:0.0:1746143767.763352:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1425408->1585151) req@ffff88009b850a80 x1830963594316160/t17179873148(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/448 e 0 to 0 dl 1746143778 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143767.763360:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850a80 with x1830963594316160 ext(1425408->1585151) 00010000:00010000:0.0:1746143767.763368:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 27 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.763380:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 27 pid: 6929 timeout: 946 lvb_type: 0 00002000:00010000:0.0:1746143767.763386:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b850a80 00000100:00100000:0.0:1746143767.763502:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.763710:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594316416 00000100:00100000:1.0:1746143767.763716:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594316416 00002000:00100000:1.0:1746143767.763738:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009b850380 x1830963594316416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.763745:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850380 with x1830963594316416 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.763748:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850380 00000100:00100000:1.0:1746143767.763776:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6473 00000100:00100000:1.0:1746143767.763782:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594316416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143767.768863:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.768927:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594316544 00000100:00100000:2.0:1746143767.768935:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594316544 00010000:00010000:2.0:1746143767.768968:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 27 pid: 6929 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.769010:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7334 00000100:00100000:2.0:1746143767.769017:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594316544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143767.769028:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143767.769048:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 27 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.769059:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 27 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.769083:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed03400/0xe984082ccd730810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1425408->1585151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f81 expref: 27 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.769121:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.769123:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.769128:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.769136:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.769192:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.769202:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594401920:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143767.769272:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.770522:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594401920:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143767.770535:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.770618:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594316544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1601us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.770625:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7334 00000100:00100000:1.0:1746143767.772272:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594316416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8486us (8766us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.772282:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6473 00002000:00100000:1.0:1746143767.772290:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009b850380 x1830963594316416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.772299:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b850380 with x1830963594316416 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.772304:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b850380 00000100:00100000:0.0:1746143767.773378:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.773461:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594316800 00000100:00100000:1.0:1746143767.773467:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594316800 00002000:00100000:1.0:1746143767.773497:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094305c00 x1830963594316800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.773505:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830963594316800 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.773508:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:1.0:1746143767.773574:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6474 00000100:00100000:1.0:1746143767.773581:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594316800:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:2.0:1746143767.780697:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143767.782992:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594316800:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9404us (9609us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.783004:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6474 00002000:00100000:1.0:1746143767.783014:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094305c00 x1830963594316800/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.783022:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830963594316800 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.783027:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:0.0:1746143767.787999:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.788540:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.788626:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594316928 00000100:00100000:1.0:1746143767.788633:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594316928 00000100:00100000:1.0:1746143767.788870:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594317056 00000100:00100000:1.0:1746143767.788873:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594317056 00000100:00100000:2.0:1746143767.788939:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13670 00000100:00100000:2.0:1746143767.788948:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594316928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.788963:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.788978:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fdc expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.788997:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.788999:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.789006:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.789018:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.789027:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792a00, rc 0) 00000100:00100000:2.0:1746143767.789074:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594316928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 127us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.789080:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13670 00000100:00100000:2.0:1746143767.789094:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13671 00000100:00100000:2.0:1746143767.789099:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31493:x1830963594317056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143767.789105:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.789113:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fe3 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.789124:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.789125:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.789128:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 32 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.789137:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 32 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.789173:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792e00, rc 0) 00000100:00100000:2.0:1746143767.789189:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31493:x1830963594317056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 90us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.789194:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13671 00000100:00100000:0.0:1746143767.793349:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.793407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.793494:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594317312 00000100:00100000:1.0:1746143767.793501:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594317312 00002000:00100000:1.0:1746143767.793536:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093f03100 x1830963594317312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.793544:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03100 with x1830963594317312 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.793548:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f03100 00000100:00100000:2.0:1746143767.793733:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594317568 00000100:00100000:2.0:1746143767.793737:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594317568 00000100:00100000:2.0:1746143767.793763:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3985 00000100:00100000:2.0:1746143767.793769:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:31488:x1830963594317568:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143767.794795:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+40:31488:x1830963594317568:12345-192.168.202.48@tcp:35:cat.0 Request processed in 1023us (1385us total) trans 8589943590 rc 0/0 00000100:00100000:2.0:1746143767.794802:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3985 00000100:00100000:1.0:1746143767.794840:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6475 00000100:00100000:1.0:1746143767.794852:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594317312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.807720:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594317312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12866us (14371us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.807730:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6475 00002000:00100000:1.0:1746143767.807740:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093f03100 x1830963594317312/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.807748:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f03100 with x1830963594317312 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.807752:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f03100 00000100:00100000:0.0:1746143767.827010:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.827575:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594317696 00000100:00100000:3.0:1746143767.827582:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594317696 00000100:00100000:3.0:1746143767.827645:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9246 00000100:00100000:3.0:1746143767.827652:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:31496:x1830963594317696:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143767.827666:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.827683:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fea expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.827735:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827744:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827752:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827761:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827768:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827772:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827868:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827877:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 258 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.827883:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.827909:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 258 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.827918:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 258 pid: 2976 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.827928:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594402048:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.828015:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.829233:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594402048:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.829247:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143767.829698:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.829926:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594317952 00000100:00100000:2.0:1746143767.829932:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594317952 00000100:00100000:2.0:1746143767.829972:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3986 00000100:00100000:2.0:1746143767.829978:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:26913:x1830963594317952:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143767.830180:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:26913:x1830963594317952:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 200us (481us total) trans 8589943591 rc 0/0 00000100:00100000:2.0:1746143767.830186:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3986 00000100:00100000:0.0:1746143767.833260:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.833377:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594318080 00000100:00100000:2.0:1746143767.833384:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594318080 00010000:00010000:2.0:1746143767.833414:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 260 pid: 2976 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.833455:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7335 00000100:00100000:2.0:1746143767.833462:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1965:x1830963594318080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143767.833475:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143767.833481:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 260 pid: 2976 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.833491:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 260 pid: 2976 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.833508:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a7fc00/0xe984082ccd7306c7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ec4 expref: 260 pid: 2976 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.833521:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143767.833525:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143767.833532:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143767.833537:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143767.833566:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.833598:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1965:x1830963594318080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 136us (345us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143767.833599:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:2.0:1746143767.833604:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7335 00010000:00010000:3.0:1746143767.833608:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143767.833646:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143767.833651:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143767.833664:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833673:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833681:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833685:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833690:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833695:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed03600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143767.833699:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833705:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833712:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143767.833714:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143767.833716:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833720:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833735:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833739:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833743:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833747:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed02000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143767.833749:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833753:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833758:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f442b00) 00010000:00010000:3.0:1746143767.833760:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143767.833762:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833766:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd73088e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.833795:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03800/0xe984082ccd730880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.833804:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 15 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.833810:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.833812:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143767.833814:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed02600, rc 0) 00000100:00100000:3.0:1746143767.833839:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31496:x1830963594317696:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 6188us (6836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.833845:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9246 00000100:00100000:0.0:1746143767.836866:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.836901:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.837611:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.837639:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594318208 00000100:00100000:2.0:1746143767.837647:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594318208 00000100:00100000:3.0:1746143767.837662:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594318336 00000100:00100000:3.0:1746143767.837665:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594318336 00000100:00100000:2.0:1746143767.837684:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13672 00000100:00100000:3.0:1746143767.837694:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13673 00000100:00100000:3.0:1746143767.837700:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594318336:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143767.837709:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594318208:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143767.837715:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.837719:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.837729:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ff8 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.837729:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7ff1 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.837745:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.837745:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.837747:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.837747:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.837754:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.837755:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.837765:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.837766:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.837774:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed02c00, rc 0) 00010000:00010000:2.0:1746143767.837774:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793600, rc 0) 00000100:00100000:2.0:1746143767.837831:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594318464 00000100:00100000:2.0:1746143767.837834:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594318464 00000100:00100000:2.0:1746143767.837849:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13674 00000100:00100000:2.0:1746143767.837853:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594318464:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143767.837859:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.837865:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a7fff expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.837874:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.837875:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.837879:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143767.837885:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143767.837887:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.837899:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793a00, rc 0) 00000100:00100000:0.0:1746143767.837900:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.837921:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594318464:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.837926:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13674 00000100:00100000:0.0:1746143767.837926:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.837938:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594318592 00000100:00100000:2.0:1746143767.837940:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594318592 00000100:00100000:2.0:1746143767.837958:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594318720 00000100:00100000:2.0:1746143767.837960:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594318720 00000100:00100000:2.0:1746143767.837970:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594318848 00000100:00100000:2.0:1746143767.837971:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594318848 00000100:00100000:2.0:1746143767.837981:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13675 00000100:00100000:2.0:1746143767.837986:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594318592:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143767.837991:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.837997:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8006 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.838005:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13676 00010000:00010000:2.0:1746143767.838006:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.838007:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.838011:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143767.838011:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594318720:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143767.838018:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.838019:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.838024:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a800d expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.838025:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793400, rc 0) 00010000:00010000:0.0:1746143767.838033:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.838034:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.838038:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143767.838044:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594318592:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 58us (159us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143767.838047:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143767.838050:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13675 00010000:00010000:0.0:1746143767.838053:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009beada00, rc 0) 00000100:00100000:2.0:1746143767.838058:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13677 00000100:00100000:2.0:1746143767.838062:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594318848:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143767.838067:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143767.838069:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594318720:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 59us (169us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143767.838072:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8014 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.838074:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13676 00010000:00010000:2.0:1746143767.838081:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.838082:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.838086:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.838093:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.838099:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793800, rc 0) 00000100:00100000:2.0:1746143767.838112:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594318848:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.838117:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13677 00000100:00100000:2.0:1746143767.838135:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594318208:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 444us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.838156:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13672 00000100:00100000:3.0:1746143767.840269:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594318336:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 2559us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.840277:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13673 00000100:00100000:0.0:1746143767.842633:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.842693:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594319104 00000100:00100000:3.0:1746143767.842700:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594319104 00000100:00100000:3.0:1746143767.842752:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9247 00000100:00100000:3.0:1746143767.842759:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:31496:x1830963594319104:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143767.842780:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.842794:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03c00/0xe984082ccd7308c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a801b expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.842875:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.842888:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.842893:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.842923:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.842933:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 16 pid: 20509 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.842942:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594402176:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.843028:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.844388:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594402176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.844402:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143767.844662:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.844808:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594319232 00000100:00100000:1.0:1746143767.844813:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594319232 00010000:00010000:1.0:1746143767.844831:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 17 pid: 20509 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.844967:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7336 00000100:00100000:1.0:1746143767.844974:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:1964:x1830963594319232:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.844983:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.844987:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 17 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.844996:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 17 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.845108:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02600/0xe984082ccd730895 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fea expref: 17 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.846348:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143767.846359:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.846369:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.846376:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.846407:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.846442:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1964:x1830963594319232:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1468us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.846451:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7336 00010000:00010000:2.0:1746143767.846771:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143767.846778:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:2.0:1746143767.846795:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143767.846913:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03c00/0xe984082ccd7308c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a801b expref: 17 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.846926:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a801b expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.846931:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143767.846933:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143767.846935:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed03e00, rc 0) 00000100:00100000:2.0:1746143767.846964:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31496:x1830963594319104:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4206us (4338us total) trans 8589943592 rc 0/0 00000100:00100000:2.0:1746143767.846970:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9247 00000100:00100000:2.0:1746143767.849626:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.850407:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594319488 00000100:00100000:0.0:1746143767.850414:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594319488 00000100:00100000:0.0:1746143767.850459:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9248 00000100:00100000:0.0:1746143767.850466:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:31496:x1830963594319488:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143767.850484:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.850486:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143767.850507:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03e00/0xe984082ccd7308cd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a801b expref: 16 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.851484:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.851490:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143767.852236:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8600/0xe984082ccd7308db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8022 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.852544:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8000/0xe984082ccd7308e2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.852555:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8000/0xe984082ccd7308e2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.852564:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8000/0xe984082ccd7308e2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143767.852576:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143767.852887:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8600/0xe984082ccd7308db lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8022 expref: 18 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.853347:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8000/0xe984082ccd7308e2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8022 expref: 17 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.853354:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143767.853356:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143767.853358:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f8000, rc 0) 00000100:00100000:1.0:1746143767.853476:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:31496:x1830963594319488:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 3008us (3853us total) trans 8589943593 rc 0/0 00000100:00100000:1.0:1746143767.853483:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9248 00000100:00100000:0.0:1746143767.860282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.861082:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594319616 00000100:00100000:1.0:1746143767.861091:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594319616 00000100:00100000:1.0:1746143767.861187:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9249 00000100:00100000:1.0:1746143767.861195:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:31496:x1830963594319616:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143767.861219:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.861233:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8400/0xe984082ccd7308f0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8029 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.861282:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8400/0xe984082ccd7308f0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8029 expref: 18 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.861295:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8400/0xe984082ccd7308f0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8029 expref: 18 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.861310:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143767.861312:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143767.861316:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f8f8400, rc 0) 00000100:00100000:1.0:1746143767.861368:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:31496:x1830963594319616:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 174us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.861373:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9249 00000100:00100000:0.0:1746143767.863797:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.863833:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.863864:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.863889:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594319744 00000100:00100000:0.0:1746143767.863890:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.863896:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594319744 00000100:00100000:0.0:1746143767.863911:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.863928:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320000 00000100:00100000:2.0:1746143767.863930:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320000 00000100:00100000:0.0:1746143767.863933:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.863942:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320256 00000100:00100000:2.0:1746143767.863943:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320256 00000100:00100000:2.0:1746143767.863951:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594319872 00000100:00100000:2.0:1746143767.863953:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594319872 00000100:00100000:2.0:1746143767.863961:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320128 00000100:00100000:2.0:1746143767.863962:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320128 00000100:00100000:0.0:1746143767.863967:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320384 00000100:00100000:0.0:1746143767.863970:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320384 00000100:00100000:2.0:1746143767.863975:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13678 00000100:00100000:2.0:1746143767.863981:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594319744:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:0.0:1746143767.863990:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13679 00000100:00100000:0.0:1746143767.863995:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594320000:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143767.864014:0:2839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864014:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864029:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.864030:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.864037:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 13 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.864037:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.864043:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 26 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.864044:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.864048:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.864049:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.864049:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.864050:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.864051:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.864052:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.864073:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 31 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.864073:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 26 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.864083:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 26 pid: 8496 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.864084:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 31 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.864094:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594402304:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.864097:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594402432:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143767.864174:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13680 00000100:00100000:1.0:1746143767.864182:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594320256:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143767.864201:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.864210:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.864216:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.864226:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 31 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.864231:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.864232:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.864234:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.864247:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 31 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.864254:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 31 pid: 9527 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.864261:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13681 00000100:00100000:1.0:1746143767.864261:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594402560:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.864268:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594319872:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143767.864287:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.864297:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 26 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.864304:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.864309:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.864313:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.864315:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.864316:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.864333:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.864339:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.864347:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594402688:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.864549:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13682 00000100:00100000:2.0:1746143767.864554:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594320128:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143767.864560:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.864568:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 13 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.864570:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.864575:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594402816:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.864583:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 29 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.864589:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.864595:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 31 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864597:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.864601:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.864602:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.864604:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864604:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 40 pid: 8496 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.864610:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594402944:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.864620:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 31 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.864627:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 31 pid: 8496 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.864634:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594403072:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.864638:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143767.864642:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 13 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.864649:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 13 pid: 9527 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.864656:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594403200:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.864656:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13683 00000100:00100000:0.0:1746143767.864662:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594320384:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143767.864665:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.864672:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 13 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.864674:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864680:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.864684:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594403328:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143767.864684:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 29 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.864690:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 40 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.864691:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594403456:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.864695:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143767.864699:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746143767.864701:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 29 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864702:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.864707:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 13 pid: 6929 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.864707:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 29 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.864708:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 26 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143767.864713:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594403712:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143767.864713:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143767.864715:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594403584:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143767.864715:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.864716:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.864723:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746143767.864731:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 26 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.864736:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 26 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864738:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 26 pid: 8496 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.864739:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 13 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.864743:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 26 pid: 8496 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.864745:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594403840:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.864746:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 13 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.864750:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594403968:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.864754:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594404096:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.864762:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00010000:00010000:0.0:1746143767.864766:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143767.864772:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.864773:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 13 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.864779:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.864780:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594404224:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.864786:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594404352:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143767.864797:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 40 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.864798:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00010000:00010000:0.0:1746143767.864804:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 40 pid: 6929 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.864810:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594404480:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.864822:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143767.872981:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594402304:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.873083:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594402432:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143767.873218:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594402560:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143767.873228:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594403200:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.873236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.873252:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.873266:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320768 00000100:00100000:1.0:1746143767.873271:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320768 00000100:00100000:2.0:1746143767.873281:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594402816:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.873289:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e17c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594402944:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.873294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143767.873305:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 32 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.873309:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.873314:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.873327:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320896 00000100:00100000:2.0:1746143767.873328:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321280 00000100:00100000:1.0:1746143767.873330:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320896 00000100:00100000:0.0:1746143767.873330:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320640 00000100:00100000:2.0:1746143767.873331:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321280 00000100:00100000:0.0:1746143767.873331:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320640 00010000:00010000:1.0:1746143767.873339:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 14 pid: 9527 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.873344:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 41 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.873344:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 14 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.873358:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7337 00000100:00100000:1.0:1746143767.873364:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594320768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143767.873367:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7338 00000100:00100000:2.0:1746143767.873371:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7339 00000100:00100000:0.0:1746143767.873373:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1962:x1830963594320896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143767.873374:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963594321280:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.873374:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.873379:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143767.873380:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143767.873392:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 41 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.873392:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 32 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.873392:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 14 pid: 9527 timeout: 946 lvb_type: 1 00010000:00010000:0.0:1746143767.873400:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 14 pid: 9527 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.873401:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 41 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.873401:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 32 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.873417:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a792c00/0xe984082ccd73086b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fd5 expref: 41 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.873417:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009beada00/0xe984082ccd7308b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a800d expref: 14 pid: 9527 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.873419:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143767.873431:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143767.873432:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.873435:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7340 00000100:00100000:3.0:1746143767.873443:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594320640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.873451:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143767.873451:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594321280:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.873451:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1962:x1830963594320768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.873453:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1962:x1830963594320896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.873457:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7337 00010000:00010000:3.0:1746143767.873460:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 14 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.873460:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7339 00000100:00100000:0.0:1746143767.873465:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7338 00010000:00010000:3.0:1746143767.873469:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 14 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873479:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a793a00/0xe984082ccd7308aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fff expref: 14 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.873481:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594403456:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.873492:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143767.873496:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.873509:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594320640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.873514:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7340 00000100:00100000:0.0:1746143767.873517:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.873526:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321152 00000100:00100000:3.0:1746143767.873529:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321152 00010000:00010000:3.0:1746143767.873544:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 13 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.873562:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7341 00000100:00100000:3.0:1746143767.873566:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594321152:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143767.873569:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143767.873571:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.873577:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 13 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873584:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 13 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873592:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.873600:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.873604:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594321152:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 38us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.873608:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7341 00000100:00100000:3.0:1746143767.873616:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594320512 00000100:00100000:3.0:1746143767.873618:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594320512 00000100:00100000:0.0:1746143767.873620:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143767.873624:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 27 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.873638:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321024 00000100:00100000:3.0:1746143767.873640:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321024 00010000:00010000:3.0:1746143767.873645:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 32 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.873648:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321408 00000100:00100000:2.0:1746143767.873651:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321408 00000100:00100000:3.0:1746143767.873653:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7342 00000100:00100000:3.0:1746143767.873656:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594320512:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143767.873660:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143767.873661:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143767.873662:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 33 pid: 9527 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873666:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 27 pid: 8496 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873672:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 27 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.873672:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321536 00000100:00100000:2.0:1746143767.873673:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321536 00010000:00010000:3.0:1746143767.873681:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a792a00/0xe984082ccd730872 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fdc expref: 27 pid: 8496 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.873681:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873687:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.873689:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143767.873689:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594403840:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.873690:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7343 00010000:00010000:3.0:1746143767.873692:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.873694:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594321024:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.873698:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.873699:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143767.873708:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 33 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873711:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143767.873716:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 33 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746143767.873716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.873725:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594320512:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.873725:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321920 00010000:00010000:2.0:1746143767.873726:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd73084f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb9 expref: 33 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.873728:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321920 00000100:00100000:3.0:1746143767.873729:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7342 00010000:00010000:2.0:1746143767.873734:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.873736:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7344 00010000:00010000:1.0:1746143767.873739:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 26 pid: 8496 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.873740:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594321408:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.873745:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143767.873748:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594321024:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (148us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143767.873750:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 32 pid: 9527 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.873751:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7345 00000100:00100000:1.0:1746143767.873755:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594321536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.873757:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 32 pid: 9527 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.873757:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7343 00010000:00010000:1.0:1746143767.873761:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143767.873764:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594404224:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.873765:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009beadc00/0xe984082ccd7307a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f49 expref: 31 pid: 9527 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.873767:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7346 00010000:00010000:1.0:1746143767.873770:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.873771:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.873772:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594321920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143767.873777:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.873777:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 40 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.873780:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594321408:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 40us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.873784:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7344 00010000:00010000:2.0:1746143767.873785:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 26 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.873788:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143767.873792:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 26 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.873801:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143767.873803:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730879 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fe3 expref: 29 pid: 8496 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.873803:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594321536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.873810:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594403072:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143767.873811:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7345 00000100:00100000:2.0:1746143767.873813:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594321920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.873818:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7346 00010000:00010000:3.0:1746143767.873819:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a793400/0xe984082ccd7308b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8006 expref: 12 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:0.0:1746143767.873821:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594404480:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.873831:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594403328:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143767.873833:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.873838:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594403712:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.873842:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.873848:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.873850:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.873857:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143767.873864:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.873867:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730856 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fc0 expref: 39 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:2.0:1746143767.873871:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.873873:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594402688:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143767.873873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.873880:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594403584:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.873882:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.873884:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322048 00010000:00010000:3.0:1746143767.873886:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730848 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fb2 expref: 25 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.873887:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009beade00 already unused, calling callback (ffffffffa0870d70) 00000100:00100000:1.0:1746143767.873887:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322048 00010000:00010000:2.0:1746143767.873890:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.873892:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594403968:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.873896:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.873897:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.873897:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143767.873903:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.873905:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.873908:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322176 00010000:00010000:2.0:1746143767.873910:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009beade00/0xe984082ccd7308fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.873910:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322176 00000100:00100000:3.0:1746143767.873915:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594404096:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143767.873916:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 12 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.873921:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594404352:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143767.873925:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322304 00000100:00100000:1.0:1746143767.873927:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322304 00010000:00010000:3.0:1746143767.873932:0:2839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.873933:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 13 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.873941:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7347 00000100:00100000:1.0:1746143767.873945:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594322048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143767.873947:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7348 00010000:00010000:1.0:1746143767.873951:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143767.873952:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963594322176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143767.873952:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594320000:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 9956us (10117us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143767.873957:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.873957:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.873958:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13679 00010000:00010000:3.0:1746143767.873962:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 12 pid: 8496 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.873964:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.873969:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 12 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.873975:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7349 00010000:00010000:1.0:1746143767.873975:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde5000/0xe984082ccd73075a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f18 expref: 30 pid: 4582 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.873977:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a793600/0xe984082ccd7308a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff1 expref: 12 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:2.0:1746143767.873980:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594322304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.873983:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143767.873986:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.873989:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.873991:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143767.873992:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594322176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (119us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143767.873993:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.873996:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 12 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.873997:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7348 00010000:00010000:1.0:1746143767.873999:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.874008:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 12 pid: 4581 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.874010:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143767.874018:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7308bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8014 expref: 12 pid: 4581 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.874024:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594322048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 78us (167us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143767.874025:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.874029:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7347 00000100:00100000:2.0:1746143767.874040:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594322304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (142us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143767.874044:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143767.874045:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7349 00010000:00010000:1.0:1746143767.874049:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874061:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874067:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874072:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874081:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f8f8200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143767.874084:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874089:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874097:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874102:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f8f8200/0xe984082ccd730905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.874127:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594320256:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 9947us (10263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.874133:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13680 00000100:00100000:0.0:1746143767.874184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.874217:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.874232:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.874255:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.874297:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.874357:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321664 00000100:00100000:1.0:1746143767.874360:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321664 00010000:00010000:1.0:1746143767.874375:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 11 pid: 6929 timeout: 946 lvb_type: 1 00000100:00100000:1.0:1746143767.874387:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7350 00000100:00100000:1.0:1746143767.874392:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594321664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.874397:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.874404:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 11 pid: 6929 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.874458:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322432 00000100:00100000:3.0:1746143767.874462:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322432 00010000:00010000:3.0:1746143767.874472:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 25 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.874482:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322560 00000100:00100000:2.0:1746143767.874482:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594321792 00000100:00100000:3.0:1746143767.874484:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322560 00000100:00100000:2.0:1746143767.874486:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594321792 00010000:00010000:3.0:1746143767.874495:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 39 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.874498:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 29 pid: 8496 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.874508:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322688 00000100:00100000:3.0:1746143767.874510:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322688 00000100:00100000:2.0:1746143767.874510:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7351 00000100:00100000:2.0:1746143767.874514:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594322432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.874517:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 30 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.874520:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143767.874525:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7352 00010000:00010000:2.0:1746143767.874527:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 25 pid: 8496 timeout: 946 lvb_type: 1 00000100:00100000:3.0:1746143767.874529:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594321792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143767.874534:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 25 pid: 8496 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.874535:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.874535:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 11 pid: 6929 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.874541:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 30 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.874543:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02200/0xe984082ccd73074c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7f0a expref: 25 pid: 8496 timeout: 946 lvb_type: 1 00010000:00010000:1.0:1746143767.874545:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02c00/0xe984082ccd73089c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ff8 expref: 11 pid: 6929 timeout: 946 lvb_type: 1 00010000:00010000:3.0:1746143767.874548:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 30 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.874552:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143767.874553:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.874555:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.874557:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874563:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.874576:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143767.874671:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4400/0xe984082ccd730864 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fce expref: 30 pid: 8496 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.874679:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.874680:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.874683:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.874688:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.874701:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.875052:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594322432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 536us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.875053:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594321664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 659us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.875057:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7351 00000100:00100000:1.0:1746143767.875061:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7350 00000100:00100000:2.0:1746143767.875070:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7353 00000100:00100000:1.0:1746143767.875074:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7354 00000100:00100000:2.0:1746143767.875075:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594322560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143767.875080:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143767.875080:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594322688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143767.875086:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143767.875088:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 39 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.875094:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.875095:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 39 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.875102:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.875105:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a7fe00/0xe984082ccd730714 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7eee expref: 39 pid: 6929 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.875112:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.875113:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bde4c00/0xe984082ccd730841 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7fab expref: 29 pid: 8497 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.875114:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.875116:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875119:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143767.875121:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875121:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.875123:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875128:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875160:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.875188:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594322688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.875244:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7354 00010000:00010000:1.0:1746143767.875261:0:2839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875267:0:2839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875280:0:2839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875285:0:2839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875295:0:2839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875299:0:2839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a793000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143767.875301:0:2839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875306:0:2839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875314:0:2839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.875320:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a793000/0xe984082ccd7308f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.875348:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594319744:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 11367us (11557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.875352:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594321792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 819us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.875353:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13678 00000100:00100000:3.0:1746143767.875358:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7352 00010000:00010000:3.0:1746143767.875375:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875382:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875395:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875401:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875406:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875410:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800900e4000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143767.875413:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875418:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875426:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875435:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800900e4000/0xe984082ccd730913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.875440:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.875457:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594322560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 381us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.875463:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594320128:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 10909us (11551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143767.875464:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7353 00000100:00100000:3.0:1746143767.875468:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13682 00010000:00010000:3.0:1746143767.875483:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875488:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875499:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875505:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875510:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875514:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed02600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143767.875516:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875520:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875521:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875528:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875528:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.875533:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02600/0xe984082ccd73090c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875541:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875546:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875551:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875556:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bead600 already unused, calling callback (ffffffffa0870d70) 00000100:00100000:3.0:1746143767.875559:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594319872:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 11291us (11668us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143767.875559:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143767.875563:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13681 00010000:00010000:0.0:1746143767.875565:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875573:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.875582:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bead600/0xe984082ccd73091a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.875702:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594320384:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 11041us (11768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.875707:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13683 00000100:00100000:0.0:1746143767.879556:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.879708:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594322944 00000100:00100000:3.0:1746143767.879717:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594322944 00000100:00100000:3.0:1746143767.879762:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9250 00000100:00100000:3.0:1746143767.879769:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:31496:x1830963594322944:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143767.879807:0:2976:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.879828:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8400/0xe984082ccd7308f0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8029 expref: 18 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.879841:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.879844:0:2976:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143767.879868:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.879878:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 258 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.879885:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 39 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.879903:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 258 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.879908:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 258 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.880280:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 258 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.880290:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 39 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.880295:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.880318:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 39 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.880328:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 39 pid: 16090 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.880379:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404608:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.881019:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 258 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.881027:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 258 pid: 16090 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.881038:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404736:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.881067:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 258 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.881078:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 258 pid: 14762 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.881084:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404864:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.881104:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 258 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.881110:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 258 pid: 2976 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.881116:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404992:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.881134:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 39 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.881153:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 39 pid: 16090 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.881160:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594405120:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.881695:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 258 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.881710:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 258 pid: 14762 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.881720:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594405248:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.881742:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143767.885389:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.885479:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404608:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.885490:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404736:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.885497:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404864:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.885504:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594404992:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.885510:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594405120:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.885603:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323456 00000100:00100000:2.0:1746143767.885609:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323456 00000100:00100000:2.0:1746143767.885654:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3987 00000100:00100000:2.0:1746143767.885661:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:23698:x1830963594323456:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143767.885834:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:23698:x1830963594323456:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 173us (452us total) trans 8589943594 rc 0/0 00000100:00100000:2.0:1746143767.885841:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3987 00000100:00100000:2.0:1746143767.886387:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.886499:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323200 00000100:00100000:3.0:1746143767.886503:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323200 00010000:00010000:3.0:1746143767.886521:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 260 pid: 16090 timeout: 946 lvb_type: 0 00000100:00100000:3.0:1746143767.886553:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7355 00000100:00100000:3.0:1746143767.886558:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+260:1963:x1830963594323200:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.886566:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.886570:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 260 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.886578:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 260 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.886599:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800957e0a00/0xe984082ccd730172 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7ba6 expref: 260 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.886611:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.886615:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143767.886622:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143767.886653:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1963:x1830963594323200:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.886658:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7355 00000100:00100000:2.0:1746143767.886691:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.886752:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.886776:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.886834:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323072 00000100:00100000:0.0:1746143767.886837:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323072 00010000:00010000:0.0:1746143767.886850:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 40 pid: 16090 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.886863:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323712 00000100:00100000:0.0:1746143767.886865:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323712 00010000:00010000:0.0:1746143767.886872:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 41 pid: 16090 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.886882:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323584 00000100:00100000:0.0:1746143767.886883:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323584 00010000:00010000:0.0:1746143767.886890:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 259 pid: 2976 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.886898:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7356 00000100:00100000:0.0:1746143767.886902:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+41:1963:x1830963594323072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.886908:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.886912:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 41 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.886919:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 41 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.886929:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009505f400/0xe984082ccd730195 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7bad expref: 41 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.886937:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.886940:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.886944:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.886963:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+40:1963:x1830963594323072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.886968:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7356 00000100:00100000:0.0:1746143767.886978:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7357 00000100:00100000:0.0:1746143767.886982:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+39:1965:x1830963594323712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.886988:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.886991:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 39 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.886997:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 39 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.887006:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7f7800/0xe984082ccd7300f4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b3d expref: 39 pid: 16090 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.887013:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.887017:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.887022:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.887033:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+38:1965:x1830963594323712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.887038:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7357 00000100:00100000:0.0:1746143767.887046:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7358 00000100:00100000:0.0:1746143767.887050:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+259:1963:x1830963594323584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.887055:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.887058:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 259 pid: 2976 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.887065:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 259 pid: 2976 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.887073:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db9200/0xe984082ccd730102 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b4b expref: 259 pid: 2976 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.887080:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.887082:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.887087:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.887099:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1963:x1830963594323584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 48us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.887103:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7358 00000100:00100000:2.0:1746143767.888502:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.888575:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594405248:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.888606:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:0.0:1746143767.888730:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323840 00000100:00100000:0.0:1746143767.888735:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323840 00010000:00010000:0.0:1746143767.888752:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 258 pid: 14762 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.888777:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7359 00000100:00100000:0.0:1746143767.888781:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+258:1965:x1830963594323840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.888790:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.888793:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 258 pid: 14762 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.888800:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 258 pid: 14762 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.888818:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5db8400/0xe984082ccd7300e6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7b2f expref: 258 pid: 14762 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.888827:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.888830:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.888836:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143767.889553:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1965:x1830963594323840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 770us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143767.889560:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7359 00000100:00100000:1.0:1746143767.889738:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.889812:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594323968 00000100:00100000:0.0:1746143767.889817:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594323968 00010000:00010000:0.0:1746143767.889829:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 257 pid: 14762 timeout: 946 lvb_type: 0 00000100:00100000:0.0:1746143767.890047:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7360 00000100:00100000:0.0:1746143767.890053:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:1965:x1830963594323968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143767.890233:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143767.890239:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 257 pid: 14762 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.890248:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 257 pid: 14762 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.890260:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13e00/0xe984082ccd730324 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a7c78 expref: 257 pid: 14762 timeout: 946 lvb_type: 0 00010000:00010000:0.0:1746143767.890268:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.890271:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.890277:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.890282:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143767.890692:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143767.890864:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143767.890871:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000040:00080000:2.0:1746143767.891427:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2704, 88 off228488 00000004:00080000:2.0:1746143767.891434:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846901294060ns, next at 788202887869ns, rc = 0 00000100:00100000:1.0:1746143767.891567:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1965:x1830963594323968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1512us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.891574:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7360 00000040:00080000:3.0:1746143767.893347:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2719, 88 off229992 00000004:00080000:3.0:1746143767.893358:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846903217866ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143767.895227:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2720, 88 off230080 00000004:00080000:3.0:1746143767.895237:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846905096708ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143767.895252:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2705, 88 off228576 00000004:00080000:3.0:1746143767.895255:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905115287ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895609:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2706, 88 off228664 00000004:00080000:3.0:1746143767.895613:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905473648ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895623:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2721, 88 off230168 00000004:00080000:3.0:1746143767.895625:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846905485718ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143767.895857:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2722, 88 off230256 00000004:00080000:3.0:1746143767.895862:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846905722312ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143767.895868:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2723, 88 off230344 00000004:00080000:3.0:1746143767.895870:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846905730639ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143767.895877:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2707, 88 off228752 00000004:00080000:3.0:1746143767.895880:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905740024ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895886:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2724, 88 off230432 00000004:00080000:3.0:1746143767.895888:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846905748844ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143767.895895:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2708, 88 off228840 00000004:00080000:3.0:1746143767.895897:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905757022ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895903:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2725, 88 off230520 00000004:00080000:3.0:1746143767.895905:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846905765219ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143767.895911:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2709, 88 off228928 00000004:00080000:3.0:1746143767.895914:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905774144ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895921:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2710, 88 off229016 00000004:00080000:3.0:1746143767.895923:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905783057ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895928:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2711, 88 off229104 00000004:00080000:3.0:1746143767.895931:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905791099ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895937:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2712, 88 off229192 00000004:00080000:3.0:1746143767.895939:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 846905799187ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143767.895945:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2726, 88 off230608 00000004:00080000:3.0:1746143767.895947:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 846905807314ns, next at 833304778357ns, rc = 0 00000001:00080000:1.0:1746143767.924352:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943588 is committed 00000001:00080000:1.0:1746143767.924365:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943549 is committed 00000001:00080000:1.0:1746143767.924369:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943548 is committed 00000001:00080000:1.0:1746143767.924376:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943593 is committed 00000001:00080000:1.0:1746143767.924387:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943571 is committed 00000001:00080000:1.0:1746143767.924401:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943595 is committed 00000004:00080000:1.0:1746143767.924404:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2061 committed 00000004:00080000:1.0:1746143767.924410:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2048 committed 00000004:00080000:1.0:1746143767.924413:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2047 committed 00000004:00080000:1.0:1746143767.924415:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2046 committed 00000004:00080000:1.0:1746143767.924416:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2045 committed 00000004:00080000:1.0:1746143767.924417:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2060 committed 00000004:00080000:1.0:1746143767.924418:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2044 committed 00000004:00080000:1.0:1746143767.924420:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2059 committed 00000004:00080000:1.0:1746143767.924421:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2043 committed 00000004:00080000:1.0:1746143767.924422:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2058 committed 00000004:00080000:1.0:1746143767.924423:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2057 committed 00000004:00080000:1.0:1746143767.924425:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2056 committed 00000004:00080000:1.0:1746143767.924426:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2042 committed 00000004:00080000:1.0:1746143767.924427:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2041 committed 00000004:00080000:1.0:1746143767.924428:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2055 committed 00000004:00080000:1.0:1746143767.924429:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2054 committed 00000004:00080000:1.0:1746143767.924430:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2040 committed 00000001:00080000:1.0:1746143767.924434:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943594 is committed 00000001:00080000:1.0:1746143767.924441:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943590 is committed 00000100:00100000:1.0:1746143767.924663:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594405760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.924717:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924760:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.924774:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924784:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.924798:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924810:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594407296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.924821:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924834:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143767.924838:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594405376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.924848:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924855:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594405888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.924863:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924870:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.924880:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924887:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.924895:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924908:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594405504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.924918:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924925:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.924934:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924940:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.924949:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924956:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594407040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.924966:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924973:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746143767.924976:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594405632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.924985:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.924990:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.925000:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.925005:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406656:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.925014:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.925019:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594407168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.925028:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.925041:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405760 00000100:00100000:1.0:1746143767.925046:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405760 00000100:00100000:1.0:1746143767.925073:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406272 00000100:00100000:1.0:1746143767.925074:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406272 00000100:00100000:1.0:1746143767.925079:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406784 00000100:00100000:1.0:1746143767.925080:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406784 00000100:00100000:1.0:1746143767.925087:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407296 00000100:00100000:1.0:1746143767.925088:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407296 00000100:00100000:1.0:1746143767.925092:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405376 00000100:00100000:1.0:1746143767.925094:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405376 00000100:00100000:1.0:1746143767.925097:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405888 00000100:00100000:1.0:1746143767.925099:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405888 00000100:00100000:1.0:1746143767.925102:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406400 00000100:00100000:1.0:1746143767.925104:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406400 00000100:00100000:1.0:1746143767.925108:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406912 00000100:00100000:1.0:1746143767.925109:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406912 00000100:00100000:1.0:1746143767.925112:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405504 00000100:00100000:1.0:1746143767.925113:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405504 00000100:00100000:1.0:1746143767.925117:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406016 00000100:00100000:1.0:1746143767.925118:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406016 00000100:00100000:1.0:1746143767.925122:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406528 00000100:00100000:1.0:1746143767.925123:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406528 00000100:00100000:1.0:1746143767.925134:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407040 00000100:00100000:1.0:1746143767.925135:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407040 00000100:00100000:1.0:1746143767.925172:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405632 00000100:00100000:1.0:1746143767.925174:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405632 00000100:00100000:1.0:1746143767.925181:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406144 00000100:00100000:1.0:1746143767.925182:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406144 00000100:00100000:1.0:1746143767.925187:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406656 00000100:00100000:1.0:1746143767.925189:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406656 00000100:00100000:1.0:1746143767.925194:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407168 00000100:00100000:1.0:1746143767.925195:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407168 00000100:00100000:1.0:1746143767.925203:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13684 00000100:00100000:1.0:1746143767.925209:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963594405760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143767.925342:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143767.925344:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143767.925346:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143767.925348:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143767.925349:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143767.925375:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963594405760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 166us (659us total) trans 17179873149 rc 0/0 00000100:00100000:1.0:1746143767.925381:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13684 00000100:00100000:1.0:1746143767.925394:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13685 00000100:00100000:1.0:1746143767.925398:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963594406272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.925471:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963594406272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (696us total) trans 17179873150 rc 0/0 00000100:00100000:1.0:1746143767.925476:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13685 00000100:00100000:1.0:1746143767.925485:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13686 00000100:00100000:1.0:1746143767.925489:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594406784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.925584:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594406784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (784us total) trans 21474840473 rc 0/0 00000100:00100000:1.0:1746143767.925588:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13686 00000100:00100000:1.0:1746143767.925598:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13687 00000100:00100000:1.0:1746143767.925602:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594407296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.925670:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594407296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (848us total) trans 21474840474 rc 0/0 00000100:00100000:1.0:1746143767.925675:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13687 00000100:00100000:1.0:1746143767.925685:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13688 00000100:00100000:1.0:1746143767.925688:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963594405376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.925764:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963594405376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (913us total) trans 17179873151 rc 0/0 00000100:00100000:1.0:1746143767.925769:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13688 00000100:00100000:1.0:1746143767.925778:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13689 00000100:00100000:1.0:1746143767.925782:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963594405888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.925847:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963594405888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (982us total) trans 17179873152 rc 0/0 00000100:00100000:1.0:1746143767.925851:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13689 00000100:00100000:1.0:1746143767.925861:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13690 00000100:00100000:1.0:1746143767.925866:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594406400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.925941:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594406400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1060us total) trans 21474840475 rc 0/0 00000100:00100000:1.0:1746143767.925945:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13690 00000100:00100000:1.0:1746143767.925954:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13691 00000100:00100000:1.0:1746143767.925958:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594406912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.926025:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594406912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1128us total) trans 21474840476 rc 0/0 00000100:00100000:1.0:1746143767.926029:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13691 00000100:00100000:1.0:1746143767.926039:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13692 00000100:00100000:1.0:1746143767.926043:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594405504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.926119:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594405504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1199us total) trans 17179873153 rc 0/0 00000100:00100000:1.0:1746143767.926123:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13692 00000100:00100000:1.0:1746143767.926132:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13693 00000100:00100000:1.0:1746143767.926136:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594406016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.926250:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594406016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (1314us total) trans 17179873154 rc 0/0 00000100:00100000:1.0:1746143767.926254:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13693 00000100:00100000:1.0:1746143767.926262:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13694 00000100:00100000:1.0:1746143767.926266:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594406528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.926339:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594406528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1388us total) trans 21474840477 rc 0/0 00000100:00100000:1.0:1746143767.926343:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13694 00000100:00100000:1.0:1746143767.926352:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13695 00000100:00100000:1.0:1746143767.926355:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594407040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.926416:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594407040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1449us total) trans 21474840478 rc 0/0 00000100:00100000:1.0:1746143767.926420:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13695 00000100:00100000:1.0:1746143767.926428:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13696 00000100:00100000:1.0:1746143767.926431:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594405632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.926500:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594405632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1513us total) trans 17179873155 rc 0/0 00000100:00100000:1.0:1746143767.926504:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13696 00000100:00100000:1.0:1746143767.926511:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13697 00000100:00100000:1.0:1746143767.926515:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594406144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143767.926574:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594406144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (1573us total) trans 17179873156 rc 0/0 00000100:00100000:1.0:1746143767.926579:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13697 00000100:00100000:1.0:1746143767.926587:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13698 00000100:00100000:1.0:1746143767.926590:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594406656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.926663:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594406656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1647us total) trans 21474840479 rc 0/0 00000100:00100000:1.0:1746143767.926667:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13698 00000100:00100000:1.0:1746143767.926675:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13699 00000100:00100000:1.0:1746143767.926679:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594407168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.926745:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594407168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1716us total) trans 21474840480 rc 0/0 00000100:00100000:1.0:1746143767.926750:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13699 00000100:00080000:1.0:1746143767.926777:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143767.926779:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746143767.926804:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ec380/2, rc 0, transno 17179873155 00000100:00100000:1.0:1746143767.926809:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594405632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926817:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79c700/2, rc 0, transno 17179873156 00000100:00100000:1.0:1746143767.926819:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926827:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79d500/2, rc 0, transno 21474840479 00000100:00100000:1.0:1746143767.926834:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143767.926840:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79df80/2, rc 0, transno 21474840480 00000100:00100000:1.0:1746143767.926843:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594407168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143767.926850:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ee680/2, rc 0, transno 17179873153 00000100:00100000:1.0:1746143767.926853:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594405504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926857:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79c000/2, rc 0, transno 17179873154 00000100:00100000:1.0:1746143767.926859:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926864:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79ca80/2, rc 0, transno 21474840477 00000100:00100000:1.0:1746143767.926867:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594406528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143767.926872:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f100/2, rc 0, transno 21474840478 00000100:00100000:1.0:1746143767.926874:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594407040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143767.926918:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1efb80/2, rc 0, transno 17179873151 00000100:00100000:1.0:1746143767.926920:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594405376:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926926:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79d180/2, rc 0, transno 17179873152 00000100:00100000:1.0:1746143767.926928:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594405888:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926933:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79e300/2, rc 0, transno 21474840475 00000100:00100000:1.0:1746143767.926935:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406400:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143767.926940:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79ce00/2, rc 0, transno 21474840476 00000100:00100000:1.0:1746143767.926942:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406912:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143767.926950:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f800/2, rc 0, transno 17179873149 00000100:00100000:1.0:1746143767.926953:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594405760:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926959:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79dc00/2, rc 0, transno 17179873150 00000100:00100000:1.0:1746143767.926961:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143767.926967:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79ed80/2, rc 0, transno 21474840473 00000100:00100000:1.0:1746143767.926969:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594406784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143767.926974:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79fb80/2, rc 0, transno 21474840474 00000100:00100000:1.0:1746143767.926976:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594407296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.926982:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143767.926988:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594407424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.927009:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143767.927049:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407424 00000100:00100000:1.0:1746143767.927052:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407424 00000100:00100000:1.0:1746143767.927069:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13700 00000100:00100000:1.0:1746143767.927073:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594407424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143767.927178:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3292:x1830963594407424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (168us total) trans 21474840481 rc 0/0 00000100:00100000:1.0:1746143767.927183:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13700 00000004:00080000:1.0:1746143767.927203:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093804380/2, rc 0, transno 21474840481 00000100:00100000:1.0:1746143767.927206:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594407424:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746143767.927443:0:2976:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093501500 reply state ffff88009554cc00 transno 8589943595 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143767.927451:0:2976:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746143767.927514:0:2976:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143767.927525:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31496:x1830963594322944:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 47755us (47973us total) trans 8589943595 rc 0/0 00000100:00100000:3.0:1746143767.927534:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9250 00010000:00010000:2.0:1746143767.927613:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143767.927621:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143767.927627:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143767.927633:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed02e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143767.927637:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143767.927642:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143767.927655:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143767.927657:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143767.927661:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143767.927666:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02e00/0xe984082ccd730921 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00000100:00100000:0.0:1746143767.932605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.933321:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324096 00000100:00100000:3.0:1746143767.933330:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324096 00000100:00100000:3.0:1746143767.933531:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9251 00000100:00100000:3.0:1746143767.933539:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31496:x1830963594324096:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143767.933559:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.933574:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8030 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.933625:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.933636:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.933650:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.933653:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143767.933655:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793200, rc 0) 00000100:00100000:3.0:1746143767.933694:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31496:x1830963594324096:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 156us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.933699:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9251 00000100:00100000:0.0:1746143767.937950:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.938060:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324224 00000100:00100000:1.0:1746143767.938067:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324224 00000100:00100000:1.0:1746143767.938692:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 744 00000100:00100000:1.0:1746143767.938701:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31496:x1830963594324224:12345-192.168.202.48@tcp:103:mirror_io.0 00010000:00010000:1.0:1746143767.938712:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.938733:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f8f8000/0xe984082ccd7308e2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8022 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.938761:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143767.938765:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143767.938805:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31496:x1830963594324224:12345-192.168.202.48@tcp:103:mirror_io.0 Request processed in 106us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.938814:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 744 00000100:00100000:0.0:1746143767.940286:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143767.940481:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324480 00000100:00100000:2.0:1746143767.940486:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324480 00000100:00100000:2.0:1746143767.940513:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3988 00000100:00100000:2.0:1746143767.940519:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31496:x1830963594324480:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143767.940986:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31496:x1830963594324480:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 466us (703us total) trans 8589943596 rc 0/0 00000100:00100000:2.0:1746143767.940993:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3988 00000100:00100000:0.0:1746143767.942196:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.942442:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324736 00000100:00100000:3.0:1746143767.942447:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324736 00000100:00100000:3.0:1746143767.942472:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3989 00000100:00100000:3.0:1746143767.942477:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31496:x1830963594324736:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143767.942601:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31496:x1830963594324736:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 123us (408us total) trans 8589943597 rc 0/0 00000100:00100000:3.0:1746143767.942606:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3989 00000100:00100000:0.0:1746143767.962078:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.962183:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594324992 00000100:00100000:1.0:1746143767.962191:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594324992 00000100:00100000:1.0:1746143767.962237:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9252 00000100:00100000:1.0:1746143767.962243:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:31502:x1830963594324992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143767.962262:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.962278:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090856200/0xe984082ccd73092f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8037 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.962434:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962444:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962452:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962463:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962467:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962472:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962558:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962565:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962571:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143767.962578:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143767.962643:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962648:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962653:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962657:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090856000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143767.962660:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962665:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962674:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143767.962676:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143767.962679:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.962682:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090856000/0xe984082ccd730936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963266:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963272:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963280:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963285:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090856c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143767.963287:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963295:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963302:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03cb00) 00010000:00010000:1.0:1746143767.963304:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143767.963306:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963310:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090856c00/0xe984082ccd73093d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.963344:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090856200/0xe984082ccd73092f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 9 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.963354:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 8 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.963359:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143767.963361:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143767.963363:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090856e00, rc 0) 00000100:00100000:1.0:1746143767.963414:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31502:x1830963594324992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1170us (1341us total) trans 8589943598 rc 0/0 00000100:00100000:1.0:1746143767.963419:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9252 00000100:00100000:1.0:1746143767.963661:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.963704:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325248 00000100:00100000:0.0:1746143767.963708:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325248 00000100:00100000:0.0:1746143767.963737:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9253 00000100:00100000:0.0:1746143767.963742:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31505:x1830963594325248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143767.963751:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143767.963758:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03200/0xe984082ccd730952 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a803e expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.963803:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963810:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963816:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963824:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963829:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963835:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963892:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963898:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963903:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:0.0:1746143767.963910:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:0.0:1746143767.963954:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963959:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963963:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963967:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed03400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143767.963969:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963973:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963979:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143767.963981:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143767.963983:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.963987:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03400/0xe984082ccd730959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964007:0:20509:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964013:0:20509:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964017:0:20509:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964024:0:20509:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ed02000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:0.0:1746143767.964027:0:20509:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964031:0:20509:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964037:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1ff900) 00010000:00010000:0.0:1746143767.964039:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143767.964042:0:20509:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964046:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed02000/0xe984082ccd730960 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143767.964069:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03200/0xe984082ccd730952 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.964077:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.964083:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143767.964084:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143767.964086:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed03600, rc 0) 00000100:00100000:0.0:1746143767.964108:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31505:x1830963594325248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 365us (447us total) trans 8589943599 rc 0/0 00000100:00100000:0.0:1746143767.964113:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9253 00000100:00100000:0.0:1746143767.966016:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.966036:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.966071:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.966086:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.966100:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325632 00000100:00100000:1.0:1746143767.966100:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.966106:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325632 00000100:00100000:1.0:1746143767.966113:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.966134:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325760 00000100:00100000:3.0:1746143767.966136:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325760 00000100:00100000:3.0:1746143767.966182:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325888 00000100:00100000:3.0:1746143767.966184:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325888 00000100:00100000:3.0:1746143767.966192:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326016 00000100:00100000:3.0:1746143767.966194:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326016 00000100:00100000:1.0:1746143767.966195:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.966210:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326144 00000100:00100000:3.0:1746143767.966211:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326144 00000100:00100000:1.0:1746143767.966214:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326272 00000100:00100000:1.0:1746143767.966218:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326272 00000100:00100000:3.0:1746143767.966223:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13701 00000100:00100000:3.0:1746143767.966228:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594325632:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143767.966234:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13702 00000100:00100000:1.0:1746143767.966239:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13703 00010000:00010000:3.0:1746143767.966242:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143767.966242:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594325760:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143767.966245:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594325888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143767.966250:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143767.966252:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.966256:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a804c expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143767.966260:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8053 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.966261:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a805a expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143767.966275:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a17, atime: 0x68140a17, ctime: 0x68140a17, blocks: 0x811 00002000:00010000:1.0:1746143767.966275:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a17, atime: 0x68140a17, ctime: 0x68140a17, blocks: 0x821 00002000:00010000:0.0:1746143767.966275:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a17, atime: 0x68140a17, ctime: 0x68140a17, blocks: 0x81f 00010000:00010000:3.0:1746143767.966287:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.966287:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.966287:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.966289:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.966289:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143767.966289:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.966295:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 32 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.966295:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 42 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.966295:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 42 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.966306:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 32 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.966306:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 42 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143767.966306:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 42 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.966313:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792e00, rc 0) 00010000:00010000:1.0:1746143767.966313:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090857200, rc 0) 00010000:00010000:0.0:1746143767.966314:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ed02400, rc 0) 00000100:00100000:1.0:1746143767.966342:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594325888:12345-192.168.202.48@tcp:101:cat.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.966346:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594325632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.966348:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13703 00000100:00100000:3.0:1746143767.966352:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13701 00000100:00100000:3.0:1746143767.966361:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13704 00000100:00100000:3.0:1746143767.966365:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1964:x1830963594326016:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143767.966365:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13705 00010000:00010000:3.0:1746143767.966369:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143767.966369:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963594325760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 128us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.966370:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594326144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.966375:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8061 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143767.966375:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13702 00010000:00010000:1.0:1746143767.966376:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746143767.966383:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a17, atime: 0x68140a17, ctime: 0x68140a17, blocks: 0x821 00010000:00010000:1.0:1746143767.966383:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8068 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.966389:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.966390:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.966393:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 32 pid: 8495 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746143767.966393:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a16, atime: 0x68140a17, ctime: 0x68140a16, blocks: 0x14ad 00010000:00010000:3.0:1746143767.966400:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 33 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143767.966400:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.966401:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143767.966405:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.966406:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792800, rc 0) 00010000:00010000:1.0:1746143767.966414:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 33 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143767.966417:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594326016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 52us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.966421:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13704 00010000:00010000:1.0:1746143767.966421:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090857400, rc 0) 00000100:00100000:3.0:1746143767.966428:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13706 00000100:00100000:3.0:1746143767.966432:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594326272:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143767.966435:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143767.966436:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594326144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 67us (322us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143767.966441:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a806f expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143767.966441:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13705 00002000:00010000:3.0:1746143767.966455:0:8495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a16, atime: 0x68140a16, ctime: 0x68140a16, blocks: 0x1029 00010000:00010000:3.0:1746143767.966460:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.966461:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143767.966464:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 41 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.966471:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 41 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143767.966477:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792400, rc 0) 00000100:00100000:3.0:1746143767.966487:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963594326272:12345-192.168.202.48@tcp:101:cat.0 Request processed in 56us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.966492:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13706 00000100:00100000:2.0:1746143767.966594:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594325504 00000100:00100000:2.0:1746143767.966598:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594325504 00000100:00100000:2.0:1746143767.966630:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9254 00000100:00100000:2.0:1746143767.966636:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31501:x1830963594325504:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143767.966657:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143767.966667:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc33800/0xe984082ccd73099f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8045 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.966740:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143767.966751:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.966757:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.966762:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143767.966784:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.966794:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 243 pid: 20509 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.966803:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407552:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143767.967030:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 7 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143767.967039:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 7 pid: 20509 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.967047:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407680:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143767.967070:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143767.968397:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407552:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143767.969640:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407680:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143767.969658:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143767.970854:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.970929:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.971034:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.971098:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326400 00000100:00100000:2.0:1746143767.971099:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326656 00000100:00100000:3.0:1746143767.971104:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326400 00000100:00100000:2.0:1746143767.971104:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326656 00000100:00100000:1.0:1746143767.971105:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326528 00000100:00100000:1.0:1746143767.971108:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326528 00010000:00010000:3.0:1746143767.971130:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 245 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:1.0:1746143767.971130:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 8 pid: 20509 timeout: 946 lvb_type: 0 00000100:00100000:2.0:1746143767.971176:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9255 00000100:00100000:3.0:1746143767.971182:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7361 00000100:00100000:2.0:1746143767.971184:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31505:x1830963594326656:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143767.971188:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:1965:x1830963594326400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143767.971197:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143767.971199:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143767.971205:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 245 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.971208:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc33400/0xe984082ccd7309ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8076 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.971214:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 245 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.971229:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ed03600/0xe984082ccd730967 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a803e expref: 246 pid: 20509 timeout: 946 lvb_type: 0 00000100:00100000:1.0:1746143767.971242:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7362 00010000:00010000:3.0:1746143767.971245:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00000100:00100000:1.0:1746143767.971248:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594326528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143767.971249:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.971255:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.971255:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143767.971259:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 8 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:3.0:1746143767.971297:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143767.971306:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc33400/0xe984082ccd7309ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8076 expref: 245 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.971317:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 8 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.971326:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc33400/0xe984082ccd7309ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8076 expref: 245 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143767.971330:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090856e00/0xe984082ccd730944 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8037 expref: 8 pid: 20509 timeout: 946 lvb_type: 0 00010000:00010000:2.0:1746143767.971340:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143767.971343:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143767.971345:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc33400, rc 0) 00010000:00010000:1.0:1746143767.971345:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143767.971348:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.971354:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143767.971359:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00000100:00100000:2.0:1746143767.971370:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31505:x1830963594326656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 187us (335us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143767.971372:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143767.971375:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9255 00000100:00100000:1.0:1746143767.971389:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1965:x1830963594326528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 141us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143767.971394:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7362 00000100:00100000:3.0:1746143767.971587:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1965:x1830963594326400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 398us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143767.971594:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7361 00010000:00010000:3.0:1746143767.971615:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143767.971621:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143767.971635:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143767.971748:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc33800/0xe984082ccd73099f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 245 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.971757:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 244 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143767.971763:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143767.971764:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143767.971766:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc32800, rc 0) 00000100:00100000:3.0:1746143767.971799:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31501:x1830963594325504:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5163us (5787us total) trans 8589943600 rc 0/0 00000100:00100000:3.0:1746143767.971804:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9254 00000100:00100000:0.0:1746143767.982388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.983118:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143767.984330:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143767.984402:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594326912 00000100:00100000:3.0:1746143767.984403:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327168 00000100:00100000:3.0:1746143767.984409:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327168 00000100:00100000:1.0:1746143767.984409:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594326912 00002000:00100000:3.0:1746143767.984444:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093500e00 x1830963594327168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.984444:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093503800 x1830963594326912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.984453:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500e00 with x1830963594327168 ext(1048576->2097151) 00002000:00100000:1.0:1746143767.984453:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503800 with x1830963594326912 ext(0->1048575) 00002000:00010000:3.0:1746143767.984457:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500e00 00002000:00010000:1.0:1746143767.984457:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093503800 00000100:00100000:3.0:1746143767.984482:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6476 00000100:00100000:3.0:1746143767.984489:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594327168:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.984548:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327424 00000100:00100000:1.0:1746143767.984552:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327424 00000100:00100000:2.0:1746143767.984556:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6477 00000100:00100000:2.0:1746143767.984564:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594326912:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143767.984564:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc11500 x1830963594327424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.984571:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11500 with x1830963594327424 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.984573:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc11500 00000100:00100000:1.0:1746143767.984583:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6478 00000100:00100000:1.0:1746143767.984588:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594327424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143767.985762:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143767.986741:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327680 00000100:00100000:3.0:1746143767.986747:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327680 00002000:00100000:3.0:1746143767.986775:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc13b80 x1830963594327680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/0 e 0 to 0 dl 1746143778 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143767.986783:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963594327680 ext(1048576->2097151) 00002000:00010000:3.0:1746143767.986787:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:3.0:1746143767.986803:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6479 00000100:00100000:3.0:1746143767.986809:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594327680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143767.995840:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1965:x1830963594327424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11241us (11502us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143767.995850:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6478 00002000:00100000:1.0:1746143767.995859:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012fc11500 x1830963594327424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143767.995867:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc11500 with x1830963594327424 ext(1048576->2097151) 00002000:00010000:1.0:1746143767.995872:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc11500 00000100:00100000:3.0:1746143768.000941:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594327168:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16447us (17818us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.000951:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6476 00002000:00100000:3.0:1746143768.000960:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093500e00 x1830963594327168/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.000969:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500e00 with x1830963594327168 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.000973:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500e00 00000100:00100000:2.0:1746143768.010703:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594326912:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26133us (28315us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.010712:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6477 00002000:00100000:2.0:1746143768.010721:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093503800 x1830963594326912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.010729:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503800 with x1830963594326912 ext(0->1048575) 00002000:00010000:2.0:1746143768.010734:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093503800 00000100:00100000:3.0:1746143768.015450:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594327680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 28631us (29681us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.015461:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6479 00002000:00100000:3.0:1746143768.015471:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc13b80 x1830963594327680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:163/0 lens 488/440 e 0 to 0 dl 1746143778 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.015481:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc13b80 with x1830963594327680 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.015486:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc13b80 00000100:00100000:0.0:1746143768.039566:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.039609:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.039627:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.039638:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.039697:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.039744:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594328192 00000100:00100000:0.0:1746143768.039750:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594328192 00002000:00100000:0.0:1746143768.039796:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a0816680 x1830963594328192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.039806:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816680 with x1830963594328192 ext(2097152->3145727) 00002000:00010000:0.0:1746143768.039810:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0816680 00000100:00100000:0.0:1746143768.039825:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594328448 00000100:00100000:0.0:1746143768.039828:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594328448 00002000:00100000:0.0:1746143768.039839:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b79c380 x1830963594328448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.039851:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c380 with x1830963594328448 ext(3145728->4194303) 00002000:00010000:0.0:1746143768.039854:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c380 00000100:00100000:0.0:1746143768.039862:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594328704 00000100:00100000:0.0:1746143768.039865:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594328704 00002000:00100000:0.0:1746143768.039877:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012b79ea00 x1830963594328704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.039884:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ea00 with x1830963594328704 ext(2097152->3145727) 00002000:00010000:0.0:1746143768.039887:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79ea00 00000100:00100000:0.0:1746143768.039895:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594328960 00000100:00100000:0.0:1746143768.039897:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594328960 00002000:00100000:0.0:1746143768.039906:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093b05180 x1830963594328960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.039912:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b05180 with x1830963594328960 ext(3145728->4194303) 00002000:00010000:0.0:1746143768.039915:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b05180 00000100:00100000:0.0:1746143768.039926:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6480 00000100:00100000:0.0:1746143768.039932:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594328192:12345-192.168.202.48@tcp:3:cat.0 00000100:00080000:1.0:1746143768.040044:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143768.040048:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143768.040062:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6481 00000100:00100000:1.0:1746143768.040071:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594328448:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143768.041017:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6482 00000100:00100000:0.0:1746143768.041024:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594328704:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.041261:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6483 00000100:00100000:1.0:1746143768.041269:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594328960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.042522:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594327936 00000100:00100000:3.0:1746143768.042528:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594327936 00000100:00100000:3.0:1746143768.042573:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9256 00000100:00100000:3.0:1746143768.042578:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31508:x1830963594327936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.042594:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.042607:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792a00/0xe984082ccd7309bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a807d expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.042683:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042695:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042708:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042718:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042723:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042728:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042815:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042822:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042827:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143768.042834:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.042898:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042904:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042909:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042914:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a792200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.042917:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042923:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042932:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.042934:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.042937:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042942:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792200/0xe984082ccd7309c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042957:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042961:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042966:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042969:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a792600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.042971:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042975:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042980:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094924400) 00010000:00010000:3.0:1746143768.042981:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.042983:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.042988:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792600/0xe984082ccd7309c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.043019:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792a00/0xe984082ccd7309bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.043028:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.043034:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.043036:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143768.043038:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793a00, rc 0) 00000100:00100000:3.0:1746143768.043061:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31508:x1830963594327936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 482us (3502us total) trans 8589943601 rc 0/0 00000100:00100000:3.0:1746143768.043067:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9256 00000100:00080000:1.0:1746143768.043092:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143768.062578:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594328192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22638us (22960us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.062588:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6480 00002000:00100000:2.0:1746143768.062598:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a0816680 x1830963594328192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.062607:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0816680 with x1830963594328192 ext(2097152->3145727) 00002000:00010000:2.0:1746143768.062612:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0816680 00000100:00100000:1.0:1746143768.062705:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594328448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22635us (23075us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.062713:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6481 00002000:00100000:1.0:1746143768.062720:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b79c380 x1830963594328448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.062729:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c380 with x1830963594328448 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.062732:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c380 00000100:00100000:2.0:1746143768.066104:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1965:x1830963594328704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25072us (26455us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.066115:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6482 00002000:00100000:2.0:1746143768.066125:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012b79ea00 x1830963594328704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.066133:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ea00 with x1830963594328704 ext(2097152->3145727) 00002000:00010000:2.0:1746143768.066176:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79ea00 00000100:00100000:1.0:1746143768.071542:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594328960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30265us (31835us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.071553:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6483 00002000:00100000:1.0:1746143768.071563:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093b05180 x1830963594328960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.071572:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b05180 with x1830963594328960 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.071578:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b05180 00000100:00100000:0.0:1746143768.073337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.073376:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.073587:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.073627:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594329088 00000100:00100000:3.0:1746143768.073634:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594329088 00000100:00100000:2.0:1746143768.073738:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594329216 00000100:00100000:2.0:1746143768.073743:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594329216 00000100:00080000:1.0:1746143768.074718:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143768.074722:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143768.074802:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594329344 00000100:00100000:3.0:1746143768.074805:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594329344 00000100:00100000:3.0:1746143768.074821:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13707 00000100:00100000:3.0:1746143768.074828:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963594329088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.074841:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.074855:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8084 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.074874:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.074876:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.074883:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 28 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.074897:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 28 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.074907:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792600, rc 0) 00000100:00100000:2.0:1746143768.075509:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13708 00000100:00100000:2.0:1746143768.075515:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1963:x1830963594329344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.075523:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.075533:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8092 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.075545:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.075546:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.075550:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 26 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.075560:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 26 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.075566:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc33800, rc 0) 00000100:00100000:3.0:1746143768.075804:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594329088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 975us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.075810:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13707 00000100:00100000:3.0:1746143768.075825:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13709 00000100:00100000:3.0:1746143768.075829:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594329216:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.075836:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.075842:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a808b expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.075852:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.075853:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.075857:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.075866:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 27 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.075873:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793800, rc 0) 00000100:00100000:2.0:1746143768.076409:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963594329344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 892us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.076416:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13708 00000100:00100000:3.0:1746143768.076481:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594329216:12345-192.168.202.48@tcp:101:cat.0 Request processed in 650us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.076486:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13709 00000100:00100000:1.0:1746143768.077395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.077438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.077554:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.077702:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594329472 00000100:00100000:3.0:1746143768.077707:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594329472 00000100:00100000:2.0:1746143768.078281:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594329600 00000100:00100000:2.0:1746143768.078285:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594329600 00000100:00100000:3.0:1746143768.078346:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594329728 00000100:00100000:3.0:1746143768.078349:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594329728 00000100:00100000:2.0:1746143768.078374:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13710 00000100:00100000:2.0:1746143768.078380:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594329472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.078393:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.078404:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8099 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.078420:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.078422:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.078428:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.078440:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.078448:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc32a00, rc 0) 00000100:00100000:2.0:1746143768.078488:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594329472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 108us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.078493:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13710 00000100:00100000:2.0:1746143768.078504:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13711 00000100:00100000:2.0:1746143768.078508:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594329600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.078514:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.078519:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80a0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.078527:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.078528:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.078531:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.078539:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 30 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.078546:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc32400, rc 0) 00000100:00100000:2.0:1746143768.078556:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594329600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 48us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.078561:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13711 00000100:00100000:2.0:1746143768.078568:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13712 00000100:00100000:2.0:1746143768.078572:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594329728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.078579:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.078586:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80a7 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.078594:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.078595:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.078598:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.078606:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 27 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.078612:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc33000, rc 0) 00000100:00100000:2.0:1746143768.078621:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963594329728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 49us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.078625:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13712 00000100:00100000:1.0:1746143768.079417:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.079657:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594329984 00000100:00100000:2.0:1746143768.079661:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594329984 00002000:00100000:2.0:1746143768.079682:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880093807100 x1830963594329984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.079691:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807100 with x1830963594329984 ext(4194304->4771839) 00002000:00010000:2.0:1746143768.079695:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093807100 00000100:00100000:2.0:1746143768.079733:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6484 00000100:00100000:2.0:1746143768.079738:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594329984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.085673:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594329984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5925us (6248us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143768.085686:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6484 00002000:00100000:2.0:1746143768.085697:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880093807100 x1830963594329984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.085706:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807100 with x1830963594329984 ext(4194304->4771839) 00002000:00010000:2.0:1746143768.085711:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093807100 00000100:00100000:0.0:1746143768.086031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.086118:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594330240 00000100:00100000:3.0:1746143768.086125:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594330240 00000100:00080000:1.0:1746143768.086186:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143768.086205:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9257 00000100:00100000:3.0:1746143768.086212:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31501:x1830963594330240:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.086227:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.086230:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143768.086249:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc33400/0xe984082ccd7309ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8076 expref: 244 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.086276:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.086279:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143768.086287:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793600/0xe984082ccd730a08 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80ae expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.086328:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143768.086338:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.086344:0:20509:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.086349:0:20509:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143768.086371:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.086379:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 8 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.086390:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407808:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.086459:0:20509:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.086467:0:20509:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 8 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.086474:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407936:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.086492:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.089880:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407936:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.089983:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594407808:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.090003:0:20509:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143768.090370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.090404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.090421:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594330496 00000100:00100000:3.0:1746143768.090427:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594330496 00010000:00010000:3.0:1746143768.090451:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 9 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.090471:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594330368 00000100:00100000:3.0:1746143768.090473:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594330368 00010000:00010000:3.0:1746143768.090486:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.090499:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7363 00000100:00100000:3.0:1746143768.090505:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1963:x1830963594330496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.090514:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.090520:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 9 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.090522:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7364 00010000:00010000:3.0:1746143768.090529:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 9 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.090530:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594330368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.090538:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.090542:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.090546:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd7309d0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a807d expref: 9 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.090550:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.090564:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd730928 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8030 expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.090570:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.090574:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143768.090580:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143768.090585:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143768.090715:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.090728:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594330624 00000100:00100000:0.0:1746143768.090731:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594330624 00000100:00100000:0.0:1746143768.090748:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9258 00000100:00100000:0.0:1746143768.090752:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31505:x1830963594330624:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.090763:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.090771:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80b5 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.090838:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143768.090841:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143768.090846:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143768.090870:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594330368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 342us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.090876:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7364 00000100:00080000:1.0:1746143768.090891:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746143768.090950:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143768.090958:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.090969:0:14762:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:0.0:1746143768.090979:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.090988:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.090990:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143768.090993:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.090998:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bde5e00, rc 0) 00010000:00010000:2.0:1746143768.091052:0:20509:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143768.091058:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20509 initiator: MDT0 00000100:00100000:3.0:1746143768.091283:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1963:x1830963594330496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 777us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.091288:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31505:x1830963594330624:12345-192.168.202.48@tcp:101:cat.0 Request processed in 534us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.091293:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7363 00000100:00100000:0.0:1746143768.091294:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9258 00000040:00080000:2.0:1746143768.092105:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2713, 88 off229280 00000004:00080000:2.0:1746143768.092112:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847101971716ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092196:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2727, 88 off230696 00000004:00080000:2.0:1746143768.092202:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847102062010ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.092222:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2728, 88 off230784 00000004:00080000:2.0:1746143768.092225:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847102085474ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.092252:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2715, 88 off229464 00000004:00080000:2.0:1746143768.092256:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102115968ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092263:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2716, 88 off229552 00000004:00080000:2.0:1746143768.092265:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102125288ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092272:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2729, 88 off230872 00000004:00080000:2.0:1746143768.092274:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847102134033ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.092279:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2730, 88 off230960 00000004:00080000:2.0:1746143768.092281:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847102141435ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.092286:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2731, 88 off231048 00000004:00080000:2.0:1746143768.092288:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847102148594ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.092294:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2717, 88 off229640 00000004:00080000:2.0:1746143768.092297:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102157230ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092303:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2732, 88 off231136 00000004:00080000:2.0:1746143768.092305:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847102165865ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.092311:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2718, 88 off229728 00000004:00080000:2.0:1746143768.092314:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102173879ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092319:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2733, 88 off231224 00000004:00080000:2.0:1746143768.092321:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847102181545ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.092326:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2719, 88 off229816 00000004:00080000:2.0:1746143768.092328:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102188303ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092333:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2720, 88 off229904 00000004:00080000:2.0:1746143768.092337:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102197665ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092343:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2721, 88 off229992 00000004:00080000:2.0:1746143768.092345:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102205398ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.092350:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2722, 88 off230080 00000004:00080000:2.0:1746143768.092352:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847102212879ns, next at 788202887869ns, rc = 0 00000100:00100000:0.0:1746143768.094622:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.095030:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594330880 00000100:00100000:3.0:1746143768.095036:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594330880 00002000:00100000:3.0:1746143768.095072:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093b07480 x1830963594330880/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.095081:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07480 with x1830963594330880 ext(0->1048575) 00002000:00010000:3.0:1746143768.095085:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b07480 00000100:00100000:3.0:1746143768.095115:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6485 00000100:00100000:3.0:1746143768.095121:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594330880:12345-192.168.202.48@tcp:3:cat.0 00000040:00080000:2.0:1746143768.095599:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2734, 88 off231312 00000004:00080000:2.0:1746143768.095608:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847105467609ns, next at 833304778357ns, rc = 0 00000100:00100000:1.0:1746143768.098273:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.098292:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.098308:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594331136 00000100:00100000:1.0:1746143768.098313:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594331136 00002000:00100000:1.0:1746143768.098341:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093805f80 x1830963594331136/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.098349:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805f80 with x1830963594331136 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.098353:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805f80 00000100:00100000:1.0:1746143768.098367:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594331392 00000100:00100000:1.0:1746143768.098369:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594331392 00002000:00100000:1.0:1746143768.098377:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093804e00 x1830963594331392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.098383:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804e00 with x1830963594331392 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.098386:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804e00 00000100:00100000:1.0:1746143768.099023:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6486 00000100:00100000:1.0:1746143768.099031:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594331136:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.099315:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6487 00000100:00100000:3.0:1746143768.099332:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1963:x1830963594331392:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.100183:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.100205:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594331648 00000100:00100000:1.0:1746143768.100208:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594331648 00002000:00100000:1.0:1746143768.100231:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093807800 x1830963594331648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.100237:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963594331648 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.100241:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:1.0:1746143768.100257:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6488 00000100:00100000:1.0:1746143768.100262:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1963:x1830963594331648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.115020:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594331136:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15984us (16746us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.115030:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6486 00002000:00100000:1.0:1746143768.115039:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093805f80 x1830963594331136/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.115048:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805f80 with x1830963594331136 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.115053:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805f80 00000100:00100000:1.0:1746143768.115307:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1963:x1830963594331648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15044us (15125us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.115313:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6488 00002000:00100000:1.0:1746143768.115317:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093807800 x1830963594331648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.115324:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093807800 with x1830963594331648 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.115327:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093807800 00000100:00100000:3.0:1746143768.135413:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1963:x1830963594331392:12345-192.168.202.48@tcp:3:cat.0 Request processed in 36077us (37111us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.135422:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6487 00002000:00100000:3.0:1746143768.135431:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093804e00 x1830963594331392/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.135440:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804e00 with x1830963594331392 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.135444:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804e00 00000100:00100000:3.0:1746143768.136751:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594330880:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41626us (42131us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.136758:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6485 00002000:00100000:3.0:1746143768.136764:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093b07480 x1830963594330880/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.136772:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07480 with x1830963594330880 ext(0->1048575) 00002000:00010000:3.0:1746143768.136776:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b07480 00000100:00100000:0.0:1746143768.145546:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.145572:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594331776 00000100:00100000:0.0:1746143768.145579:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594331776 00000100:00100000:0.0:1746143768.145612:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9259 00000100:00100000:0.0:1746143768.145618:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31508:x1830963594331776:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.145636:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.145651:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80bc expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.145698:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.145709:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.145723:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.145726:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143768.145729:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.145734:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091302a00, rc 0) 00000100:00100000:0.0:1746143768.145768:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31508:x1830963594331776:12345-192.168.202.48@tcp:101:cat.0 Request processed in 150us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.145774:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9259 00000001:00080000:1.0:1746143768.172560:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943599 is committed 00000001:00080000:1.0:1746143768.172570:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943598 is committed 00000001:00080000:1.0:1746143768.172574:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943602 is committed 00000004:00080000:1.0:1746143768.172578:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2069 committed 00000004:00080000:1.0:1746143768.172584:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2057 committed 00000004:00080000:1.0:1746143768.172587:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2056 committed 00000004:00080000:1.0:1746143768.172589:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2055 committed 00000004:00080000:1.0:1746143768.172590:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2054 committed 00000004:00080000:1.0:1746143768.172593:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2068 committed 00000004:00080000:1.0:1746143768.172594:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2053 committed 00010000:00010000:0.0:1746143768.172594:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 245 pid: 20509 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746143768.172595:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2067 committed 00000004:00080000:1.0:1746143768.172597:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2052 committed 00000004:00080000:1.0:1746143768.172598:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2066 committed 00000004:00080000:1.0:1746143768.172600:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2065 committed 00000004:00080000:1.0:1746143768.172601:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2064 committed 00000004:00080000:1.0:1746143768.172602:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2051 committed 00000004:00080000:1.0:1746143768.172603:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2050 committed 00000004:00080000:1.0:1746143768.172604:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2063 committed 00000004:00080000:1.0:1746143768.172606:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2062 committed 00010000:00010000:0.0:1746143768.172606:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00000004:00080000:1.0:1746143768.172607:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2049 committed 00010000:00010000:0.0:1746143768.172608:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:1.0:1746143768.172610:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943596 is committed 00010000:00010000:0.0:1746143768.172612:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746143768.172615:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943601 is committed 00010000:00010000:0.0:1746143768.172620:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746143768.172623:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943597 is committed 00010000:00010000:0.0:1746143768.172626:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.172631:0:20509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.172637:0:20509:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.172642:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.172661:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.172672:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594408192:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143768.172729:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408064:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143768.172746:0:20509:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.172752:0:20509:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594409216:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143768.172761:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.172766:0:20509:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.172776:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.172786:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172799:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.172810:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172821:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.172832:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172840:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746143768.172844:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.172853:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172860:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.172870:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172877:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.172885:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172893:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.172902:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.172908:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408064 00000100:00100000:0.0:1746143768.172914:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408064 00000100:00100000:1.0:1746143768.172916:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594408448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.172927:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172935:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594408960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.172939:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408704 00000100:00100000:0.0:1746143768.172940:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408704 00000100:00100000:1.0:1746143768.172943:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.172950:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594409600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.172950:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409344 00000100:00100000:0.0:1746143768.172952:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409344 00000100:00100000:0.0:1746143768.172958:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409856 00000100:00100000:1.0:1746143768.172959:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.172959:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409856 00000100:00100000:1.0:1746143768.172964:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594410112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.172964:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408320 00000100:00100000:0.0:1746143768.172965:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408320 00000100:00100000:0.0:1746143768.172971:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408832 00000100:00100000:1.0:1746143768.172972:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.172972:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408832 00000100:00100000:0.0:1746143768.172977:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409472 00000100:00100000:1.0:1746143768.172978:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746143768.172979:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409472 00000100:00100000:1.0:1746143768.172981:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594408576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.172983:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409984 00000100:00100000:0.0:1746143768.172985:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409984 00000100:00100000:0.0:1746143768.172990:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408448 00000100:00100000:0.0:1746143768.172991:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408448 00000100:00100000:1.0:1746143768.172993:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.172997:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408960 00000100:00100000:0.0:1746143768.172998:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408960 00000100:00100000:1.0:1746143768.173000:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594409088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.173002:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409600 00000100:00100000:0.0:1746143768.173003:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409600 00000100:00100000:0.0:1746143768.173007:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410112 00000100:00100000:0.0:1746143768.173008:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410112 00000100:00100000:1.0:1746143768.173010:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.173016:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594409728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.173018:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408576 00000100:00100000:0.0:1746143768.173020:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408576 00000100:00100000:1.0:1746143768.173024:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.173025:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409088 00000100:00100000:0.0:1746143768.173026:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409088 00000100:00100000:1.0:1746143768.173029:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594410240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.173031:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409728 00000100:00100000:0.0:1746143768.173033:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409728 00000100:00100000:1.0:1746143768.173038:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.173040:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13713 00000100:00100000:0.0:1746143768.173045:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3294:x1830963594408064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.173049:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410240 00000100:00100000:1.0:1746143768.173051:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410240 00000100:00100000:1.0:1746143768.173064:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13714 00000100:00100000:1.0:1746143768.173068:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3294:x1830963594408704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.173091:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13715 00000100:00100000:0.0:1746143768.173095:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594409344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143768.173216:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143768.173218:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143768.173221:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143768.173222:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143768.173224:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143768.173249:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594409344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (438us total) trans 17179873157 rc 0/0 00000100:00100000:1.0:1746143768.173250:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594408704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (461us total) trans 21474840482 rc 0/0 00000100:00100000:0.0:1746143768.173255:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13715 00000100:00100000:1.0:1746143768.173258:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13714 00000100:00100000:0.0:1746143768.173267:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13716 00000100:00100000:1.0:1746143768.173270:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13717 00000100:00100000:0.0:1746143768.173271:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594409856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.173273:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3294:x1830963594408320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143768.173336:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143768.173337:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594409856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (504us total) trans 17179873158 rc 0/0 00002000:00010000:1.0:1746143768.173338:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.173340:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.173342:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143767 -> 1746143767 00000100:00100000:0.0:1746143768.173342:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13716 00002000:00010000:1.0:1746143768.173343:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143768.173350:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13718 00000100:00100000:0.0:1746143768.173353:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594408832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.173357:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594408320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (502us total) trans 21474840483 rc 0/0 00000100:00100000:1.0:1746143768.173361:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13717 00000100:00100000:1.0:1746143768.173369:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13719 00000100:00100000:1.0:1746143768.173373:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594409472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.173423:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594408832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (552us total) trans 21474840484 rc 0/0 00002000:00010000:1.0:1746143768.173425:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143768.173426:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143767 -> 1746143767 00000100:00100000:0.0:1746143768.173427:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13718 00002000:00010000:1.0:1746143768.173429:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.173430:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.173432:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143768.173436:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13720 00000100:00100000:0.0:1746143768.173440:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594409984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.173445:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594409472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (558us total) trans 17179873159 rc 0/0 00000100:00100000:1.0:1746143768.173449:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13719 00000100:00100000:1.0:1746143768.173457:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13721 00000100:00100000:1.0:1746143768.173460:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3292:x1830963594408448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.173502:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594409984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (599us total) trans 17179873160 rc 0/0 00000100:00100000:0.0:1746143768.173507:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13720 00000100:00100000:0.0:1746143768.173515:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13722 00002000:00010000:1.0:1746143768.173516:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:1.0:1746143768.173518:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143766 -> 1746143766 00000100:00100000:0.0:1746143768.173518:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594408960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143768.173520:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.173521:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143766 -> 1746143766 00002000:00010000:1.0:1746143768.173523:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5293 -> 5293 00000100:00100000:1.0:1746143768.173538:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594408448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (609us total) trans 21474840485 rc 0/0 00000100:00100000:1.0:1746143768.173542:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13721 00000100:00100000:1.0:1746143768.173549:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13723 00000100:00100000:1.0:1746143768.173552:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3292:x1830963594409600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.173583:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594408960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (638us total) trans 21474840486 rc 0/0 00000100:00100000:0.0:1746143768.173588:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13722 00000100:00100000:0.0:1746143768.173596:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13724 00000100:00100000:0.0:1746143768.173600:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594410112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143768.173601:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143768.173603:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143766 -> 1746143766 00002000:00010000:1.0:1746143768.173604:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143766 -> 1746143766 00002000:00010000:1.0:1746143768.173606:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143766 -> 1746143766 00002000:00010000:1.0:1746143768.173607:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143768.173621:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594409600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (660us total) trans 17179873161 rc 0/0 00000100:00100000:1.0:1746143768.173627:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13723 00000100:00100000:1.0:1746143768.173634:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13725 00000100:00100000:1.0:1746143768.173638:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3292:x1830963594408576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.173662:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594410112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (688us total) trans 17179873162 rc 0/0 00000100:00100000:0.0:1746143768.173666:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13724 00000100:00100000:0.0:1746143768.173674:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13726 00000100:00100000:0.0:1746143768.173678:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594409088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.173695:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594408576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (700us total) trans 21474840487 rc 0/0 00000100:00100000:1.0:1746143768.173699:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13725 00000100:00100000:1.0:1746143768.173705:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13727 00000100:00100000:1.0:1746143768.173709:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3292:x1830963594409728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.173742:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594409088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (730us total) trans 21474840488 rc 0/0 00000100:00100000:0.0:1746143768.173746:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13726 00002000:00010000:1.0:1746143768.173752:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143768.173754:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00000100:00100000:0.0:1746143768.173754:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13728 00002000:00010000:1.0:1746143768.173755:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143768.173757:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00000100:00100000:0.0:1746143768.173757:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594410240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143768.173758:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143768.173771:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594409728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (746us total) trans 17179873163 rc 0/0 00000100:00100000:1.0:1746143768.173775:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13727 00000004:00080000:1.0:1746143768.173807:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe6c380/2, rc 0, transno 21474840487 00000100:00100000:1.0:1746143768.173814:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594408576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.173817:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3292:x1830963594410240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (777us total) trans 17179873164 rc 0/0 00000004:00080000:1.0:1746143768.173821:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe6d180/2, rc 0, transno 21474840488 00000100:00100000:0.0:1746143768.173822:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13728 00000100:00100000:1.0:1746143768.173824:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594409088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.173831:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090767b80/2, rc 0, transno 17179873163 00000100:00100000:1.0:1746143768.173833:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594409728:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.173840:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094306300/2, rc 0, transno 17179873164 00000100:00100000:1.0:1746143768.173842:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594410240:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.173847:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe6c000/2, rc 0, transno 21474840485 00000100:00100000:1.0:1746143768.173849:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594408448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.173854:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe6ce00/2, rc 0, transno 21474840486 00000100:00100000:1.0:1746143768.173857:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594408960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.173862:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090764380/2, rc 0, transno 17179873161 00000100:00100000:1.0:1746143768.173864:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594409600:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.173869:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b851180/2, rc 0, transno 17179873162 00000100:00100000:1.0:1746143768.173872:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594410112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.173906:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746143768.173911:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594410368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.173926:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143768.173928:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143768.173931:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143768.173932:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143768.173934:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143768.173936:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2065 -> 2063 00000100:00100000:0.0:1746143768.173952:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594408064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 907us (1192us total) trans 21474840489 rc 0/0 00000100:00100000:0.0:1746143768.173956:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13713 00000100:00100000:0.0:1746143768.173964:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410368 00000100:00100000:0.0:1746143768.173966:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410368 00000100:00100000:0.0:1746143768.173976:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13729 00000100:00100000:0.0:1746143768.173980:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3295:x1830963594410368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.174049:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3295:x1830963594410368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (121us total) trans 21474840490 rc 0/0 00000100:00100000:0.0:1746143768.174053:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13729 00000004:00080000:0.0:1746143768.174072:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a0e00/2, rc 0, transno 21474840490 00000100:00100000:0.0:1746143768.174075:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594410368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.174091:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093805500/2, rc 0, transno 21474840483 00000100:00100000:0.0:1746143768.174093:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.174099:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe6ca80/2, rc 0, transno 21474840484 00000100:00100000:0.0:1746143768.174102:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408832:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.174108:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b04380/2, rc 0, transno 17179873159 00000100:00100000:0.0:1746143768.174111:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143768.174117:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b850700/2, rc 0, transno 17179873160 00000100:00100000:0.0:1746143768.174119:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143768.174124:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b852a00/2, rc 0, transno 17179873158 00000100:00100000:0.0:1746143768.174126:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b852a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143768.174131:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093b05880/2, rc 0, transno 17179873157 00000100:00100000:0.0:1746143768.174133:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594409344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143768.174155:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093804a80/2, rc 0, transno 21474840489 00000100:00100000:0.0:1746143768.174157:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143768.174178:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fe6c700/2, rc 0, transno 21474840482 00000100:00100000:0.0:1746143768.174181:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594408704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.177404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.177440:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594408192:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143768.177449:0:20509:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20509:1830963594409216:192.168.202.48@tcp:105: 00010000:00010000:0.0:1746143768.177479:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793600/0xe984082ccd730a08 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 244 pid: 20509 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143768.177495:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.177524:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793e00, rc 0) 00000100:00100000:0.0:1746143768.177560:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31501:x1830963594330240:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 91348us (91530us total) trans 8589943602 rc 0/0 00000100:00100000:0.0:1746143768.177567:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9257 00000100:00100000:0.0:1746143768.177594:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594331904 00000100:00100000:0.0:1746143768.177598:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594331904 00000100:00100000:0.0:1746143768.177623:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3990 00000100:00100000:0.0:1746143768.177628:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31508:x1830963594331904:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143768.177680:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31508:x1830963594331904:12345-192.168.202.48@tcp:49:cat.0 Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.177685:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3990 00000100:00100000:0.0:1746143768.177797:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.177852:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.177969:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594332032 00000100:00100000:0.0:1746143768.177974:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594332032 00000100:00100000:0.0:1746143768.178001:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3991 00000100:00100000:0.0:1746143768.178005:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31505:x1830963594332032:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143768.178049:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31505:x1830963594332032:12345-192.168.202.48@tcp:49:cat.0 Request processed in 42us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.178054:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3991 00000100:00100000:0.0:1746143768.178103:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594332160 00000100:00100000:0.0:1746143768.178106:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594332160 00000100:00100000:0.0:1746143768.178389:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9260 00000100:00100000:0.0:1746143768.178396:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31502:x1830963594332160:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143768.178406:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.178416:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a008600/0xe984082ccd730a24 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80c3 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.178446:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a008600/0xe984082ccd730a24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80c3 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.178456:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a008600/0xe984082ccd730a24 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80c3 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.178473:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.178475:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143768.178477:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a008600, rc 0) 00000100:00100000:0.0:1746143768.178507:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31502:x1830963594332160:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 102us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.178512:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9260 00000100:00100000:2.0:1746143768.186156:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.186400:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594332288 00000100:00100000:3.0:1746143768.186407:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594332288 00000100:00100000:3.0:1746143768.186449:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 745 00000100:00100000:3.0:1746143768.186455:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594332288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.186466:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.186486:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a008600/0xe984082ccd730a24 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80c3 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.186498:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.186502:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.186543:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1962:x1830963594332288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 87us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.186549:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 745 00000100:00100000:0.0:1746143768.187225:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.187244:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594332416 00000100:00100000:0.0:1746143768.187248:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594332416 00000100:00100000:0.0:1746143768.187279:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13730 00000100:00100000:0.0:1746143768.187284:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31502:x1830963594332416:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143768.187296:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.187306:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80ca expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.187326:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 40 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.187339:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.187344:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.187345:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.187348:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.187370:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 28 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.187379:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 28 pid: 9527 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.187390:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594410496:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.188457:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 40 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.188467:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 40 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.188476:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594410624:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.188506:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.189906:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.189953:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594332672 00000100:00100000:3.0:1746143768.189960:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594332672 00000100:00100000:0.0:1746143768.189980:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143768.189990:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009c3f9880 x1830963594332672/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.189999:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830963594332672 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.190002:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000100:00100000:3.0:1746143768.190019:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6489 00000100:00100000:3.0:1746143768.190025:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594332672:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143768.190209:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594410496:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.191044:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594332800 00000100:00100000:3.0:1746143768.191047:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594332800 00010000:00010000:3.0:1746143768.191062:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 30 pid: 9527 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.191080:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7365 00000100:00100000:3.0:1746143768.191084:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594332800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.191091:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.191104:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 30 pid: 9527 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.191113:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 30 pid: 9527 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.191127:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc33800/0xe984082ccd7309e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8092 expref: 30 pid: 9527 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.191136:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.191201:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594332800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.191207:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7365 00000100:00100000:0.0:1746143768.191622:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.191676:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.191721:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594410624:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143768.191742:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.191753:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a008800, rc 0) 00000100:00100000:1.0:1746143768.191775:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31502:x1830963594332416:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4491us (4552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.191782:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13730 00000100:00100000:1.0:1746143768.191796:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594332928 00000100:00100000:1.0:1746143768.191798:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594332928 00000100:00100000:1.0:1746143768.191826:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13731 00000100:00100000:1.0:1746143768.191831:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:31501:x1830963594332928:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143768.191840:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.191849:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80d1 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.191861:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.191865:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.191870:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.191873:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1634304->2097151] (req 1634304->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 42 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.191894:0:8496:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.191903:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1634304->2097151] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 42 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.191909:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f5d800, rc 0) 00000100:00100000:1.0:1746143768.191926:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:31501:x1830963594332928:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.191931:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13731 00000100:00100000:2.0:1746143768.192822:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594333056 00000100:00100000:2.0:1746143768.192826:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594333056 00010000:00010000:2.0:1746143768.192844:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 42 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.192879:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7366 00000100:00100000:2.0:1746143768.192885:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594333056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.192893:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.192908:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 42 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.192918:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 42 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.192932:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090857200/0xe984082ccd730983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a805a expref: 42 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.192941:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.192943:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.192949:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.192956:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.192976:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.192986:0:9890:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 28 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.192997:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594410880:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.193058:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.196807:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.196847:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594333184 00000100:00100000:1.0:1746143768.196854:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594333184 00000100:00100000:1.0:1746143768.196897:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13732 00000100:00100000:1.0:1746143768.196905:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963594333184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.196917:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.197077:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f5d000/0xe984082ccd730a39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80d8 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.197120:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594411008:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143768.197579:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.198990:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.199031:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594410880:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.199044:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.199071:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1965:x1830963594333056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6186us (7394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.199079:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7366 00000100:00100000:3.0:1746143768.199092:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594333440 00000100:00100000:3.0:1746143768.199097:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594333440 00002000:00100000:3.0:1746143768.199122:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1990656->1994751) req@ffff88012f184380 x1830963594333440/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.199551:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184380 with x1830963594333440 ext(1990656->1994751) 00010000:00010000:3.0:1746143768.199558:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.199563:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594411008:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143768.199569:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.199574:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f184380 00010000:00010000:1.0:1746143768.199579:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f5d000/0xe984082ccd730a39 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d8 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.199587:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d000/0xe984082ccd730a39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d8 expref: 42 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143768.199588:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1832 00000100:00100000:3.0:1746143768.199593:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594333440:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:1.0:1746143768.199595:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f5d000, rc 0) 00000100:00100000:1.0:1746143768.199630:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963594333184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2727us (2828us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143768.199636:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13732 00000100:00100000:3.0:1746143768.200060:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594333440:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 465us (1071us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.200066:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1832 00002000:00100000:3.0:1746143768.200071:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1990656->1994751) req@ffff88012f184380 x1830963594333440/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.200084:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184380 with x1830963594333440 ext(1990656->1994751) 00010000:00010000:3.0:1746143768.200089:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.200098:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.200104:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f184380 00000100:00100000:3.0:1746143768.200398:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594332672:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10372us (10493us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.200404:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6489 00002000:00100000:3.0:1746143768.200409:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009c3f9880 x1830963594332672/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.200415:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3f9880 with x1830963594332672 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.200418:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3f9880 00000001:00080000:2.0:1746143768.201720:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840457 is committed 00000001:00080000:2.0:1746143768.201734:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840424 is committed 00000001:00080000:2.0:1746143768.201790:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840481 is committed 00000001:00080000:2.0:1746143768.201809:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840472 is committed 00000001:00080000:2.0:1746143768.201816:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840470 is committed 00000001:00080000:2.0:1746143768.201866:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840439 is committed 00000100:00100000:0.0:1746143768.202405:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.202465:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594333824 00000100:00100000:3.0:1746143768.202470:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594333824 00002000:00100000:3.0:1746143768.202500:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1990656->2097151) req@ffff88009c3faa00 x1830963594333824/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.202508:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963594333824 ext(1990656->2097151) 00010000:00010000:3.0:1746143768.202514:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 27 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.202526:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 27 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.202533:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3faa00 00000100:00100000:3.0:1746143768.202547:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1833 00000100:00100000:3.0:1746143768.202553:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594333824:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143768.203460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.203497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.203498:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594334080 00000100:00100000:1.0:1746143768.203502:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594334080 00000100:00100000:1.0:1746143768.203524:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13733 00000100:00100000:1.0:1746143768.203529:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31502:x1830963594334080:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143768.203538:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.203550:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80df expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.203568:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 15 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.203579:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.203585:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.203586:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.203589:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->1978367] (req 1048576->1978367) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 9 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.203602:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594333952 00000100:00100000:2.0:1746143768.203605:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594333952 00010000:00010000:1.0:1746143768.203611:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 9 pid: 6929 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746143768.203619:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4767744->4771839) req@ffff8800930ddf80 x1830963594333952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746143768.203620:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 9 pid: 6929 timeout: 947 lvb_type: 1 00002000:00100000:2.0:1746143768.203626:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963594333952 ext(4767744->4771839) 00002000:00010000:2.0:1746143768.203630:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ddf80 00000100:00100000:1.0:1746143768.203630:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594411136:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.203641:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6490 00000100:00100000:2.0:1746143768.203644:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594333952:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143768.203693:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 16 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.203700:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 16 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.203707:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594411264:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.203723:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.203749:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594333952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 103us (252us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143768.203763:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6490 00002000:00100000:2.0:1746143768.203768:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4767744->4771839) req@ffff8800930ddf80 x1830963594333952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.203774:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930ddf80 with x1830963594333952 ext(4767744->4771839) 00002000:00010000:2.0:1746143768.203777:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930ddf80 00000100:00100000:3.0:1746143768.205707:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594333824:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3147us (3299us total) trans 17179873165 rc 0/0 00000100:00100000:3.0:1746143768.205717:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1833 00002000:00100000:3.0:1746143768.205729:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1990656->2097151) req@ffff88009c3faa00 x1830963594333824/t17179873165(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.205738:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3faa00 with x1830963594333824 ext(1990656->2097151) 00010000:00010000:3.0:1746143768.205745:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.205756:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.205762:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c3faa00 00000100:00100000:1.0:1746143768.206005:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594411136:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.206016:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594411264:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143768.206036:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->1978367] (req 1048576->1978367) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 9 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.206049:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948cf800, rc 0) 00000100:00100000:1.0:1746143768.206070:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31502:x1830963594334080:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2540us (2611us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.206076:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13733 00000100:00100000:0.0:1746143768.207000:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.207036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.207079:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594334336 00000100:00100000:3.0:1746143768.207084:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594334336 00010000:00010000:3.0:1746143768.207105:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 16 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.207123:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594334208 00000100:00100000:3.0:1746143768.207125:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594334208 00010000:00010000:3.0:1746143768.207132:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 9 pid: 6929 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.207180:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7367 00000100:00100000:3.0:1746143768.207187:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594334336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143768.207189:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7368 00000100:00100000:0.0:1746143768.207194:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594334208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.207197:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.207199:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.207212:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 9 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.207213:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 16 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.207221:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 16 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.207297:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 9 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.207314:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc32a00/0xe984082ccd7309f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8099 expref: 9 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.207321:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792800/0xe984082ccd73098a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8061 expref: 16 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.207324:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.207325:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.207331:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 8 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.207337:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 8 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.207349:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143768.207365:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 8 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.207375:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594411392:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.207503:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1964:x1830963594334336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 316us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.207510:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7367 00000100:00100000:0.0:1746143768.207520:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.208407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.208549:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.208599:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594334464 00000100:00100000:3.0:1746143768.208603:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594334464 00010000:00010000:3.0:1746143768.208622:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.208663:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594334720 00000100:00100000:2.0:1746143768.208666:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594334720 00000100:00100000:2.0:1746143768.208690:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3992 00000100:00100000:2.0:1746143768.208695:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31505:x1830963594334720:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143768.208727:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7369 00000100:00100000:3.0:1746143768.208732:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594334464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.208740:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143768.208740:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594411392:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143768.208751:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143768.208754:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.208762:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.208769:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594334208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1576us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.208774:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7368 00010000:00010000:3.0:1746143768.208775:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a008800/0xe984082ccd730a2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ca expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.208784:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.208785:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.208789:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.208797:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.208921:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.208930:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594411520:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.208977:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.209214:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31505:x1830963594334720:12345-192.168.202.48@tcp:35:cat.0 Request processed in 518us (664us total) trans 8589943603 rc 0/0 00000100:00100000:2.0:1746143768.209219:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3992 00000100:00100000:0.0:1746143768.209724:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.209767:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594334848 00000100:00100000:1.0:1746143768.209770:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594334848 00000100:00100000:1.0:1746143768.209791:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13734 00000100:00100000:1.0:1746143768.209795:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31508:x1830963594334848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.209803:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.209958:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80e6 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.209978:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.209984:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.209986:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.209989:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 30 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.210005:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 40 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.210015:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 40 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.210024:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594411648:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.210068:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.210222:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594411520:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.210233:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.210262:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1963:x1830963594334464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1528us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.210269:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7369 00000100:00100000:0.0:1746143768.212090:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.212230:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594335104 00000100:00100000:3.0:1746143768.212236:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594335104 00002000:00100000:3.0:1746143768.212266:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1634304->1638399) req@ffff88012ba28000 x1830963594335104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.212275:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28000 with x1830963594335104 ext(1634304->1638399) 00010000:00010000:3.0:1746143768.212281:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 41 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.212293:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 41 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.212298:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba28000 00000100:00100000:1.0:1746143768.212309:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594411648:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.212311:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1834 00000100:00100000:3.0:1746143768.212317:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594335104:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143768.212326:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 29 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.212453:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594335104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 136us (368us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.212459:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1834 00002000:00100000:3.0:1746143768.212464:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1634304->1638399) req@ffff88012ba28000 x1830963594335104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.212470:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28000 with x1830963594335104 ext(1634304->1638399) 00010000:00010000:3.0:1746143768.212475:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 41 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.212483:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 41 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.212492:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba28000 00010000:00010000:1.0:1746143768.212541:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d2800, rc 0) 00000100:00100000:1.0:1746143768.212562:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31508:x1830963594334848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2766us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.212568:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13734 00000100:00100000:0.0:1746143768.217409:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.217455:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.217492:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.217493:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594335360 00000100:00100000:2.0:1746143768.217501:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594335360 00000100:00100000:3.0:1746143768.217524:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594335616 00000100:00100000:3.0:1746143768.217528:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594335616 00002000:00100000:2.0:1746143768.217534:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1974272->1978367) req@ffff88012ba28380 x1830963594335360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.217543:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28380 with x1830963594335360 ext(1974272->1978367) 00002000:00100000:3.0:1746143768.217546:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1634304->2097151) req@ffff88012ba28700 x1830963594335616/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746143768.217547:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba28380 00002000:00100000:3.0:1746143768.217554:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28700 with x1830963594335616 ext(1634304->2097151) 00010000:00010000:3.0:1746143768.217561:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 41 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.217565:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6491 00010000:00010000:3.0:1746143768.217571:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 41 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.217571:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594335360:12345-192.168.202.48@tcp:3:multiop.0 00002000:00010000:3.0:1746143768.217577:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba28700 00000100:00100000:3.0:1746143768.217590:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1835 00000100:00100000:3.0:1746143768.217595:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1963:x1830963594335616:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143768.217639:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594335744 00000100:00100000:1.0:1746143768.217643:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594335744 00000100:00100000:2.0:1746143768.217715:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594335360:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 143us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143768.217721:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6491 00002000:00100000:2.0:1746143768.217726:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1974272->1978367) req@ffff88012ba28380 x1830963594335360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.217732:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28380 with x1830963594335360 ext(1974272->1978367) 00002000:00010000:2.0:1746143768.217735:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba28380 00000100:00100000:1.0:1746143768.217762:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13735 00000100:00100000:1.0:1746143768.217768:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:31501:x1830963594335744:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143768.217776:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.217787:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80ed expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.217810:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 7 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.217817:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.217819:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.217823:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.217844:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 7 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.217852:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 7 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.217861:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594411776:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.217917:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.219890:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594411776:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.219910:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.219924:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d2a00, rc 0) 00000100:00100000:2.0:1746143768.219957:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31501:x1830963594335744:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2187us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.219963:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13735 00000100:00100000:0.0:1746143768.220797:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.220833:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.220901:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594336000 00000100:00100000:1.0:1746143768.220907:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594336000 00002000:00100000:1.0:1746143768.220933:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1978367) req@ffff88012ba28e00 x1830963594336000/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.220942:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28e00 with x1830963594336000 ext(1048576->1978367) 00010000:00010000:1.0:1746143768.220947:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 8 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.220957:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 8 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:1.0:1746143768.220963:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba28e00 00000100:00100000:1.0:1746143768.220978:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1836 00000100:00100000:1.0:1746143768.220984:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1965:x1830963594336000:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143768.221324:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594336256 00000100:00100000:3.0:1746143768.221328:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594336256 00000100:00100000:3.0:1746143768.221350:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3993 00000100:00100000:3.0:1746143768.221355:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31502:x1830963594336256:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143768.221502:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31502:x1830963594336256:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 146us (667us total) trans 8589943604 rc 0/0 00000100:00100000:3.0:1746143768.221507:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3993 00000100:00100000:3.0:1746143768.224279:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1963:x1830963594335616:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6674us (6814us total) trans 17179873166 rc 0/0 00000100:00100000:3.0:1746143768.224294:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1835 00002000:00100000:3.0:1746143768.224303:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1634304->2097151) req@ffff88012ba28700 x1830963594335616/t17179873166(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.224312:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28700 with x1830963594335616 ext(1634304->2097151) 00010000:00010000:3.0:1746143768.224322:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 43 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.224333:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 43 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.224340:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba28700 00000100:00100000:2.0:1746143768.227515:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.227671:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594336384 00000100:00100000:3.0:1746143768.227679:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594336384 00010000:00010000:3.0:1746143768.227708:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 43 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.227748:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7370 00000100:00100000:3.0:1746143768.227755:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1964:x1830963594336384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.227795:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.227818:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 43 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.227828:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 43 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.227850:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f5d800/0xe984082ccd730a32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80d1 expref: 43 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.227871:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.227873:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.227880:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.227889:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.227917:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.227929:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594411904:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.227997:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.229567:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594411904:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.229582:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.229618:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963594336384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1863us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.229625:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7370 00000100:00100000:0.0:1746143768.231105:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.231179:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594336640 00000100:00100000:3.0:1746143768.231184:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594336640 00002000:00100000:3.0:1746143768.231208:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012ba29500 x1830963594336640/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.231222:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29500 with x1830963594336640 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.231225:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba29500 00000100:00100000:3.0:1746143768.231382:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6492 00000100:00100000:3.0:1746143768.231388:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594336640:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143768.234123:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594336000:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 13131us (13320us total) trans 21474840491 rc 0/0 00000100:00100000:1.0:1746143768.234132:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1836 00002000:00100000:1.0:1746143768.234158:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1978367) req@ffff88012ba28e00 x1830963594336000/t21474840491(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.234378:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28e00 with x1830963594336000 ext(1048576->1978367) 00010000:00010000:1.0:1746143768.234388:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 10 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.234401:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 10 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:1.0:1746143768.234407:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba28e00 00000100:00100000:0.0:1746143768.237395:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.237518:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594336768 00000100:00100000:3.0:1746143768.237526:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594336768 00010000:00010000:3.0:1746143768.237561:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 10 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.237584:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7371 00000100:00100000:3.0:1746143768.237591:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594336768:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.237603:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.237619:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 10 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.237630:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 10 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.237649:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948cf800/0xe984082ccd730a40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1978367) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80df expref: 10 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.237666:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.237669:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.237675:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.237687:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.237714:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.237724:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594412032:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.237797:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.237824:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594336640:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 6434us (6718us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.237832:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6492 00002000:00100000:2.0:1746143768.237839:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012ba29500 x1830963594336640/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.237848:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29500 with x1830963594336640 ext(1048576->2097151) 00002000:00010000:2.0:1746143768.237851:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba29500 00000100:00100000:0.0:1746143768.242884:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.242971:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594336896 00000100:00100000:3.0:1746143768.242985:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594412032:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.243004:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.243013:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594336896 00000100:00100000:3.0:1746143768.243040:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594336768:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5449us (5652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.243048:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7371 00000100:00100000:2.0:1746143768.243069:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13736 00000100:00100000:2.0:1746143768.243076:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31508:x1830963594336896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.243201:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.243215:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80f4 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.243237:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.243244:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143768.243245:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143768.243248:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 10 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.243250:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143768.243270:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 15 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.243280:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 15 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.243290:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594412160:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.243342:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594337152 00000100:00100000:3.0:1746143768.243345:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594337152 00000100:00100000:2.0:1746143768.243345:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3a80 going to sleep for 11 seconds 00002000:00100000:3.0:1746143768.243368:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1433600->1437695) req@ffff88012ba29f80 x1830963594337152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.243376:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29f80 with x1830963594337152 ext(1433600->1437695) 00010000:00010000:3.0:1746143768.243381:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.243391:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.243401:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba29f80 00000100:00100000:3.0:1746143768.243416:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1837 00000100:00100000:3.0:1746143768.243421:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594337152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.243661:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594337152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 238us (410us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.243667:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1837 00002000:00100000:3.0:1746143768.243672:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1433600->1437695) req@ffff88012ba29f80 x1830963594337152/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.243678:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29f80 with x1830963594337152 ext(1433600->1437695) 00010000:00010000:3.0:1746143768.243683:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.243691:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.243696:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba29f80 00000100:00100000:2.0:1746143768.246685:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594412160:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.246711:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 10 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.246726:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800953a3c00, rc 0) 00000100:00100000:2.0:1746143768.246770:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31508:x1830963594336896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3693us (3892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.246778:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13736 00000100:00100000:0.0:1746143768.250860:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.251233:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594337408 00000100:00100000:3.0:1746143768.251241:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594337408 00002000:00100000:3.0:1746143768.251281:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1437695) req@ffff88012ba2a300 x1830963594337408/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.251289:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2a300 with x1830963594337408 ext(1048576->1437695) 00010000:00010000:3.0:1746143768.251297:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.251315:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 16 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.251321:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba2a300 00000100:00100000:3.0:1746143768.251357:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1838 00000100:00100000:3.0:1746143768.251364:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594337408:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143768.256642:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594337408:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5270us (5779us total) trans 21474840492 rc 0/0 00000100:00100000:3.0:1746143768.256653:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1838 00002000:00100000:3.0:1746143768.256663:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1437695) req@ffff88012ba2a300 x1830963594337408/t21474840492(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.256672:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2a300 with x1830963594337408 ext(1048576->1437695) 00010000:00010000:3.0:1746143768.256785:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 18 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.256801:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 18 pid: 8496 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.256807:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba2a300 00000100:00100000:0.0:1746143768.258269:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.258348:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594337536 00000100:00100000:3.0:1746143768.258355:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594337536 00010000:00010000:3.0:1746143768.258379:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 18 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.258441:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7372 00000100:00100000:3.0:1746143768.258447:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594337536:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.258458:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143768.258472:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143767 -> 1746143768 00002000:00010000:3.0:1746143768.258474:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143767 -> 1746143768 00010000:00010000:3.0:1746143768.258479:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 18 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.258488:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 18 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.258593:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d2a00/0xe984082ccd730a4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ed expref: 18 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.258609:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.258611:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.258720:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 9 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.258727:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 9 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.258755:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 9 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.258771:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594412288:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.258844:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.260757:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594412288:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.260774:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.260810:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594337536:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2362us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.260817:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7372 00000100:00100000:0.0:1746143768.261740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.261791:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594337792 00000100:00100000:3.0:1746143768.261797:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594337792 00002000:00100000:3.0:1746143768.261826:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012ba2a680 x1830963594337792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.261836:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2a680 with x1830963594337792 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.261839:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2a680 00000100:00100000:3.0:1746143768.261870:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6493 00000100:00100000:3.0:1746143768.261876:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594337792:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143768.269083:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594337792:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7198us (7336us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.269094:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6493 00002000:00100000:3.0:1746143768.269104:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012ba2a680 x1830963594337792/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.269112:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2a680 with x1830963594337792 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.269117:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2a680 00000100:00100000:0.0:1746143768.284430:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.284472:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.284526:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.284591:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594338048 00000100:00100000:2.0:1746143768.284599:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594338048 00000100:00100000:1.0:1746143768.284599:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594338304 00000100:00100000:1.0:1746143768.284603:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594338304 00002000:00100000:2.0:1746143768.284637:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012ba2aa00 x1830963594338048/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.284646:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2aa00 with x1830963594338048 ext(2097152->3145727) 00002000:00010000:2.0:1746143768.284651:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2aa00 00000100:00100000:2.0:1746143768.284669:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594338560 00000100:00100000:2.0:1746143768.284671:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594338560 00000100:00100000:3.0:1746143768.284728:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6494 00000100:00100000:3.0:1746143768.284736:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594338048:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143768.284980:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012ba2ad80 x1830963594338304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.284981:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012ba2b100 x1830963594338560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.284987:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2ad80 with x1830963594338304 ext(3145728->4194303) 00002000:00100000:2.0:1746143768.284989:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2b100 with x1830963594338560 ext(2097152->3145727) 00002000:00010000:1.0:1746143768.284989:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2ad80 00002000:00010000:2.0:1746143768.284992:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba2b100 00000100:00100000:1.0:1746143768.285012:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6495 00000100:00100000:2.0:1746143768.285017:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6496 00000100:00100000:1.0:1746143768.285018:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594338304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.285022:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1963:x1830963594338560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143768.285446:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.285458:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594338688 00000100:00100000:0.0:1746143768.285461:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594338688 00002000:00100000:0.0:1746143768.285476:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012ba2b480 x1830963594338688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.285482:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2b480 with x1830963594338688 ext(3145728->4194303) 00002000:00010000:0.0:1746143768.285484:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba2b480 00000100:00100000:0.0:1746143768.285495:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6497 00000100:00100000:0.0:1746143768.285499:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594338688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.286482:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594412416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143768.286518:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.286555:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412416 00000100:00100000:2.0:1746143768.286558:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412416 00000100:00100000:2.0:1746143768.286594:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1746143768.286599:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594412416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143768.286612:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 601686016 pending 3407872 free 3852468224 avail 3830448128 00000100:00100000:2.0:1746143768.286643:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594412416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.286652:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1746143768.286679:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840481 gen 2 00000004:00080000:2.0:1746143768.286683:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d3100, transno 21474840415 00000004:00080000:2.0:1746143768.286689:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2680, transno 21474840416 00000004:00080000:2.0:1746143768.286691:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b06300, transno 21474840417 00000004:00080000:2.0:1746143768.286694:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d2d80, transno 21474840418 00000004:00080000:2.0:1746143768.286696:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b04a80, transno 21474840419 00000004:00080000:2.0:1746143768.286697:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d0000, transno 21474840420 00000004:00080000:2.0:1746143768.286699:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b07800, transno 21474840421 00000004:00080000:2.0:1746143768.286701:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930d1500, transno 21474840422 00000004:00080000:2.0:1746143768.286703:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a04cf100, transno 21474840423 00000004:00080000:2.0:1746143768.286705:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a04cf480, transno 21474840428 00000004:00080000:2.0:1746143768.286706:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0879180, transno 21474840429 00000004:00080000:2.0:1746143768.286708:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a04cce00, transno 21474840430 00000004:00080000:2.0:1746143768.286710:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a0a80, transno 21474840431 00000004:00080000:2.0:1746143768.286713:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a04cdc00, transno 21474840432 00000004:00080000:2.0:1746143768.286715:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a04cd500, transno 21474840433 00000004:00080000:2.0:1746143768.286717:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a04cea00, transno 21474840434 00000004:00080000:2.0:1746143768.286719:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a04ced80, transno 21474840435 00000004:00080000:2.0:1746143768.286721:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f01500, transno 21474840436 00000004:00080000:2.0:1746143768.286723:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd6680, transno 21474840440 00000004:00080000:2.0:1746143768.286725:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd6d80, transno 21474840441 00000004:00080000:2.0:1746143768.286727:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd4a80, transno 21474840442 00000004:00080000:2.0:1746143768.286729:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd5f80, transno 21474840443 00000004:00080000:2.0:1746143768.286731:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd7800, transno 21474840444 00000004:00080000:2.0:1746143768.286733:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd4700, transno 21474840445 00000004:00080000:2.0:1746143768.286736:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd5c00, transno 21474840446 00000004:00080000:2.0:1746143768.286738:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd7480, transno 21474840447 00000004:00080000:2.0:1746143768.286741:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dc000, transno 21474840448 00000004:00080000:2.0:1746143768.286743:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dd180, transno 21474840449 00000004:00080000:2.0:1746143768.286745:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ddc00, transno 21474840450 00000004:00080000:2.0:1746143768.286747:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930ded80, transno 21474840451 00000004:00080000:2.0:1746143768.286749:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767480, transno 21474840452 00000004:00080000:2.0:1746143768.286751:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930df800, transno 21474840453 00000004:00080000:2.0:1746143768.286753:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090766a00, transno 21474840454 00000004:00080000:2.0:1746143768.286755:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800930dea00, transno 21474840455 00000004:00080000:2.0:1746143768.286757:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090766300, transno 21474840456 00000004:00080000:2.0:1746143768.286759:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3ca300, transno 21474840457 00000004:00080000:2.0:1746143768.286761:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79ed80, transno 21474840473 00000004:00080000:2.0:1746143768.286763:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79fb80, transno 21474840474 00000004:00080000:2.0:1746143768.286765:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79e300, transno 21474840475 00000004:00080000:2.0:1746143768.286767:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79ce00, transno 21474840476 00000004:00080000:2.0:1746143768.286769:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79ca80, transno 21474840477 00000004:00080000:2.0:1746143768.286770:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f100, transno 21474840478 00000004:00080000:2.0:1746143768.286772:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79d500, transno 21474840479 00000004:00080000:2.0:1746143768.286774:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79df80, transno 21474840480 00000004:00080000:2.0:1746143768.286776:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093804380, transno 21474840481 00000100:00100000:2.0:1746143768.286781:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008fe6c700 x1830963594408704/t21474840482(21474840482) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143784 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:2.0:1746143768.286793:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594412416:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1746143768.287074:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 9 in progress, 0 in flight, 45 done 00000100:00100000:3.0:1746143768.297107:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1963:x1830963594338560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12074us (12571us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.297118:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6496 00002000:00100000:3.0:1746143768.297129:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012ba2b100 x1830963594338560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.297155:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2b100 with x1830963594338560 ext(2097152->3145727) 00002000:00010000:3.0:1746143768.297170:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba2b100 00000100:00100000:1.0:1746143768.301445:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963594412544:0@lo:400:kworker.0 00000100:00100000:1.0:1746143768.301497:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.301801:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963594412800:0@lo:400:kworker.0 00000100:00100000:0.0:1746143768.301826:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143768.301869:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412800 00000100:00100000:0.0:1746143768.301875:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412800 00000100:00100000:0.0:1746143768.301906:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1746143768.301911:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963594412800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143768.301942:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963594412800:12345-0@lo:400:kworker.0 Request processed in 30us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.301947:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1746143768.301974:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963594412800:0@lo:400:kworker.0 00000100:00100000:1.0:1746143768.302083:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143768.302088:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963594412672:0@lo:400:kworker.0 00000100:00100000:1.0:1746143768.302108:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.302413:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412544 00000100:00100000:3.0:1746143768.302417:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412544 00000100:00100000:3.0:1746143768.302437:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1746143768.302441:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3292:x1830963594412544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143768.302466:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3292:x1830963594412544:12345-0@lo:400:kworker.0 Request processed in 25us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.302470:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1746143768.302492:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830963594412928:0@lo:400:kworker.0 00000100:00100000:1.0:1746143768.302581:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b20e2be-dc58-49ff-81b7-9c0574412294:3292:1830963594412544:0@lo:400:kworker.0 00000100:00080000:1.0:1746143768.302597:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143768.302634:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594338688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17132us (17186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.302642:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6497 00002000:00100000:2.0:1746143768.302651:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012ba2b480 x1830963594338688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.302665:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2b480 with x1830963594338688 ext(3145728->4194303) 00002000:00010000:2.0:1746143768.302670:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba2b480 00000100:00100000:2.0:1746143768.302692:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.302713:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412672 00000100:00100000:2.0:1746143768.302716:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412672 00000100:00100000:2.0:1746143768.302747:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412928 00000100:00100000:2.0:1746143768.302750:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412928 00000100:00080000:1.0:1746143768.302752:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143768.302761:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1746143768.302765:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963594412672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143768.302865:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1830963594412672:12345-0@lo:400:kworker.0 Request processed in 99us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.302870:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1746143768.302881:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1746143768.302885:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830963594412928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143768.302902:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830963594412928:12345-0@lo:400:kworker.0 Request processed in 17us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.302906:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1746143768.302926:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830963594412928:0@lo:400:kworker.0 00000100:00100000:1.0:1746143768.303027:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3292:1830963594412672:0@lo:400:kworker.0 00000100:00100000:3.0:1746143768.304079:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1963:x1830963594338048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19340us (19653us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.304086:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6494 00002000:00100000:3.0:1746143768.304092:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012ba2aa00 x1830963594338048/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.304099:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2aa00 with x1830963594338048 ext(2097152->3145727) 00002000:00010000:3.0:1746143768.304103:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2aa00 00000100:00100000:1.0:1746143768.305450:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594338304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20427us (20973us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.305458:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6495 00002000:00100000:1.0:1746143768.305464:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012ba2ad80 x1830963594338304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.305472:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2ad80 with x1830963594338304 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.305475:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2ad80 00000100:00100000:0.0:1746143768.311432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.311505:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594339072 00000100:00100000:1.0:1746143768.311514:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594339072 00002000:00100000:1.0:1746143768.311552:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012ba2bb80 x1830963594339072/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.311562:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2bb80 with x1830963594339072 ext(4194304->4771839) 00002000:00010000:1.0:1746143768.311566:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2bb80 00000100:00100000:1.0:1746143768.311627:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6498 00000100:00100000:1.0:1746143768.311635:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594339072:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.316882:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594339072:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5237us (5446us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746143768.316892:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6498 00002000:00100000:1.0:1746143768.316903:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012ba2bb80 x1830963594339072/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.316912:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba2bb80 with x1830963594339072 ext(4194304->4771839) 00002000:00010000:1.0:1746143768.316917:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba2bb80 00000100:00100000:3.0:1746143768.317483:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746143768.317498:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594413056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746143768.317537:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.318203:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594413056 00000100:00100000:2.0:1746143768.318211:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594413056 00000100:00100000:2.0:1746143768.318248:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1746143768.318254:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3293:x1830963594413056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143768.318271:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 618594304 pending 35782656 free 3853516800 avail 3851419648 00000100:00100000:2.0:1746143768.318315:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3293:x1830963594413056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.318324:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1746143768.318551:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594413056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143768.323889:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.324012:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594339328 00000100:00100000:2.0:1746143768.324019:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594339328 00000100:00100000:2.0:1746143768.324075:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3994 00000100:00100000:2.0:1746143768.324082:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31508:x1830963594339328:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143768.324385:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31508:x1830963594339328:12345-192.168.202.48@tcp:35:cat.0 Request processed in 303us (502us total) trans 8589943605 rc 0/0 00000100:00100000:2.0:1746143768.324391:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3994 00000100:00100000:0.0:1746143768.332856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.332954:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594339584 00000100:00100000:2.0:1746143768.332962:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594339584 00000100:00100000:2.0:1746143768.333002:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9261 00000100:00100000:2.0:1746143768.333008:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31514:x1830963594339584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.333027:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.333042:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3a00/0xe984082ccd730a5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a80fb expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.333157:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333176:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333185:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333197:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333202:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333207:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333296:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333304:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333309:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143768.333317:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143768.333390:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333396:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333401:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333405:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800953a3e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.333409:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333414:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333423:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143768.333425:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143768.333428:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333436:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3e00/0xe984082ccd730a63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333467:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333472:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333476:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333479:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0e0000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.333482:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333486:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333492:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009066dd00) 00010000:00010000:2.0:1746143768.333493:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143768.333495:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333498:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e0000/0xe984082ccd730a6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.333531:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800953a3a00/0xe984082ccd730a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 247 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.333542:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 246 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.333552:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.333554:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143768.333556:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1400, rc 0) 00000100:00100000:2.0:1746143768.333614:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31514:x1830963594339584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 604us (765us total) trans 8589943606 rc 0/0 00000100:00100000:2.0:1746143768.333619:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9261 00000100:00100000:0.0:1746143768.344483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.344526:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.344547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.344600:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594340096 00000100:00100000:1.0:1746143768.344602:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594339712 00000100:00100000:3.0:1746143768.344607:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594340096 00000100:00100000:1.0:1746143768.344607:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594339712 00000100:00100000:1.0:1746143768.344641:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594339840 00000100:00100000:1.0:1746143768.344642:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594339840 00000100:00100000:1.0:1746143768.344658:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13737 00000100:00100000:1.0:1746143768.344664:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1964:x1830963594339712:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.344678:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.344691:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8102 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.344709:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.344711:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.344718:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 43 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.344731:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 43 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.344741:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094676c00, rc 0) 00000100:00100000:2.0:1746143768.344775:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13738 00000100:00100000:1.0:1746143768.344780:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1964:x1830963594339712:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.344784:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594339840:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143768.344786:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13737 00010000:00010000:2.0:1746143768.344792:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.344802:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8109 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.344813:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.344814:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.344820:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 18 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.344828:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 18 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.344835:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e0400, rc 0) 00000100:00100000:2.0:1746143768.344851:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594339840:12345-192.168.202.48@tcp:101:cat.0 Request processed in 70us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.344855:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13738 00000100:00100000:3.0:1746143768.345044:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9262 00000100:00100000:3.0:1746143768.345050:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31517:x1830963594340096:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.345061:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.345070:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd730a8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8110 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.345326:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.345336:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.345344:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.345356:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.345361:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.345371:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346108:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346117:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346123:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143768.346131:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.346241:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346248:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346253:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346258:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d9200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.346261:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346267:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346275:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.346277:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.346280:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346284:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d9200/0xe984082ccd730a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346388:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346397:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346402:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346407:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d8400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.346409:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346413:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346420:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f600) 00010000:00010000:3.0:1746143768.346422:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.346424:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346429:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8400/0xe984082ccd730a9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.346463:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8600/0xe984082ccd730a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.346473:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.346479:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.346481:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143768.346483:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63d8a00, rc 0) 00000100:00100000:3.0:1746143768.346524:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31517:x1830963594340096:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1473us (2049us total) trans 8589943607 rc 0/0 00000100:00100000:3.0:1746143768.346531:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9262 00000100:00100000:0.0:1746143768.358117:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.358747:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.358813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.358849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.359006:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594340608 00000100:00100000:3.0:1746143768.359013:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594340608 00000100:00100000:3.0:1746143768.359024:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594340352 00000100:00100000:3.0:1746143768.359025:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594340352 00002000:00100000:3.0:1746143768.359059:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093b06300 x1830963594340352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.359068:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06300 with x1830963594340352 ext(0->1048575) 00002000:00010000:3.0:1746143768.359072:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b06300 00000100:00100000:3.0:1746143768.359088:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594340864 00000100:00100000:3.0:1746143768.359090:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594340864 00002000:00100000:3.0:1746143768.359099:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093b04a80 x1830963594340864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.359106:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04a80 with x1830963594340864 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.359109:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b04a80 00000100:00100000:3.0:1746143768.359116:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594341120 00000100:00100000:3.0:1746143768.359117:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594341120 00002000:00100000:3.0:1746143768.359124:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093b07800 x1830963594341120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.359130:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07800 with x1830963594341120 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.359132:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b07800 00000100:00100000:3.0:1746143768.359156:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6499 00000100:00100000:3.0:1746143768.359174:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594340352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143768.359797:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6500 00000100:00100000:0.0:1746143768.359805:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1964:x1830963594340864:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143768.360928:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6501 00000100:00100000:0.0:1746143768.360934:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594341120:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:3.0:1746143768.361009:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093500a80 x1830963594340608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.361023:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500a80 with x1830963594340608 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.361027:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500a80 00000100:00100000:3.0:1746143768.361042:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6502 00000100:00100000:3.0:1746143768.361047:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1965:x1830963594340608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.376368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.376548:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594341376 00000100:00100000:3.0:1746143768.376556:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594341376 00000100:00100000:3.0:1746143768.376603:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9263 00000100:00100000:3.0:1746143768.376609:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31520:x1830963594341376:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.376632:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.376646:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8117 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.376740:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376751:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376760:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376770:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376775:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376780:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376868:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730ac5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376876:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376882:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143768.376889:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.376956:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376962:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376967:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376972:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093326c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.376975:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376981:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376989:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.376992:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.376994:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.376999:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326c00/0xe984082ccd730ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377024:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377029:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377033:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377037:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093327400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.377039:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377044:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377049:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f600) 00010000:00010000:3.0:1746143768.377051:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.377053:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377057:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730abe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.377088:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8117 expref: 249 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.377097:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8117 expref: 248 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.377103:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.377632:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143768.377635:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326600, rc 0) 00000100:00100000:3.0:1746143768.379488:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31520:x1830963594341376:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2872us (3121us total) trans 8589943608 rc 0/0 00000100:00100000:3.0:1746143768.379498:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9263 00000100:00100000:1.0:1746143768.380536:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1964:x1830963594340864:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20730us (21720us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.380545:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6500 00002000:00100000:1.0:1746143768.380555:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093b04a80 x1830963594340864/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.380564:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04a80 with x1830963594340864 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.380569:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b04a80 00000100:00100000:3.0:1746143768.384417:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594340352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25237us (25663us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.384429:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6499 00002000:00100000:3.0:1746143768.384438:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093b06300 x1830963594340352/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.384447:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06300 with x1830963594340352 ext(0->1048575) 00002000:00010000:3.0:1746143768.384452:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b06300 00000100:00100000:1.0:1746143768.384550:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594341120:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23615us (25699us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.384557:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6501 00002000:00100000:1.0:1746143768.384562:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093b07800 x1830963594341120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.384568:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07800 with x1830963594341120 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.384572:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b07800 00000100:00100000:1.0:1746143768.385794:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.385999:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.386344:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1965:x1830963594340608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25296us (28233us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.386351:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6502 00002000:00100000:2.0:1746143768.386357:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093500a80 x1830963594340608/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.386363:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500a80 with x1830963594340608 ext(1048576->2097151) 00002000:00010000:2.0:1746143768.386367:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093500a80 00000100:00100000:3.0:1746143768.386645:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594341760 00000100:00100000:3.0:1746143768.386651:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594341760 00000100:00100000:3.0:1746143768.386684:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3995 00000100:00100000:3.0:1746143768.386688:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31520:x1830963594341760:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143768.386823:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31520:x1830963594341760:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 135us (1032us total) trans 8589943609 rc 0/0 00000100:00100000:3.0:1746143768.386828:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3995 00000100:00100000:3.0:1746143768.387196:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594341504 00000100:00100000:3.0:1746143768.387200:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594341504 00000100:00100000:3.0:1746143768.387227:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 746 00000100:00100000:3.0:1746143768.387231:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1965:x1830963594341504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.387242:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.387261:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730ac5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8117 expref: 249 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.387275:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.387279:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.387303:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1965:x1830963594341504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 71us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.387308:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 746 00000100:00100000:0.0:1746143768.390327:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.390693:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594341888 00000100:00100000:2.0:1746143768.390797:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594341888 00000100:00100000:2.0:1746143768.390843:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13739 00000100:00100000:2.0:1746143768.390849:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:31520:x1830963594341888:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143768.390863:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.390876:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a811e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.390900:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.390908:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 44 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.390913:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.390915:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.390917:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1208320->1314815] (req 1208320->1314815) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.390942:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 44 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.390952:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 44 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.390961:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594413184:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.391448:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 28 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.391455:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 28 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.391462:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594413312:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.391480:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.394115:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.394209:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594413184:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.394252:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594413312:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.394277:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1208320->1314815] (req 1208320->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.394290:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c24ea00, rc 0) 00000100:00100000:2.0:1746143768.394330:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:31520:x1830963594341888:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3481us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.394337:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13739 00000100:00100000:1.0:1746143768.394349:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594342016 00000100:00100000:1.0:1746143768.394356:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594342016 00000100:00100000:1.0:1746143768.394393:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13740 00000100:00100000:1.0:1746143768.394399:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:31514:x1830963594342016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.394411:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.394496:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8125 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.394498:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143768.394513:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.394518:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1208320->1314815] (req 1208320->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 45 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.394523:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.394526:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.394546:0:12618:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1208320->1314815] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 45 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.394554:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.394561:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094676600, rc 0) 00000100:00100000:3.0:1746143768.394577:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594342144 00000100:00100000:3.0:1746143768.394581:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594342144 00010000:00010000:3.0:1746143768.394663:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 46 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.394833:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:31514:x1830963594342016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 434us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.394838:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13740 00000100:00100000:3.0:1746143768.394842:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7373 00000100:00100000:3.0:1746143768.394847:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1962:x1830963594342144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.394854:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.394871:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 45 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.394879:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 45 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.394892:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730a7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8102 expref: 45 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.394913:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.394964:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1962:x1830963594342144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 116us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.394973:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7373 00000100:00100000:0.0:1746143768.395750:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.395935:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594342272 00000100:00100000:3.0:1746143768.395939:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594342272 00010000:00010000:3.0:1746143768.395951:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.395966:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7374 00000100:00100000:3.0:1746143768.395971:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594342272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.395976:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.395984:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.395992:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.396002:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d2800/0xe984082ccd730a47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80e6 expref: 29 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.396010:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.396011:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.396016:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 43 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.396022:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 43 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.396041:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 43 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.396051:0:7150:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 43 pid: 4581 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.396321:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594413568:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.396837:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.397611:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594413568:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.397628:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.397663:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594342272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1691us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.397670:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7374 00000100:00100000:0.0:1746143768.397690:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.398131:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594342528 00000100:00100000:2.0:1746143768.398136:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594342528 00002000:00100000:2.0:1746143768.398187:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1208320->1212415) req@ffff88009bfe3100 x1830963594342528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.398195:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3100 with x1830963594342528 ext(1208320->1212415) 00010000:00010000:2.0:1746143768.398201:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.398210:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00002000:00010000:2.0:1746143768.398216:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe3100 00000100:00100000:2.0:1746143768.398236:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1839 00000100:00100000:2.0:1746143768.398241:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963594342528:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143768.398352:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963594342528:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 110us (661us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143768.398358:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1839 00002000:00100000:2.0:1746143768.398362:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1208320->1212415) req@ffff88009bfe3100 x1830963594342528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.398369:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3100 with x1830963594342528 ext(1208320->1212415) 00010000:00010000:2.0:1746143768.398373:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.398391:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00002000:00010000:2.0:1746143768.398396:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bfe3100 00000100:00100000:0.0:1746143768.400016:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.400215:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594342784 00000100:00100000:2.0:1746143768.400220:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594342784 00002000:00100000:2.0:1746143768.400244:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1310720->1314815) req@ffff88008f0ac700 x1830963594342784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.400252:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac700 with x1830963594342784 ext(1310720->1314815) 00010000:00010000:2.0:1746143768.400257:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.400267:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00002000:00010000:2.0:1746143768.400272:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0ac700 00000100:00100000:2.0:1746143768.400296:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1840 00000100:00100000:2.0:1746143768.400302:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1962:x1830963594342784:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143768.400483:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1962:x1830963594342784:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 181us (470us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143768.400489:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1840 00002000:00100000:2.0:1746143768.400493:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1310720->1314815) req@ffff88008f0ac700 x1830963594342784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.400499:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac700 with x1830963594342784 ext(1310720->1314815) 00010000:00010000:2.0:1746143768.400504:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.400513:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00002000:00010000:2.0:1746143768.400518:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0ac700 00000100:00100000:0.0:1746143768.404451:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.404543:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594343040 00000100:00100000:2.0:1746143768.404551:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594343040 00002000:00100000:2.0:1746143768.404584:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1208320->1314815) req@ffff88008f0af100 x1830963594343040/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.404593:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af100 with x1830963594343040 ext(1208320->1314815) 00010000:00010000:2.0:1746143768.404601:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.404613:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 44 pid: 4581 timeout: 947 lvb_type: 0 00002000:00010000:2.0:1746143768.404623:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0af100 00000100:00100000:2.0:1746143768.404648:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1841 00000100:00100000:2.0:1746143768.404654:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963594343040:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:2.0:1746143768.408436:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1963:x1830963594343040:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3775us (3985us total) trans 17179873167 rc 0/0 00000100:00100000:2.0:1746143768.408444:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1841 00002000:00100000:2.0:1746143768.408454:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1208320->1314815) req@ffff88008f0af100 x1830963594343040/t17179873167(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.408467:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0af100 with x1830963594343040 ext(1208320->1314815) 00010000:00010000:2.0:1746143768.408476:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 46 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.408487:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 46 pid: 4581 timeout: 947 lvb_type: 0 00002000:00010000:2.0:1746143768.408493:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f0af100 00000100:00100000:0.0:1746143768.410315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.410469:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594343168 00000100:00100000:2.0:1746143768.410477:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594343168 00010000:00010000:2.0:1746143768.410505:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 46 pid: 4581 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.410526:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7375 00000100:00100000:2.0:1746143768.410532:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1962:x1830963594343168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.410542:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143768.410556:0:7150:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143767 -> 1746143768 00002000:00010000:2.0:1746143768.410558:0:7150:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143767 -> 1746143768 00010000:00010000:2.0:1746143768.410563:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 46 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.410571:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 46 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.410589:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c24ea00/0xe984082ccd730ad3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1208320->1314815) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a811e expref: 46 pid: 4581 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.410613:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.410615:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.410620:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.410626:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.410651:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.410661:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594413696:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.411002:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.414207:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594413696:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.414225:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.414259:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1962:x1830963594343168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3726us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.414268:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7375 00000100:00100000:0.0:1746143768.415126:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.415192:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.415266:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594343296 00000100:00100000:1.0:1746143768.415272:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594343296 00000100:00100000:1.0:1746143768.415308:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13741 00000100:00100000:1.0:1746143768.415313:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31517:x1830963594343296:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143768.415325:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.415338:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a812c expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.415359:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 44 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.415364:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 29 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.415367:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.415368:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.415370:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2347008->3071999] (req 2347008->3071999) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.415387:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 29 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.415394:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 29 pid: 6929 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.415400:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594413824:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.415403:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594343552 00000100:00100000:2.0:1746143768.415406:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594343552 00002000:00100000:2.0:1746143768.415427:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88008f0aed80 x1830963594343552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143768.415452:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 45 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.415457:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 45 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.415461:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594413952:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.415471:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7836c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746143768.415809:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aed80 with x1830963594343552 ext(1048576->2097151) 00002000:00010000:2.0:1746143768.415813:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0aed80 00000100:00100000:2.0:1746143768.415836:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6503 00000100:00100000:2.0:1746143768.415843:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1963:x1830963594343552:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143768.417967:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594413824:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.420477:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.420600:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594343680 00000100:00100000:1.0:1746143768.420600:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594413952:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.420606:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594343680 00010000:00010000:1.0:1746143768.420625:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2347008->3071999] (req 2347008->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 29 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.420631:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 47 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.420638:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094676c00, rc 0) 00000100:00100000:3.0:1746143768.420654:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7376 00000100:00100000:3.0:1746143768.420660:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1964:x1830963594343680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.420670:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.420688:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 47 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.420696:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 47 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.420715:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a792400/0xe984082ccd730998 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a806f expref: 47 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.420729:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.420772:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1964:x1830963594343680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.420782:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7376 00000100:00100000:1.0:1746143768.421116:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31517:x1830963594343296:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5801us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.421123:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13741 00000100:00100000:0.0:1746143768.421489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.421592:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594343808 00000100:00100000:2.0:1746143768.421595:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594343808 00010000:00010000:2.0:1746143768.421609:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 29 pid: 6929 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.421651:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7377 00000100:00100000:2.0:1746143768.421656:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1964:x1830963594343808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.421662:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.421671:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 29 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.421679:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 29 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.421690:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc33000/0xe984082ccd730a01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a7 expref: 29 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.421701:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.421702:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.421707:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.421713:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.421738:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 28 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.421747:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594414080:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.421797:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.423388:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.423455:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594344064 00000100:00100000:1.0:1746143768.423460:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594344064 00002000:00100000:1.0:1746143768.423489:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2347008->2351103) req@ffff880094c0f480 x1830963594344064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.423498:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f480 with x1830963594344064 ext(2347008->2351103) 00002000:00010000:1.0:1746143768.423502:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0f480 00000100:00100000:1.0:1746143768.423516:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6504 00000100:00100000:1.0:1746143768.423521:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594344064:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143768.423633:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594344064:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 111us (248us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143768.423638:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6504 00002000:00100000:1.0:1746143768.423643:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2347008->2351103) req@ffff880094c0f480 x1830963594344064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.423650:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f480 with x1830963594344064 ext(2347008->2351103) 00002000:00010000:1.0:1746143768.423653:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0f480 00000100:00100000:2.0:1746143768.423801:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594414080:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.423813:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.423831:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594343808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2175us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.423836:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7377 00000100:00100000:3.0:1746143768.424167:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963594343552:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8315us (8964us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.424174:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6503 00002000:00100000:3.0:1746143768.424180:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88008f0aed80 x1830963594343552/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.424187:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0aed80 with x1830963594343552 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.424190:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0aed80 00000100:00100000:0.0:1746143768.430896:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.431005:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594344320 00000100:00100000:3.0:1746143768.431013:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594344320 00002000:00100000:3.0:1746143768.431049:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3067904->3071999) req@ffff880094c0e680 x1830963594344320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.431058:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e680 with x1830963594344320 ext(3067904->3071999) 00002000:00010000:3.0:1746143768.431063:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0e680 00000100:00100000:3.0:1746143768.431094:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6505 00000100:00100000:3.0:1746143768.431102:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594344320:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143768.431279:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594344320:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 178us (390us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.431286:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6505 00002000:00100000:3.0:1746143768.431291:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3067904->3071999) req@ffff880094c0e680 x1830963594344320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.431298:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0e680 with x1830963594344320 ext(3067904->3071999) 00002000:00010000:3.0:1746143768.431301:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0e680 00000100:00100000:0.0:1746143768.434571:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.434624:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.434703:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594344704 00000100:00100000:2.0:1746143768.434711:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594344704 00000100:00100000:2.0:1746143768.434744:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3996 00000100:00100000:2.0:1746143768.434750:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31517:x1830963594344704:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143768.434979:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31517:x1830963594344704:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 227us (413us total) trans 8589943610 rc 0/0 00000100:00100000:2.0:1746143768.434986:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3996 00000100:00100000:3.0:1746143768.435077:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594344832 00000100:00100000:3.0:1746143768.435081:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594344832 00002000:00100000:3.0:1746143768.435101:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094c0d500 x1830963594344832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.435110:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d500 with x1830963594344832 ext(2097152->3145727) 00002000:00010000:3.0:1746143768.435114:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d500 00000100:00100000:3.0:1746143768.435136:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6506 00000100:00100000:3.0:1746143768.435172:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594344832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.444546:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594344832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9365us (9912us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.444557:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6506 00002000:00100000:3.0:1746143768.444566:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880094c0d500 x1830963594344832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.444576:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d500 with x1830963594344832 ext(2097152->3145727) 00002000:00010000:3.0:1746143768.444580:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0d500 00000100:00100000:0.0:1746143768.449206:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.449237:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594344960 00000100:00100000:1.0:1746143768.449245:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594344960 00000100:00100000:1.0:1746143768.449361:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13742 00000100:00100000:1.0:1746143768.449369:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:31514:x1830963594344960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.449384:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.449398:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8133 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.449422:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.449429:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.449430:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.449433:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.449456:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 27 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.449466:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 27 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.449475:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594414208:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.449554:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.450735:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594414208:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143768.450752:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.450764:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094677000, rc 0) 00000100:00100000:1.0:1746143768.450798:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:31514:x1830963594344960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1430us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.450804:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13742 00000100:00100000:0.0:1746143768.452118:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.452238:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594345088 00000100:00100000:3.0:1746143768.452244:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594345088 00002000:00100000:3.0:1746143768.452273:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2347008->3071999) req@ffff880094c0c380 x1830963594345088/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.452282:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963594345088 ext(2347008->3071999) 00010000:00010000:3.0:1746143768.452288:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 28 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.452300:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 28 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.452311:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0c380 00000100:00100000:3.0:1746143768.452339:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1842 00000100:00100000:3.0:1746143768.452345:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1965:x1830963594345088:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143768.460462:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594345088:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 8109us (8339us total) trans 17179873168 rc 0/0 00000100:00100000:3.0:1746143768.460473:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1842 00002000:00100000:3.0:1746143768.460482:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2347008->3071999) req@ffff880094c0c380 x1830963594345088/t17179873168(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.460492:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0c380 with x1830963594345088 ext(2347008->3071999) 00010000:00010000:3.0:1746143768.460500:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 30 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.460513:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 30 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:3.0:1746143768.460521:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0c380 00000100:00100000:0.0:1746143768.462968:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.463306:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594345216 00000100:00100000:2.0:1746143768.463313:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594345216 00010000:00010000:2.0:1746143768.463340:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 30 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.463467:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7378 00000100:00100000:2.0:1746143768.463473:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594345216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.463487:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143768.463501:0:9890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143766 -> 1746143768 00002000:00010000:2.0:1746143768.463503:0:9890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143766 -> 1746143768 00010000:00010000:2.0:1746143768.463507:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 30 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.463518:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 30 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.463536:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094676c00/0xe984082ccd730ae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2347008->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a812c expref: 30 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.463561:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.463563:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.463568:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 44 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.463575:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 44 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.463601:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 44 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.463611:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594414336:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.463677:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.465043:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594414336:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.465060:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.465100:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594345216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1625us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.465107:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7378 00000100:00100000:0.0:1746143768.469931:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.470001:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594345472 00000100:00100000:3.0:1746143768.470008:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594345472 00002000:00100000:3.0:1746143768.470050:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094c0ca80 x1830963594345472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.470058:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963594345472 ext(2097152->3145727) 00002000:00010000:3.0:1746143768.470063:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ca80 00000100:00100000:3.0:1746143768.470092:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6507 00000100:00100000:3.0:1746143768.470099:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1964:x1830963594345472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143768.470327:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.470360:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.470439:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594345728 00000100:00100000:1.0:1746143768.470443:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594345728 00002000:00100000:1.0:1746143768.470461:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094c0f100 x1830963594345728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.470473:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f100 with x1830963594345728 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.470475:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0f100 00000100:00100000:1.0:1746143768.470488:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594345984 00000100:00100000:1.0:1746143768.470490:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594345984 00002000:00100000:1.0:1746143768.470502:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c0ed80 x1830963594345984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.470508:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ed80 with x1830963594345984 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.470511:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ed80 00000100:00100000:1.0:1746143768.470537:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6508 00000100:00100000:1.0:1746143768.470543:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1964:x1830963594345728:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.470578:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6509 00000100:00100000:2.0:1746143768.470585:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594345984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.481293:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1964:x1830963594345472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11187us (11362us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.481303:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6507 00002000:00100000:3.0:1746143768.481312:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094c0ca80 x1830963594345472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.481321:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ca80 with x1830963594345472 ext(2097152->3145727) 00002000:00010000:3.0:1746143768.481325:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0ca80 00000100:00100000:3.0:1746143768.482431:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594345984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11843us (12066us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.482437:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6509 00002000:00100000:3.0:1746143768.482443:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094c0ed80 x1830963594345984/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.482450:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0ed80 with x1830963594345984 ext(3145728->4194303) 00002000:00010000:3.0:1746143768.482453:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c0ed80 00000100:00100000:2.0:1746143768.490107:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1964:x1830963594345728:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19557us (19772us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.490117:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6508 00002000:00100000:2.0:1746143768.490126:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094c0f100 x1830963594345728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.490134:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0f100 with x1830963594345728 ext(3145728->4194303) 00002000:00010000:2.0:1746143768.490153:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c0f100 00000100:00100000:0.0:1746143768.495104:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.495523:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594346240 00000100:00100000:2.0:1746143768.495531:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594346240 00002000:00100000:2.0:1746143768.495570:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4767743) req@ffff8800949f0700 x1830963594346240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.495580:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0700 with x1830963594346240 ext(4194304->4767743) 00002000:00010000:2.0:1746143768.495585:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0700 00000100:00100000:2.0:1746143768.495615:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6510 00000100:00100000:2.0:1746143768.495622:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594346240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.501465:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594346240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5836us (6361us total) trans 0 rc 573440/573440 00000100:00100000:3.0:1746143768.501475:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6510 00002000:00100000:3.0:1746143768.501483:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4767743) req@ffff8800949f0700 x1830963594346240/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 573440/573440 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.501492:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f0700 with x1830963594346240 ext(4194304->4767743) 00002000:00010000:3.0:1746143768.501497:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949f0700 00000100:00100000:0.0:1746143768.509090:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.509204:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594346496 00000100:00100000:2.0:1746143768.509212:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594346496 00000100:00100000:2.0:1746143768.509251:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3997 00000100:00100000:2.0:1746143768.509258:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31514:x1830963594346496:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143768.509455:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31514:x1830963594346496:12345-192.168.202.48@tcp:35:cat.0 Request processed in 196us (370us total) trans 8589943611 rc 0/0 00000100:00100000:2.0:1746143768.509460:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3997 00000100:00100000:0.0:1746143768.524968:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.525054:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594346752 00000100:00100000:3.0:1746143768.525062:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594346752 00000100:00100000:3.0:1746143768.525114:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9264 00000100:00100000:3.0:1746143768.525121:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31524:x1830963594346752:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.525180:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.525194:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a813a expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.525284:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525295:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525310:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525323:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525329:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525334:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525422:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525429:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525435:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143768.525445:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.525512:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525518:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525523:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525528:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093326800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.525531:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525536:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525544:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.525546:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.525549:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525554:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326800/0xe984082ccd730af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525579:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525583:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525588:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525595:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093327800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.525597:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525601:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525607:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f400) 00010000:00010000:3.0:1746143768.525608:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.525610:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525614:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730afd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.525644:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a813a expref: 252 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.525654:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a813a expref: 251 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.525660:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.525662:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143768.525664:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326000, rc 0) 00000100:00100000:3.0:1746143768.525711:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31524:x1830963594346752:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 590us (751us total) trans 8589943612 rc 0/0 00000100:00100000:3.0:1746143768.525717:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9264 00000100:00100000:0.0:1746143768.527046:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.527083:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594347008 00000100:00100000:0.0:1746143768.527084:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.527086:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594347008 00000100:00100000:2.0:1746143768.527106:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3998 00000100:00100000:2.0:1746143768.527110:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31524:x1830963594347008:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143768.527168:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594347136 00000100:00100000:3.0:1746143768.527171:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594347136 00000100:00100000:3.0:1746143768.527196:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 747 00000100:00100000:3.0:1746143768.527200:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1963:x1830963594347136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.527207:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.527219:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b04 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a813a expref: 252 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.527228:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.527231:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.527266:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1963:x1830963594347136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.527272:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 747 00000100:00100000:2.0:1746143768.527282:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31524:x1830963594347008:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 171us (238us total) trans 8589943613 rc 0/0 00000100:00100000:2.0:1746143768.527288:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3998 00000100:00100000:0.0:1746143768.528837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.528998:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594347264 00000100:00100000:1.0:1746143768.529002:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594347264 00000100:00100000:1.0:1746143768.529043:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13743 00000100:00100000:1.0:1746143768.529050:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:31524:x1830963594347264:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143768.529060:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.529071:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8141 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.529090:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 46 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.529097:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.529098:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.529101:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1974272->1990655] (req 1974272->1990655) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 46 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.529125:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 46 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.529135:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 46 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.529179:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594414464:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.529248:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.531035:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594414464:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143768.531054:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1974272->1990655] (req 1974272->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 46 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.531066:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba27c00, rc 0) 00000100:00100000:1.0:1746143768.531521:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:31524:x1830963594347264:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2470us (2685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.531529:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13743 00000100:00100000:0.0:1746143768.532281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.532333:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594347392 00000100:00100000:2.0:1746143768.532338:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594347392 00010000:00010000:2.0:1746143768.532358:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 46 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.532388:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7379 00000100:00100000:2.0:1746143768.532394:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1965:x1830963594347392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.532404:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.532426:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 46 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.532437:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 46 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.532454:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094676600/0xe984082ccd730ada lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8125 expref: 46 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.532498:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.532500:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.532506:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.532513:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.532536:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.532546:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594414592:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.532613:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.533528:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594414592:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.533540:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.533560:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1965:x1830963594347392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1167us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.533567:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7379 00000100:00100000:0.0:1746143768.534208:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.534224:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594347648 00000100:00100000:3.0:1746143768.534229:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594347648 00002000:00100000:3.0:1746143768.534257:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1986560->1990655) req@ffff880094c12d80 x1830963594347648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.534266:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963594347648 ext(1986560->1990655) 00002000:00010000:3.0:1746143768.534270:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:3.0:1746143768.534339:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6511 00000100:00100000:3.0:1746143768.534345:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1964:x1830963594347648:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143768.534465:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1964:x1830963594347648:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 120us (257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.534471:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6511 00002000:00100000:3.0:1746143768.534476:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1986560->1990655) req@ffff880094c12d80 x1830963594347648/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.534483:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12d80 with x1830963594347648 ext(1986560->1990655) 00002000:00010000:3.0:1746143768.534486:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094c12d80 00000100:00100000:0.0:1746143768.544813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.544910:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594347904 00000100:00100000:2.0:1746143768.544920:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594347904 00000100:00100000:3.0:1746143768.545296:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9265 00000100:00100000:3.0:1746143768.545305:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31529:x1830963594347904:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.545324:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.545337:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8148 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.545428:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545437:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545445:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545455:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545460:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545463:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545549:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b2e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545556:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545561:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143768.545573:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.545641:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545647:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545651:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545656:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093327600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.545659:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545664:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545837:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.545839:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.545843:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545848:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545873:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545878:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545883:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545891:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093326e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.545893:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545898:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545904:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f800) 00010000:00010000:3.0:1746143768.545906:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.545908:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545912:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326e00/0xe984082ccd730b27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.545945:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8148 expref: 15 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.545957:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8148 expref: 14 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.545963:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.545965:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143768.545968:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326400, rc 0) 00000100:00100000:3.0:1746143768.546025:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31529:x1830963594347904:12345-192.168.202.48@tcp:101:cat.0 Request processed in 720us (1218us total) trans 8589943614 rc 0/0 00000100:00100000:3.0:1746143768.546030:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9265 00000100:00100000:0.0:1746143768.547837:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.547999:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594348032 00000100:00100000:2.0:1746143768.548005:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594348032 00000100:00100000:2.0:1746143768.548054:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 748 00000100:00100000:2.0:1746143768.548060:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1963:x1830963594348032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.548070:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.548087:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b2e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8148 expref: 14 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.548105:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.548109:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.548175:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1963:x1830963594348032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.548181:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 748 00000100:00100000:1.0:1746143768.548471:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.548527:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.548682:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594348160 00000100:00100000:0.0:1746143768.548685:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594348160 00000100:00100000:0.0:1746143768.548703:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594348288 00000100:00100000:0.0:1746143768.548704:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594348288 00000100:00100000:0.0:1746143768.548724:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13744 00000100:00100000:0.0:1746143768.548729:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963594348160:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143768.548735:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13745 00010000:00010000:0.0:1746143768.548740:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143768.548745:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594348288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.548753:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.548754:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930c5800/0xe984082ccd730b3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a814f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.548760:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8156 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.548774:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.548775:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.548782:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 32 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.548793:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 32 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.548807:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327c00, rc 0) 00000100:00100000:3.0:1746143768.548841:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1965:x1830963594348288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.548846:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13745 00000100:00100000:0.0:1746143768.548883:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594414720:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143768.548927:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0736c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746143768.550236:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143767 -> 1746143768 00000100:00100000:2.0:1746143768.550255:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594414720:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143768.550272:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930c5800/0xe984082ccd730b3c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a814f expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.550281:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930c5800/0xe984082ccd730b3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a814f expref: 31 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.550289:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c5800, rc 0) 00000100:00100000:2.0:1746143768.550312:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1964:x1830963594348160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1582us (1841us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143768.550318:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13744 00000100:00100000:0.0:1746143768.553537:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.553614:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.553711:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594348800 00000100:00100000:3.0:1746143768.553719:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594348800 00000100:00100000:3.0:1746143768.553763:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9266 00000100:00100000:3.0:1746143768.553770:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31531:x1830963594348800:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.553788:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.553802:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730b4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a815d expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.553908:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.553919:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.553929:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.553939:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.553944:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.553948:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554033:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730b5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554041:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730b5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554047:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730b5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143768.554056:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.554126:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554131:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554135:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554180:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093327200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.554184:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554190:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554200:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.554202:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.554205:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554209:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730b51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554222:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554226:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554231:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554235:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093326400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.554237:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554241:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554247:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f800) 00010000:00010000:3.0:1746143768.554249:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.554251:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.554255:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326400/0xe984082ccd730b58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00000100:00100000:2.0:1746143768.554266:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594348544 00000100:00100000:2.0:1746143768.554270:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594348544 00010000:00010000:3.0:1746143768.554289:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730b4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a815d expref: 16 pid: 2976 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143768.554292:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880094c10700 x1830963594348544/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143768.554299:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730b5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a815d expref: 15 pid: 2976 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143768.554301:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10700 with x1830963594348544 ext(0->1048575) 00002000:00010000:2.0:1746143768.554304:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10700 00010000:00010000:3.0:1746143768.554305:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.554307:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143768.554309:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327400, rc 0) 00000100:00100000:2.0:1746143768.554316:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6512 00000100:00100000:2.0:1746143768.554321:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594348544:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.554357:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31531:x1830963594348800:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 587us (742us total) trans 8589943615 rc 0/0 00000100:00100000:3.0:1746143768.554363:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9266 00000100:00100000:0.0:1746143768.555558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.555701:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594348928 00000100:00100000:3.0:1746143768.555705:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594348928 00000100:00100000:3.0:1746143768.555730:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 749 00000100:00100000:3.0:1746143768.555736:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594348928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.555745:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.555756:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730b5f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a815d expref: 15 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.555766:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.555769:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.555790:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594348928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.555796:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 749 00000100:00100000:2.0:1746143768.559247:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.559699:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594349056 00000100:00100000:3.0:1746143768.559707:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594349056 00000100:00100000:3.0:1746143768.559743:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13746 00000100:00100000:3.0:1746143768.559749:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31531:x1830963594349056:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.559762:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.559775:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8164 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.559797:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.559804:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.559809:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.559811:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.559814:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2834432->2973695] (req 2834432->2973695) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 13 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.559837:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 13 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.559848:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 13 pid: 6929 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.559859:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594414848:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.560004:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.560016:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 17 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.560024:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594414976:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.560043:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.561340:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594348544:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7015us (7807us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.561349:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6512 00002000:00100000:3.0:1746143768.561357:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880094c10700 x1830963594348544/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.561365:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10700 with x1830963594348544 ext(0->1048575) 00002000:00010000:3.0:1746143768.561369:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10700 00000100:00100000:3.0:1746143768.561408:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594414976:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.561662:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594414848:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.561686:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2834432->2973695] (req 2834432->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 11 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.561698:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326e00, rc 0) 00000100:00100000:3.0:1746143768.562008:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31531:x1830963594349056:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2258us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.562014:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13746 00000100:00100000:0.0:1746143768.562662:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.562717:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594349184 00000100:00100000:3.0:1746143768.562721:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594349184 00000100:00100000:3.0:1746143768.562797:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9267 00000100:00100000:3.0:1746143768.562803:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31532:x1830963594349184:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.562819:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.562830:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a816b expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.562874:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.562884:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.562892:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.562902:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.562908:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.562912:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.562997:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.563005:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 250 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.563012:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.563034:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 250 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.563043:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 250 pid: 20509 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.563052:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594415104:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.563581:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.565445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.565483:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.565617:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594349312 00000100:00100000:3.0:1746143768.565623:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594349312 00010000:00010000:3.0:1746143768.565653:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 18 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.565660:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594349440 00000100:00100000:2.0:1746143768.565664:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594349440 00010000:00010000:2.0:1746143768.565679:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 11 pid: 6929 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.565684:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7380 00000100:00100000:3.0:1746143768.565690:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594349312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143768.565697:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7381 00010000:00010000:3.0:1746143768.565699:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143768.565702:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594349440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.565707:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.565714:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 18 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.565714:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 11 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.565723:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 11 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.565843:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 18 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.565860:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090857400/0xe984082ccd730991 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8068 expref: 18 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.565870:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.565896:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594349312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 206us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.565901:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7380 00010000:00010000:2.0:1746143768.565913:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc32400/0xe984082ccd7309fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80a0 expref: 11 pid: 6929 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.565930:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.565932:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.565937:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.565944:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.565972:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.565982:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594415232:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.566026:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.566197:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.566296:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594349696 00000100:00100000:2.0:1746143768.566299:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594349696 00000100:00100000:2.0:1746143768.566320:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 3999 00000100:00100000:2.0:1746143768.566324:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:7695:x1830963594349696:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143768.566360:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594415104:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.566376:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:2.0:1746143768.566463:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:7695:x1830963594349696:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 138us (266us total) trans 8589943616 rc 0/0 00000100:00100000:2.0:1746143768.566468:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 3999 00000100:00100000:0.0:1746143768.567560:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.567649:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594349824 00000100:00100000:3.0:1746143768.567653:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594349824 00010000:00010000:3.0:1746143768.567669:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 252 pid: 20509 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.567687:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7382 00000100:00100000:3.0:1746143768.567691:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1965:x1830963594349824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.567698:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.567703:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 252 pid: 20509 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.567711:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 252 pid: 20509 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.567726:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc32800/0xe984082ccd7309a6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8045 expref: 252 pid: 20509 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.567736:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.567740:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.567748:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.567753:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.567768:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.567907:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594415232:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.567920:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.567941:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963594349824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 248us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.567944:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594349440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2241us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.567947:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7382 00000100:00100000:2.0:1746143768.567951:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7381 00010000:00010000:3.0:1746143768.567968:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.567974:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143768.568443:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143768.568447:0:2976:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143768.568460:0:2976:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568470:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568478:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568483:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568488:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568493:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093326000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.568496:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568502:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568509:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.568511:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.568514:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568518:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326000/0xe984082ccd730b7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568528:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568532:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568536:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568540:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093326200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.568541:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568546:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568551:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f400) 00010000:00010000:3.0:1746143768.568553:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.568554:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568558:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730b82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.568583:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.568593:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 7 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.568598:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.568599:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143768.568601:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326600, rc 0) 00000100:00100000:3.0:1746143768.568624:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31532:x1830963594349184:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 5820us (5962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.568629:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9267 00000100:00100000:0.0:1746143768.569202:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.569254:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594350080 00000100:00100000:3.0:1746143768.569258:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594350080 00002000:00100000:3.0:1746143768.569283:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2834432->2838527) req@ffff880094c12a00 x1830963594350080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.569292:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963594350080 ext(2834432->2838527) 00002000:00010000:3.0:1746143768.569296:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12a00 00000100:00100000:3.0:1746143768.569308:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6513 00000100:00100000:3.0:1746143768.569313:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594350080:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143768.569449:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594350080:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 135us (248us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.569456:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6513 00002000:00100000:3.0:1746143768.569460:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2834432->2838527) req@ffff880094c12a00 x1830963594350080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.569472:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c12a00 with x1830963594350080 ext(2834432->2838527) 00002000:00010000:3.0:1746143768.569475:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c12a00 00000100:00100000:2.0:1746143768.570387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.571176:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594350208 00000100:00100000:3.0:1746143768.571182:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594350208 00000100:00100000:3.0:1746143768.571230:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13747 00000100:00100000:3.0:1746143768.571236:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1962:x1830963594350208:12345-192.168.202.48@tcp:101:lfs.0 00000100:00080000:1.0:1746143768.571240:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746143768.571246:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.571257:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8172 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.571327:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.571328:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.571335:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.571347:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 6 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.571357:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326800, rc 0) 00000100:00100000:3.0:1746143768.571381:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1962:x1830963594350208:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 146us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.571386:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13747 00000100:00100000:0.0:1746143768.572415:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.572445:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.572472:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.572488:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594350848 00000100:00100000:0.0:1746143768.572492:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594350848 00002000:00100000:0.0:1746143768.572517:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2969600->2973695) req@ffff880094c10e00 x1830963594350848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.572526:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963594350848 ext(2969600->2973695) 00002000:00010000:0.0:1746143768.572530:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10e00 00000100:00100000:0.0:1746143768.572557:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6514 00000100:00100000:0.0:1746143768.572563:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594350848:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143768.572622:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594350336 00000100:00100000:1.0:1746143768.572627:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594350336 00000100:00100000:3.0:1746143768.572640:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594350464 00000100:00100000:3.0:1746143768.572644:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594350464 00000100:00100000:1.0:1746143768.572656:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13748 00000100:00100000:1.0:1746143768.572661:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594350336:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:3.0:1746143768.572665:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13749 00010000:00010000:1.0:1746143768.572668:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143768.572670:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594350464:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.572676:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.572680:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8179 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.572683:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093327e00/0xe984082ccd730b9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8180 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.572693:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.572694:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.572700:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.572710:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 11 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143768.572715:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594415360:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143768.572718:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79de00, rc 0) 00000100:00100000:1.0:1746143768.572742:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594350336:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 81us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.572747:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13748 00000100:00100000:3.0:1746143768.572755:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157a80 going to sleep for 11 seconds 00000100:00080000:1.0:1746143768.572761:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143768.572872:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594350848:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 308us (398us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143768.572877:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.572877:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6514 00002000:00100000:0.0:1746143768.572882:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2969600->2973695) req@ffff880094c10e00 x1830963594350848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.572889:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10e00 with x1830963594350848 ext(2969600->2973695) 00002000:00010000:0.0:1746143768.572892:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094c10e00 00000100:00100000:2.0:1746143768.572913:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.572954:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.572975:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594350592 00000100:00100000:0.0:1746143768.572978:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594350592 00000100:00100000:0.0:1746143768.572991:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594350976 00000100:00100000:0.0:1746143768.572993:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594350976 00000100:00100000:0.0:1746143768.573001:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594351104 00000100:00100000:0.0:1746143768.573003:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594351104 00000100:00100000:0.0:1746143768.573012:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13750 00000100:00100000:0.0:1746143768.573017:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963594350592:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143768.573023:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.573030:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8187 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.573041:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.573042:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.573046:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.573056:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.573062:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c4000, rc 0) 00000100:00100000:0.0:1746143768.573078:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594350592:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 61us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.573083:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13750 00000100:00100000:0.0:1746143768.573091:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13751 00000100:00100000:0.0:1746143768.573096:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963594350976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143768.573101:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.573105:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd730bac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a818e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.573123:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594415488:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143768.573184:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.573197:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13752 00000100:00100000:0.0:1746143768.573202:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594351104:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:0.0:1746143768.573207:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.573213:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8195 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.573222:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.573223:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.573227:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.573235:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 12 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.573242:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c4e00, rc 0) 00000100:00100000:0.0:1746143768.573254:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594351104:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 53us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.573259:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13752 00000100:00100000:3.0:1746143768.575253:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594415360:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143768.575280:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093327e00/0xe984082ccd730b9e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8180 expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.575291:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093327e00/0xe984082ccd730b9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8180 expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.575300:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327e00, rc 0) 00000100:00100000:3.0:1746143768.575335:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594350464:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2663us (2888us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143768.575341:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13749 00002000:00010000:0.0:1746143768.576422:0:4581:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143766 -> 1746143768 00002000:00010000:0.0:1746143768.576426:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143767 -> 1746143768 00002000:00010000:0.0:1746143768.576428:0:4581:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143766 -> 1746143768 00000100:00100000:0.0:1746143768.576439:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594415488:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143768.576455:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd730bac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a818e expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.576469:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930c5c00/0xe984082ccd730bac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a818e expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.576480:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930c5c00, rc 0) 00000100:00100000:0.0:1746143768.576503:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1963:x1830963594350976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3407us (3589us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143768.576510:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13751 00000100:00100000:0.0:1746143768.576547:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.576835:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594351360 00000100:00100000:2.0:1746143768.576841:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594351360 00000100:00100000:2.0:1746143768.576868:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4000 00000100:00100000:2.0:1746143768.576874:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31531:x1830963594351360:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143768.577007:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31531:x1830963594351360:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 132us (458us total) trans 8589943617 rc 0/0 00000100:00100000:2.0:1746143768.577012:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4000 00000100:00100000:0.0:1746143768.577481:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.577494:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594351488 00000100:00100000:0.0:1746143768.577497:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594351488 00000100:00100000:0.0:1746143768.577511:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13753 00000100:00100000:0.0:1746143768.577516:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:31529:x1830963594351488:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.577523:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.577533:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a819c expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.577549:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 44 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.577556:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143768.577557:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143768.577560:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.577579:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 44 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.577590:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 44 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.577599:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594415616:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.577633:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.579281:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.580219:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594415616:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143768.580243:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 31 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.580262:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc4a00, rc 0) 00000100:00100000:1.0:1746143768.580293:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31529:x1830963594351488:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2776us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.580300:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13753 00000100:00100000:3.0:1746143768.581298:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594351744 00000100:00100000:3.0:1746143768.581304:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594351744 00000100:00100000:0.0:1746143768.584448:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.584472:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594351872 00000100:00100000:0.0:1746143768.584477:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594351872 00002000:00100000:0.0:1746143768.584509:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1974272->1990655) req@ffff88009ca6ea00 x1830963594351872/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 16872/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.584518:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ea00 with x1830963594351872 ext(1974272->1990655) 00010000:00010000:0.0:1746143768.584525:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 45 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.584538:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 45 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:0.0:1746143768.584545:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca6ea00 00000100:00100000:0.0:1746143768.584561:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1843 00000100:00100000:0.0:1746143768.584567:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1965:x1830963594351872:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143768.584938:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1965:x1830963594351872:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 370us (495us total) trans 17179873169 rc 0/0 00000100:00100000:0.0:1746143768.584945:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1843 00002000:00100000:0.0:1746143768.584950:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1974272->1990655) req@ffff88009ca6ea00 x1830963594351872/t17179873169(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 16872/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.584959:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ea00 with x1830963594351872 ext(1974272->1990655) 00010000:00010000:0.0:1746143768.584964:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 47 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.584973:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 47 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:0.0:1746143768.584979:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca6ea00 00000100:00100000:3.0:1746143768.586449:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9268 00000100:00100000:3.0:1746143768.586456:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31532:x1830963594351744:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.586469:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.586483:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730bc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81a3 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.586556:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.586569:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.586575:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.586598:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.586608:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 8 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.586617:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594415744:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.586669:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a21576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.588104:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.588128:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594352000 00000100:00100000:3.0:1746143768.588133:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594352000 00010000:00010000:3.0:1746143768.588177:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 47 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.588196:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7383 00000100:00100000:3.0:1746143768.588202:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1964:x1830963594352000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.588209:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.588224:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 47 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.588234:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 47 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.588251:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba27c00/0xe984082ccd730b12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->1990655) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8141 expref: 47 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.588261:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.588263:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.588269:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.588276:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.588295:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.588304:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594415872:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.588337:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.591441:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594415744:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.591462:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143768.591464:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594415872:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.591474:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.591503:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1964:x1830963594352000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3300us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.591822:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.591948:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7383 00000100:00100000:3.0:1746143768.591970:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594352128 00000100:00100000:3.0:1746143768.591974:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594352128 00010000:00010000:3.0:1746143768.591992:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.592012:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7384 00000100:00100000:3.0:1746143768.592017:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594352128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.592025:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.592030:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.592039:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.592055:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326600/0xe984082ccd730b89 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a816b expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.592066:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.592070:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.592077:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.592083:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.592095:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.592112:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594352128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.592117:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7384 00010000:00010000:2.0:1746143768.593316:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.593325:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143768.593343:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143768.593455:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327400/0xe984082ccd730bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.593482:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.593493:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.593495:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143768.593497:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327000, rc 0) 00000100:00100000:2.0:1746143768.593539:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594351744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 7083us (14260us total) trans 8589943618 rc 0/0 00000100:00100000:2.0:1746143768.593545:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9268 00000100:00100000:0.0:1746143768.593865:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.593932:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594352384 00000100:00100000:0.0:1746143768.593936:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594352384 00002000:00100000:0.0:1746143768.593959:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6ca80 x1830963594352384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.593974:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ca80 with x1830963594352384 ext(1048576->2097151) 00002000:00010000:0.0:1746143768.593977:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6ca80 00000100:00100000:0.0:1746143768.593989:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6515 00000100:00100000:0.0:1746143768.593994:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594352384:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143768.601318:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.602092:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594352512 00000100:00100000:1.0:1746143768.602099:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594352512 00000100:00100000:3.0:1746143768.602178:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9269 00000100:00100000:3.0:1746143768.602191:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594352512:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.602209:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.602223:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730bd6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81aa expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.602293:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.602304:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.602311:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.602333:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.602343:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.602353:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594416000:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.602399:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.608848:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594416000:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.608868:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143768.610758:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.612265:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594352640 00000100:00100000:3.0:1746143768.612273:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594352640 00010000:00010000:3.0:1746143768.612361:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.612384:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7385 00000100:00100000:3.0:1746143768.612390:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594352640:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.612400:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.612406:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.612416:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.612432:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327000/0xe984082ccd730bc8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81a3 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.612443:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.612447:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.612455:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.612461:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.612476:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.613190:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594352640:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 798us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.613197:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7385 00010000:00010000:3.0:1746143768.614232:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.614240:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143768.614275:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143768.614279:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143768.614291:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.614317:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327600/0xe984082ccd730bd6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81aa expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.614330:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81aa expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.614336:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.614338:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143768.614341:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326200, rc 0) 00000100:00100000:3.0:1746143768.614372:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594352512:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 12183us (13061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.614378:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9269 00000100:00100000:2.0:1746143768.617432:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.617455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.617471:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594352768 00000100:00100000:2.0:1746143768.617478:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594352768 00000100:00100000:3.0:1746143768.617616:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594352896 00000100:00100000:3.0:1746143768.617620:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594352896 00000100:00100000:3.0:1746143768.617641:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13754 00000100:00100000:3.0:1746143768.617647:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594352768:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.617660:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.617672:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81b1 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.617677:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13755 00000100:00100000:2.0:1746143768.617683:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594352896:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.617688:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.617689:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.617690:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.617696:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009089e400/0xe984082ccd730beb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81b8 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.617697:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.617709:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 11 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.617721:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326c00, rc 0) 00000100:00100000:2.0:1746143768.617726:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416128:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143768.617751:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594352768:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.617756:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13754 00000100:00100000:2.0:1746143768.617773:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.618898:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1964:x1830963594352384:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 24900us (25031us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.618906:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6515 00002000:00100000:2.0:1746143768.618914:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6ca80 x1830963594352384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.618921:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ca80 with x1830963594352384 ext(1048576->2097151) 00002000:00010000:2.0:1746143768.618925:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6ca80 00000100:00100000:0.0:1746143768.619057:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416128:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143768.619074:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009089e400/0xe984082ccd730beb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b8 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.619082:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009089e400/0xe984082ccd730beb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b8 expref: 8 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.619096:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009089e400, rc 0) 00000100:00100000:0.0:1746143768.619127:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594352896:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1444us (1671us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143768.619132:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13755 00000100:00100000:0.0:1746143768.624058:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.624268:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353152 00000100:00100000:3.0:1746143768.624276:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353152 00000100:00100000:3.0:1746143768.624312:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9270 00000100:00100000:3.0:1746143768.624319:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594353152:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.624334:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.624348:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730bf2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81bf expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.624421:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.624433:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.624441:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143768.624451:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.624542:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327800/0xe984082ccd730bf2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.624557:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.624568:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.624571:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143768.624573:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327200, rc 0) 00000100:00100000:3.0:1746143768.624610:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31532:x1830963594353152:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 291us (557us total) trans 8589943619 rc 0/0 00000100:00100000:3.0:1746143768.624615:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9270 00000100:00100000:2.0:1746143768.626444:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.626462:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353280 00000100:00100000:0.0:1746143768.626468:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353280 00000100:00100000:0.0:1746143768.627426:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13756 00000100:00100000:0.0:1746143768.627433:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594353280:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143768.627464:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.627479:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 16 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.627487:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 7 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.627494:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.627499:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.627501:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.627504:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.627531:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.627542:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 9 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.627553:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416256:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.627614:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 7 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.627621:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 7 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.627628:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416384:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.627648:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 16 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.627655:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 16 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.627662:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416512:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.627676:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.630035:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.630059:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.630071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.630087:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.630098:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.630110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.630121:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353408 00000100:00100000:2.0:1746143768.630128:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353408 00000100:00100000:0.0:1746143768.630129:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.630166:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353664 00000100:00100000:0.0:1746143768.630169:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353664 00000100:00100000:2.0:1746143768.630175:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353920 00000100:00100000:2.0:1746143768.630178:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353920 00000100:00100000:0.0:1746143768.630187:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353536 00000100:00100000:0.0:1746143768.630188:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353536 00000100:00100000:2.0:1746143768.630189:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594353792 00000100:00100000:2.0:1746143768.630190:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594353792 00000100:00100000:0.0:1746143768.630201:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13757 00000100:00100000:0.0:1746143768.630207:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594353408:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143768.630236:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.630250:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 45 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.630258:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.630265:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.630271:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.630272:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.630275:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.630296:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 30 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.630305:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 30 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.630315:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594416640:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.630333:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13758 00000100:00100000:2.0:1746143768.630340:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594353664:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:3.0:1746143768.630353:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13759 00010000:00010000:2.0:1746143768.630357:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.630359:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594353920:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143768.630362:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.630368:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 9 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.630369:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 13 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.630374:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.630375:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 9 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143768.630375:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594416768:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.630383:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.630383:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 16 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.630388:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.630389:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.630389:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.630391:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.630395:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.630395:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 45 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.630401:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.630402:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.630402:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 45 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.630404:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 6/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.630406:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 16 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143768.630409:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594416896:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.630414:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 16 pid: 8496 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.630416:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143768.630420:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073780 going to sleep for 11 seconds 00010000:00010000:3.0:1746143768.630424:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.630428:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594417024:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.630431:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594417152:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.630432:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354048 00000100:00100000:0.0:1746143768.630434:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354048 00010000:00010000:0.0:1746143768.630448:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 10 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.630456:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 10 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.630463:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 10 pid: 4581 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.630466:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354176 00000100:00100000:0.0:1746143768.630468:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354176 00000100:00100000:2.0:1746143768.630470:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594417280:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.630475:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 10 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.630488:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7386 00000100:00100000:0.0:1746143768.630492:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594354048:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.630499:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.630516:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 10 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.630524:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 10 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.630531:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.630533:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 10 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.630538:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 13 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.630539:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143768.630540:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 10 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.630545:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594417408:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.630548:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594417536:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.630558:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594354048:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.630560:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368b3a80 going to sleep for 11 seconds 00010000:00010000:3.0:1746143768.630562:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.630563:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7386 00010000:00010000:3.0:1746143768.630568:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.630573:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13760 00000100:00100000:3.0:1746143768.630575:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594417664:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.630575:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7387 00000100:00100000:2.0:1746143768.630578:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594353536:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:0.0:1746143768.630580:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594354176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.630585:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143768.630587:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2157f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143768.630591:0:9527:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.630591:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 10 pid: 8496 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.630598:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 10 pid: 8496 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.630601:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.630607:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143768.630611:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.630616:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.630617:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143768.630617:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594354176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 37us (487us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143768.630619:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.630622:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7387 00010000:00010000:2.0:1746143768.630633:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143768.630637:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13761 00010000:00010000:2.0:1746143768.630641:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 13 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.630642:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594353792:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:2.0:1746143768.630648:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594417792:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.630656:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.630664:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.630667:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.630669:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143768.630670:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143768.630672:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.630674:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.630681:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594417920:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.630685:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 9 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.630690:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8cf00 going to sleep for 11 seconds 00010000:00010000:0.0:1746143768.630693:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 9 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.630700:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594418048:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.630714:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c073f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746143768.630745:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd7309de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8084 expref: 9 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.630754:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416256:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.630763:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093326800/0xe984082ccd730b90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8172 expref: 9 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.630770:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416384:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.630778:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594416512:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.630793:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.632744:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.632844:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354304 00000100:00100000:2.0:1746143768.632849:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354304 00010000:00010000:2.0:1746143768.632867:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 17 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.632887:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7388 00000100:00100000:2.0:1746143768.632892:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594354304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.632900:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.632913:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 17 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.632957:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594416640:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.632969:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594416768:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.632976:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8496:1830963594416896:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.632991:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.633856:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 17 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.633875:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792e00/0xe984082ccd730975 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a804c expref: 17 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.633888:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.633890:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.633894:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.633900:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.633916:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143768.633925:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.633934:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.633953:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.633954:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594354304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1061us (1213us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143768.633960:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.633964:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7388 00010000:00010000:1.0:1746143768.633967:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.633972:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094768000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143768.633975:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.633986:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.633994:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.633996:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594417024:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143768.633999:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094768000/0xe984082ccd730c07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.634466:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594417152:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.634506:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594417280:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.634590:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594353280:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 7156us (8148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.634598:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13756 00000100:00100000:1.0:1746143768.637482:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.637509:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.637635:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594418048:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.637655:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.637658:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594417408:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.637669:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594417664:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.637686:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.637705:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594417536:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.637719:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.637808:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355072 00000100:00100000:0.0:1746143768.637813:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355072 00000100:00100000:1.0:1746143768.637819:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.637832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.637845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:0.0:1746143768.637845:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2834432->2973695) req@ffff8800935a2d80 x1830963594355072/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.637853:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2d80 with x1830963594355072 ext(2834432->2973695) 00000100:00100000:1.0:1746143768.637856:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143768.637859:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 9 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.637868:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 9 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:0.0:1746143768.637873:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a2d80 00000100:00100000:1.0:1746143768.637880:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.637886:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355456 00000100:00100000:0.0:1746143768.637888:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355456 00000100:00100000:1.0:1746143768.637893:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:0.0:1746143768.637898:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3284991) req@ffff8800935a3100 x1830963594355456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 504/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143768.637903:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:0.0:1746143768.637904:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3100 with x1830963594355456 ext(2097152->3284991) 00010000:00010000:0.0:1746143768.637908:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.637915:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:0.0:1746143768.637919:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a3100 00000100:00100000:1.0:1746143768.637922:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.637929:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1844 00000100:00100000:1.0:1746143768.637934:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354432 00000100:00100000:0.0:1746143768.637934:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594355072:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143768.637936:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354432 00010000:00010000:1.0:1746143768.637952:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 14 pid: 4581 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.637967:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354688 00000100:00100000:1.0:1746143768.637969:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354688 00010000:00010000:1.0:1746143768.637976:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 8 pid: 4581 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.637984:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354944 00000100:00100000:1.0:1746143768.637985:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354944 00010000:00010000:1.0:1746143768.637992:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 15 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.637999:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355584 00000100:00100000:1.0:1746143768.638001:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355584 00010000:00010000:1.0:1746143768.638007:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 11 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.638014:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354560 00000100:00100000:1.0:1746143768.638016:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354560 00010000:00010000:1.0:1746143768.638022:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 31 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.638028:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594354816 00000100:00100000:1.0:1746143768.638030:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594354816 00010000:00010000:1.0:1746143768.638035:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 16 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.638042:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355328 00000100:00100000:1.0:1746143768.638043:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355328 00010000:00010000:1.0:1746143768.638050:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 32 pid: 4581 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.638057:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355712 00000100:00100000:1.0:1746143768.638058:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355712 00010000:00010000:1.0:1746143768.638065:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 46 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.638073:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7389 00000100:00100000:1.0:1746143768.638077:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963594354432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.638085:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143768.638089:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7390 00000100:00100000:0.0:1746143768.638094:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594354688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00002000:00010000:1.0:1746143768.638097:0:23335:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:1.0:1746143768.638102:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 16 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.638103:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.638110:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 16 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.638113:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 8 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.638120:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 8 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.638126:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd730b97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8179 expref: 16 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.638132:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930c4000/0xe984082ccd730ba5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8187 expref: 8 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.638153:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143768.638171:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143768.638185:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594354432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.638189:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594354688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 94us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.638191:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7389 00000100:00100000:0.0:1746143768.638194:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7390 00000100:00100000:0.0:1746143768.638205:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7391 00000100:00100000:0.0:1746143768.638210:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594354944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.638215:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143768.638223:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7392 00010000:00010000:0.0:1746143768.638223:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 14 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.638228:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594355584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.638230:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 14 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.638236:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.638239:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143768.638243:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 12 pid: 8496 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.638250:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 12 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.638251:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594354944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 41us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.638259:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7391 00010000:00010000:1.0:1746143768.638261:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800953a3c00/0xe984082ccd730a55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80f4 expref: 12 pid: 8496 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.638267:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7393 00010000:00010000:1.0:1746143768.638269:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.638271:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:1965:x1830963594354560:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.638276:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143768.638282:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594355584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 55us (425us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143768.638282:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 32 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.638288:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7392 00010000:00010000:0.0:1746143768.638290:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 32 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.638298:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7394 00010000:00010000:0.0:1746143768.638300:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7309ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a808b expref: 32 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.638302:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594354816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.638307:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143768.638308:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143768.638314:0:23335:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4139 00010000:00010000:1.0:1746143768.638317:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 13 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.638319:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1965:x1830963594354560:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 47us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.638324:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7393 00010000:00010000:1.0:1746143768.638325:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 13 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.638334:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930c4e00/0xe984082ccd730bb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8195 expref: 13 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.638334:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7395 00000100:00100000:0.0:1746143768.638339:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594355328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.638345:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.638346:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143768.638351:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.638357:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594354816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 54us (463us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143768.638358:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 30 pid: 4581 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.638362:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7394 00000100:00100000:1.0:1746143768.638370:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7396 00010000:00010000:0.0:1746143768.638371:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.638373:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143768.638374:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1965:x1830963594355712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.638376:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638378:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.638383:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638385:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 46 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.638392:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 46 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.638394:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143768.638401:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ed02400/0xe984082ccd73097c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8053 expref: 46 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.638407:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143768.638407:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594355328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (503us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143768.638409:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.638411:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.638412:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7395 00010000:00010000:1.0:1746143768.638417:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.638428:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1845 00010000:00010000:1.0:1746143768.638430:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.638432:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594355456:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.638439:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1965:x1830963594355712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 65us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.638444:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7396 00010000:00010000:1.0:1746143768.638465:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638471:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638487:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638494:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638500:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638506:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bebf000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143768.638509:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638515:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638523:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.638533:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bebf000/0xe984082ccd730c0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.638561:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594353408:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 8355us (8531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.638567:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13757 00010000:00010000:2.0:1746143768.639465:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093326c00/0xe984082ccd730be4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81b1 expref: 10 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.639478:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594417792:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.639490:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dc4a00/0xe984082ccd730bba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a819c expref: 29 pid: 4581 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.639497:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594417920:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.639512:0:9527:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639519:0:9527:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639524:0:9527:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639540:0:9527:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639547:0:9527:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639553:0:9527:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639563:0:9527:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a081c800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143768.639565:0:9527:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639571:0:9527:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639581:0:9527:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.639587:0:9527:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a081c800/0xe984082ccd730c23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.639614:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594353536:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 9036us (9525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.639620:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13760 00000100:00100000:0.0:1746143768.639694:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.639711:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355968 00000100:00100000:3.0:1746143768.639716:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355968 00010000:00010000:3.0:1746143768.639732:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.639749:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7397 00000100:00100000:3.0:1746143768.639754:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+45:1963:x1830963594355968:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.639761:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.639769:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.639776:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.639787:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094677000/0xe984082ccd730ae8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8133 expref: 45 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.640076:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.640111:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.640175:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594355840 00000100:00100000:0.0:1746143768.640179:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594355840 00010000:00010000:0.0:1746143768.640191:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 16 pid: 8496 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.640199:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.640207:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7398 00000100:00100000:0.0:1746143768.640212:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1963:x1830963594355840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143768.640218:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356992 00010000:00010000:0.0:1746143768.640218:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143768.640221:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356992 00010000:00010000:0.0:1746143768.640227:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 16 pid: 8496 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.640235:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 16 pid: 8496 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.640241:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9271 00000100:00100000:3.0:1746143768.640246:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31536:x1830963594356992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.640246:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0400/0xe984082ccd730a86 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8109 expref: 16 pid: 8496 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.640256:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.640257:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.640260:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.640260:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.640266:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.640270:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd730c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81c6 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.640281:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.640296:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1963:x1830963594355840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.640302:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7398 00010000:00010000:3.0:1746143768.640337:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.640346:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.640353:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.640929:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.640935:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.640941:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.640966:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.640973:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.640991:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.640997:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.641003:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.641008:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012caacc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143768.641011:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.641017:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.641025:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.641031:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012caacc00/0xe984082ccd730c15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.641059:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963594353664:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10719us (10997us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.641065:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13758 00000100:00100000:3.0:1746143768.641082:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+44:1963:x1830963594355968:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1329us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.641089:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7397 00000100:00100000:0.0:1746143768.641176:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.641194:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.641214:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143768.641241:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641250:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641256:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143768.641264:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143768.641325:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641333:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641337:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641342:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d9800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.641344:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641349:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641356:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.641359:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143768.641361:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143768.641363:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356224 00010000:00010000:2.0:1746143768.641365:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd730c46 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143768.641366:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356224 00010000:00010000:2.0:1746143768.641375:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641380:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00002000:00100000:3.0:1746143768.641384:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3284992->4194303) req@ffff88009ff6d180 x1830963594356224/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143768.641384:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641387:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a081de00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.641389:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00002000:00100000:3.0:1746143768.641393:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d180 with x1830963594356224 ext(3284992->4194303) 00010000:00010000:2.0:1746143768.641397:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.641398:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 11 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.641403:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143768.641405:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.641407:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 11 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.641407:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641410:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081de00/0xe984082ccd730c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00002000:00010000:3.0:1746143768.641413:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6d180 00010000:00010000:2.0:1746143768.641416:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641420:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641425:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641428:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a081d800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.641430:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641434:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641439:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009343f600) 00010000:00010000:2.0:1746143768.641440:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143768.641442:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.641446:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081d800/0xe984082ccd730c3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143768.641456:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356480 00000100:00100000:3.0:1746143768.641459:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356480 00002000:00100000:3.0:1746143768.641470:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009ff6f480 x1830963594356480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143768.641474:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd730c31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81c6 expref: 253 pid: 2976 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143768.641476:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963594356480 ext(2097152->3145727) 00010000:00010000:3.0:1746143768.641481:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 29 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.641481:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a081c200/0xe984082ccd730c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81c6 expref: 253 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.641487:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a081c200, rc 0) 00010000:00010000:3.0:1746143768.641488:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 29 pid: 4581 timeout: 947 lvb_type: 1 00002000:00010000:3.0:1746143768.641493:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6f480 00000100:00100000:3.0:1746143768.641501:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594356736 00000100:00100000:3.0:1746143768.641503:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594356736 00000100:00100000:2.0:1746143768.641508:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31536:x1830963594356992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1261us (1431us total) trans 8589943620 rc 301/301 00002000:00100000:3.0:1746143768.641510:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6d500 x1830963594356736/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143768.641513:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9271 00002000:00100000:3.0:1746143768.641517:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d500 with x1830963594356736 ext(3145728->4194303) 00010000:00010000:3.0:1746143768.641520:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.641527:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.641530:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1846 00002000:00010000:3.0:1746143768.641532:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6d500 00000100:00100000:2.0:1746143768.641535:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594356224:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.641542:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1847 00000100:00100000:3.0:1746143768.641546:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594356480:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.642442:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1848 00000100:00100000:2.0:1746143768.642449:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963594356736:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143768.645634:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594355072:12345-192.168.202.48@tcp:4:cat.0 Request processed in 7692us (8151us total) trans 21474840493 rc 0/0 00000100:00100000:0.0:1746143768.645645:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1844 00002000:00100000:0.0:1746143768.645653:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x354:0x0] (2834432->2973695) req@ffff8800935a2d80 x1830963594355072/t21474840493(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.645663:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a2d80 with x1830963594355072 ext(2834432->2973695) 00010000:00010000:0.0:1746143768.645671:0:26144:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 14 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.645683:0:26144:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 14 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:0.0:1746143768.645689:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a2d80 00000100:00100000:0.0:1746143768.646481:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.646511:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.646523:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.646548:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.646560:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.646589:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357248 00000100:00100000:2.0:1746143768.646597:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357248 00000100:00100000:2.0:1746143768.646624:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357504 00000100:00100000:2.0:1746143768.646626:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357504 00000100:00100000:2.0:1746143768.646640:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357120 00000100:00100000:2.0:1746143768.646642:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357120 00000100:00100000:2.0:1746143768.646650:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357376 00000100:00100000:2.0:1746143768.646652:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357376 00000100:00100000:2.0:1746143768.646660:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357760 00000100:00100000:2.0:1746143768.646662:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357760 00000100:00100000:0.0:1746143768.646669:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13762 00000100:00100000:0.0:1746143768.646676:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1964:x1830963594357248:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143768.646677:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13763 00000100:00100000:2.0:1746143768.646683:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13764 00000100:00100000:3.0:1746143768.646685:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594357504:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143768.646689:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594357120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.646689:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.646692:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.646702:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81e2 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.646702:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81d4 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.646704:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.646713:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81cd expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143768.646718:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a18, atime: 0x68140a17, ctime: 0x68140a18, blocks: 0x81f 00002000:00010000:0.0:1746143768.646718:0:6929:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a17, atime: 0x68140a17, ctime: 0x68140a17, blocks: 0x821 00002000:00010000:2.0:1746143768.646725:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a17, atime: 0x68140a17, ctime: 0x68140a17, blocks: 0x80f 00010000:00010000:3.0:1746143768.646732:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.646732:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.646733:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.646733:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.646733:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.646735:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.646740:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.646740:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.646740:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 47 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.646751:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 47 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.646752:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 18 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.646752:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 18 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.646760:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a64de000, rc 0) 00010000:00010000:2.0:1746143768.646760:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e6c400, rc 0) 00010000:00010000:0.0:1746143768.646760:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5546c00, rc 0) 00000100:00100000:2.0:1746143768.646787:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594357120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 98us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.646793:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13764 00000100:00100000:2.0:1746143768.646805:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13765 00000100:00100000:2.0:1746143768.646809:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1964:x1830963594357376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.646814:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143768.646817:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13766 00010000:00010000:2.0:1746143768.646822:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81db expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.646823:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1964:x1830963594357760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.646829:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746143768.646832:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a18, atime: 0x68140a17, ctime: 0x68140a18, blocks: 0x81f 00010000:00010000:1.0:1746143768.646836:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4daea00/0xe984082ccd730c70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81f0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.646838:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.646839:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.646844:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 49 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.646845:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.646851:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 49 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.646852:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4daea00/0xe984082ccd730c70 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f0 expref: 49 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.646856:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d0600, rc 0) 00010000:00010000:1.0:1746143768.646859:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4daea00/0xe984082ccd730c70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f0 expref: 49 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.646876:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4daea00, rc 0) 00000100:00100000:3.0:1746143768.646908:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594357504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.646913:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13763 00000100:00100000:0.0:1746143768.646913:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+48:1964:x1830963594357248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 238us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.646915:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+48:1964:x1830963594357376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 104us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.646919:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13762 00000100:00100000:2.0:1746143768.646923:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13765 00000100:00100000:0.0:1746143768.646996:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.647025:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357632 00000100:00100000:2.0:1746143768.647028:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357632 00000100:00100000:2.0:1746143768.647042:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13767 00000100:00100000:2.0:1746143768.647046:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594357632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.647051:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.647057:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1a00/0xe984082ccd730c77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81e9 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.647084:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594418176:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143768.647153:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a54e1840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.647760:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+46:1964:x1830963594357760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 935us (1196us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143768.647765:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13766 00000100:00100000:2.0:1746143768.656326:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594418176:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143768.656352:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1a00/0xe984082ccd730c77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e9 expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.656368:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5d1a00/0xe984082ccd730c77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e9 expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.656381:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5d1a00, rc 0) 00000100:00100000:2.0:1746143768.656425:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594357632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 9377us (9428us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143768.656436:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13767 00000100:00100000:2.0:1746143768.656832:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:1962:x1830963594356480:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15285us (15636us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.656837:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1847 00002000:00100000:2.0:1746143768.656844:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009ff6f480 x1830963594356480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.656850:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963594356480 ext(2097152->3145727) 00010000:00010000:2.0:1746143768.656855:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 31 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.656862:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 31 pid: 4581 timeout: 947 lvb_type: 1 00002000:00010000:2.0:1746143768.656865:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6f480 00000100:00100000:1.0:1746143768.661237:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1962:x1830963594355456:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22797us (23720us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.661250:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1845 00002000:00100000:1.0:1746143768.661260:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3284991) req@ffff8800935a3100 x1830963594355456/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 504/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.661269:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3100 with x1830963594355456 ext(2097152->3284991) 00010000:00010000:1.0:1746143768.661277:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 12 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.661288:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 12 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:1.0:1746143768.661294:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935a3100 00000100:00100000:2.0:1746143768.664097:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1962:x1830963594356224:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22557us (22916us total) trans 0 rc 909312/909312 00000100:00100000:2.0:1746143768.664106:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1846 00002000:00100000:2.0:1746143768.664114:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3284992->4194303) req@ffff88009ff6d180 x1830963594356224/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 909312/909312 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.664122:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d180 with x1830963594356224 ext(3284992->4194303) 00010000:00010000:2.0:1746143768.664130:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.664153:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00002000:00010000:2.0:1746143768.664169:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6d180 00000100:00100000:3.0:1746143768.665772:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.666502:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594357888 00000100:00100000:2.0:1746143768.666508:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594357888 00000100:00100000:2.0:1746143768.666539:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13768 00000100:00100000:2.0:1746143768.666545:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+31:31529:x1830963594357888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.666559:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.666571:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81f7 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.666589:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.666593:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.666599:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143768.666602:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.666615:0:8495:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.666625:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 32 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.666639:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2d600, rc 0) 00000100:00100000:2.0:1746143768.666824:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+32:31529:x1830963594357888:12345-192.168.202.48@tcp:101:cat.0 Request processed in 277us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.666830:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13768 00000100:00100000:2.0:1746143768.667272:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594356736:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24822us (26056us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.667279:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1848 00002000:00100000:2.0:1746143768.667286:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6d500 x1830963594356736/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.667294:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d500 with x1830963594356736 ext(3145728->4194303) 00010000:00010000:2.0:1746143768.667300:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.667309:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00002000:00010000:2.0:1746143768.667315:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6d500 00000100:00100000:1.0:1746143768.667471:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.667487:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358016 00000100:00100000:1.0:1746143768.667489:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358016 00010000:00010000:1.0:1746143768.667504:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.667520:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7399 00000100:00100000:1.0:1746143768.667524:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594358016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.667532:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.667555:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.667563:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.667582:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093326e00/0xe984082ccd730b6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->2973695) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8164 expref: 10 pid: 12618 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.667593:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.667594:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.667598:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.667605:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.667627:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143768.667642:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594358016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 118us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.667648:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7399 00010000:00010000:0.0:1746143768.667710:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667719:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667750:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667756:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667762:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667768:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bebe000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143768.667771:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667778:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667788:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.667794:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bebe000/0xe984082ccd730c2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.667832:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963594353792:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 37188us (37731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.667838:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13761 00000100:00100000:1.0:1746143768.669348:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.669370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.669381:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.669427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.669442:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358528 00000100:00100000:1.0:1746143768.669446:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358528 00002000:00100000:1.0:1746143768.669467:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800935a3800 x1830963594358528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.669475:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3800 with x1830963594358528 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.669478:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a3800 00000100:00100000:1.0:1746143768.669493:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358400 00000100:00100000:1.0:1746143768.669495:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358400 00002000:00100000:1.0:1746143768.669504:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800935a3b80 x1830963594358400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143768.669607:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358784 00000100:00100000:2.0:1746143768.669609:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594358912 00000100:00100000:0.0:1746143768.669611:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358784 00000100:00100000:2.0:1746143768.669613:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594358912 00002000:00100000:0.0:1746143768.669625:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800935a0000 x1830963594358784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.669626:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800935a0380 x1830963594358912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.669632:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0000 with x1830963594358784 ext(0->1048575) 00002000:00100000:2.0:1746143768.669633:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0380 with x1830963594358912 ext(1048576->2097151) 00002000:00010000:0.0:1746143768.669635:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a0000 00002000:00010000:2.0:1746143768.669637:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a0380 00000100:00100000:0.0:1746143768.669646:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6516 00000100:00100000:2.0:1746143768.669650:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6517 00000100:00100000:0.0:1746143768.669652:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1965:x1830963594358528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.669656:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594358784:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.669713:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6518 00000100:00100000:3.0:1746143768.669720:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594358912:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:1.0:1746143768.670976:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3b80 with x1830963594358400 ext(1048576->2097151) 00002000:00010000:1.0:1746143768.670980:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a3b80 00000100:00100000:1.0:1746143768.671005:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6519 00000100:00100000:1.0:1746143768.671012:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+47:1965:x1830963594358400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.674099:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.674448:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359168 00000100:00100000:1.0:1746143768.674456:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359168 00010000:00010000:1.0:1746143768.674484:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.674519:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7400 00000100:00100000:1.0:1746143768.674526:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1965:x1830963594359168:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.674538:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.674556:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.674571:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.674590:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093327c00/0xe984082ccd730b43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8156 expref: 30 pid: 4581 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.674604:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.674606:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.674610:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.674617:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.674652:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143768.674685:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594359168:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 158us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.674691:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7400 00010000:00010000:3.0:1746143768.674783:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674791:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674809:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674815:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674821:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674827:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093326400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143768.674831:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674842:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674850:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.674851:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.674856:0:15784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674863:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.674885:0:15784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 28 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.674895:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594418304:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.674950:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f3d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.678233:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594418304:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.678255:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.678264:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093326400/0xe984082ccd730c1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.678325:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594353920:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 47964us (48251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.678335:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13759 00000100:00100000:1.0:1746143768.680308:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.680376:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359424 00000100:00100000:3.0:1746143768.680383:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359424 00000100:00100000:1.0:1746143768.680388:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:3.0:1746143768.680415:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800935a0700 x1830963594359424/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143768.680422:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359680 00002000:00100000:3.0:1746143768.680424:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0700 with x1830963594359424 ext(2097152->3145727) 00000100:00100000:2.0:1746143768.680426:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359680 00002000:00010000:3.0:1746143768.680429:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a0700 00000100:00100000:3.0:1746143768.680446:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6520 00000100:00100000:2.0:1746143768.680450:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9272 00000100:00100000:3.0:1746143768.680452:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594359424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.680455:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31532:x1830963594359680:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143768.680484:0:2976:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.680502:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093326200/0xe984082ccd730bdd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81aa expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680515:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.680519:0:2976:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143768.680540:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.680549:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 251 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680555:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680560:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680566:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 251 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680571:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 14 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680577:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.680598:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 14 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680607:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 14 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.680616:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418432:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.680676:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 251 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680683:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 251 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.680689:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418560:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.680704:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680710:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 14 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.680716:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418688:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.680728:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680737:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 251 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.680742:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b07100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418816:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.680755:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 251 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.680760:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 251 pid: 20509 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.680766:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418944:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.680784:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.682004:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594358784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12343us (12617us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.682012:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6517 00002000:00100000:2.0:1746143768.682019:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800935a0000 x1830963594358784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.682028:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0000 with x1830963594358784 ext(0->1048575) 00002000:00010000:2.0:1746143768.682031:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a0000 00000100:00100000:3.0:1746143768.688561:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594358912:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18833us (19126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.688561:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.688571:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6518 00002000:00100000:3.0:1746143768.688581:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800935a0380 x1830963594358912/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.688589:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0380 with x1830963594358912 ext(1048576->2097151) 00002000:00010000:3.0:1746143768.688595:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a0380 00000100:00100000:3.0:1746143768.688651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.688662:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418432:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.688670:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.688673:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418560:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.688680:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418688:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.688688:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b07100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418816:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.688695:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594418944:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.688698:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.688713:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359936 00000100:00100000:3.0:1746143768.688717:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359936 00010000:00010000:2.0:1746143768.688718:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:2.0:1746143768.688736:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360064 00000100:00100000:2.0:1746143768.688739:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360064 00010000:00010000:3.0:1746143768.688740:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 15 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.688751:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 16 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.688757:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594359808 00000100:00100000:3.0:1746143768.688760:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594359808 00000100:00100000:2.0:1746143768.688766:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360192 00010000:00010000:3.0:1746143768.688768:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 252 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.688768:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360192 00000100:00100000:3.0:1746143768.688777:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7401 00000100:00100000:3.0:1746143768.688782:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594359936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.688791:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143768.688792:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7402 00010000:00010000:3.0:1746143768.688796:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 16 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.688799:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594360064:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.688804:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 16 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.688806:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.688810:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 16 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.688820:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63d8a00/0xe984082ccd730aa2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8110 expref: 16 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.688898:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 253 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.688911:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7403 00000100:00100000:2.0:1746143768.688917:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1965:x1830963594359808:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.688923:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.688927:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 253 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.689326:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+48:1965:x1830963594358528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19672us (19978us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143768.689333:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6516 00002000:00100000:0.0:1746143768.689339:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800935a3800 x1830963594358528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.689347:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3800 with x1830963594358528 ext(1048576->2097151) 00002000:00010000:0.0:1746143768.689351:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a3800 00000100:00100000:0.0:1746143768.689371:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7404 00000100:00100000:0.0:1746143768.689376:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1963:x1830963594360192:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.689382:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.689386:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 253 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.689392:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 15 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.689402:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.689407:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.689415:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143768.689421:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 253 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.689431:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594359936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 648us (872us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143768.689432:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 253 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.689437:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7401 00010000:00010000:1.0:1746143768.689444:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091302a00/0xe984082ccd730a1d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80bc expref: 14 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.689450:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0e1400/0xe984082ccd730a71 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80fb expref: 253 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.689453:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.689454:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bde5e00/0xe984082ccd730a16 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80b5 expref: 253 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.689455:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000001:00080000:3.0:1746143768.689456:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873164 is committed 00010000:00010000:1.0:1746143768.689459:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143768.689460:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.689464:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.689469:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1746143768.689476:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873119 is committed 00000100:00100000:1.0:1746143768.689477:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594360064:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 679us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.689481:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7402 00000001:00080000:3.0:1746143768.689505:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873148 is committed 00000001:00080000:3.0:1746143768.689511:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873147 is committed 00010000:00010000:0.0:1746143768.689518:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.689522:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:2.0:1746143768.689526:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963594359808:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 608us (853us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143768.689527:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.689531:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7403 00000001:00080000:3.0:1746143768.689537:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873167 is committed 00000100:00100000:0.0:1746143768.689545:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1963:x1830963594360192:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 169us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.689551:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7404 00000001:00080000:3.0:1746143768.689575:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873168 is committed 00000100:00100000:0.0:1746143768.689597:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.690011:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594358400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18999us (20639us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143768.690017:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6519 00002000:00100000:0.0:1746143768.690022:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800935a3b80 x1830963594358400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.690029:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3b80 with x1830963594358400 ext(1048576->2097151) 00002000:00010000:0.0:1746143768.690033:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a3b80 00000100:00100000:1.0:1746143768.690173:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360320 00000100:00100000:1.0:1746143768.690177:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360320 00010000:00010000:1.0:1746143768.690190:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 250 pid: 20509 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.690218:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7405 00000100:00100000:1.0:1746143768.690223:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1965:x1830963594360320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.690230:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.690233:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 250 pid: 20509 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.690241:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 250 pid: 20509 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.690251:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd730a0f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a80ae expref: 250 pid: 20509 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.690259:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143768.690262:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143768.690267:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143768.690273:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143768.690291:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143768.690316:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1965:x1830963594360320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.690321:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7405 00000100:00100000:2.0:1746143768.690724:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1965:x1830963594359424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10271us (10419us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.690731:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6520 00002000:00100000:2.0:1746143768.690736:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff8800935a0700 x1830963594359424/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.690779:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0700 with x1830963594359424 ext(2097152->3145727) 00002000:00010000:2.0:1746143768.690783:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a0700 00010000:00010000:2.0:1746143768.690800:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.690806:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000040:00080000:2.0:1746143768.691894:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2723, 88 off230168 00000004:00080000:2.0:1746143768.691899:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847701759558ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.691951:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2735, 88 off231400 00000004:00080000:2.0:1746143768.691955:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847701815383ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.692257:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2736, 88 off231488 00000004:00080000:2.0:1746143768.692261:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847702121160ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.692268:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2724, 88 off230256 00000004:00080000:2.0:1746143768.692271:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702130965ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692278:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2725, 88 off230344 00000004:00080000:2.0:1746143768.692280:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702140828ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692286:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2737, 88 off231576 00000004:00080000:2.0:1746143768.692288:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847702148624ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.692294:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2738, 88 off231664 00000004:00080000:2.0:1746143768.692296:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847702156085ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.692301:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2739, 88 off231752 00000004:00080000:2.0:1746143768.692303:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847702162996ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.692308:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2726, 88 off230432 00000004:00080000:2.0:1746143768.692310:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702170395ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692317:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2740, 88 off231840 00000004:00080000:2.0:1746143768.692320:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847702180184ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.692327:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2727, 88 off230520 00000004:00080000:2.0:1746143768.692329:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702189824ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692336:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2741, 88 off231928 00000004:00080000:2.0:1746143768.692337:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847702197806ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.692342:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2728, 88 off230608 00000004:00080000:2.0:1746143768.692344:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702204396ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692349:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2729, 88 off230696 00000004:00080000:2.0:1746143768.692351:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702211319ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692356:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2730, 88 off230784 00000004:00080000:2.0:1746143768.692358:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702218466ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692363:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2731, 88 off230872 00000004:00080000:2.0:1746143768.692365:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847702225955ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.692371:0:2976:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2742, 88 off232016 00000004:00080000:2.0:1746143768.692374:0:2976:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847702234163ns, next at 833304778357ns, rc = 0 00000100:00100000:3.0:1746143768.695464:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.696246:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360448 00000100:00100000:2.0:1746143768.696254:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360448 00000100:00100000:2.0:1746143768.696285:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9273 00000100:00100000:2.0:1746143768.696291:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31536:x1830963594360448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.696308:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.696321:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a81fe expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.696362:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.696369:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 250 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.696382:0:16090:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143768.696389:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 250 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.696399:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.696402:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143768.696405:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 250 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.696411:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13c00, rc 0) 00000100:00100000:2.0:1746143768.696444:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31536:x1830963594360448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 152us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.696449:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9273 00000100:00100000:0.0:1746143768.699576:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.699620:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360576 00000100:00100000:3.0:1746143768.699628:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360576 00000100:00100000:3.0:1746143768.699661:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13769 00000100:00100000:3.0:1746143768.699667:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31529:x1830963594360576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.699680:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.699694:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8205 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143768.699714:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a18, atime: 0x68140a17, ctime: 0x68140a18, blocks: 0x14a9 00010000:00010000:3.0:1746143768.699729:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.699731:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.699737:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.699750:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.699758:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091338400, rc 0) 00000100:00100000:3.0:1746143768.699793:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31529:x1830963594360576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.699798:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13769 00000100:00100000:3.0:1746143768.700947:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.701002:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360704 00000100:00100000:2.0:1746143768.701007:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360704 00000100:00100000:2.0:1746143768.701099:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9274 00000100:00100000:2.0:1746143768.701109:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31529:x1830963594360704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.701121:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.701130:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a820c expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.701196:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a820c expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.701204:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a820c expref: 14 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.701213:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.701216:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143768.701219:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 249 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.701224:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf12a00, rc 0) 00000100:00100000:2.0:1746143768.701247:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31529:x1830963594360704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 143us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.701252:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9274 00000001:00080000:1.0:1746143768.708498:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943621 is committed 00000004:00080000:1.0:1746143768.708508:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2077 committed 00000004:00080000:1.0:1746143768.708514:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2066 committed 00000004:00010000:3.0:1746143768.708568:0:2976:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800935a0a80 reply state ffff88008ec58400 transno 8589943621 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143768.708579:0:2976:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1746143768.708661:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2065 committed 00000004:00080000:1.0:1746143768.708663:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2064 committed 00000004:00080000:1.0:1746143768.708664:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2063 committed 00000004:00080000:1.0:1746143768.708665:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2076 committed 00000004:00080000:1.0:1746143768.708666:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2062 committed 00000004:00080000:1.0:1746143768.708667:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2075 committed 00000004:00080000:1.0:1746143768.708669:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2061 committed 00000004:00080000:1.0:1746143768.708670:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2074 committed 00000004:00080000:1.0:1746143768.708671:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2073 committed 00000004:00080000:1.0:1746143768.708672:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2072 committed 00000004:00080000:1.0:1746143768.708673:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2060 committed 00000004:00080000:1.0:1746143768.708674:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2059 committed 00000004:00080000:1.0:1746143768.708679:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2071 committed 00000004:00080000:1.0:1746143768.708680:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2070 committed 00000004:00080000:1.0:1746143768.708682:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2058 committed 00000001:00080000:1.0:1746143768.708687:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943620 is committed 00000001:00080000:1.0:1746143768.708694:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943617 is committed 00000100:00100000:1.0:1746143768.708736:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594419456:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746143768.708788:0:2976:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143768.708799:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594359680:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 28341us (28409us total) trans 8589943621 rc 0/0 00000100:00100000:3.0:1746143768.708806:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9272 00000100:00100000:2.0:1746143768.708822:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594419072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.708875:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.708882:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594419200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143768.708897:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.708898:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594419968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143768.708908:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594419712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.708910:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.708919:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.708925:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594420480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.708928:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594420224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.708937:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.708941:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594419328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.708948:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594420992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.708954:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.708964:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419456 00000100:00100000:2.0:1746143768.708965:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594419840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.708969:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419456 00000100:00100000:2.0:1746143768.708976:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.708984:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594420352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.708989:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419200 00000100:00100000:1.0:1746143768.708991:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419200 00000100:00100000:2.0:1746143768.708995:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143768.709079:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.709086:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.709092:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.709097:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e15b000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.709115:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.709120:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.709131:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.709134:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143768.709169:0:3278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 240 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.709178:0:3278:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 240 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.709185:0:3278:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 240 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.709192:0:3278:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a820c expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.709198:0:3278:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a820c expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.709203:0:3278:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a820c expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.709220:0:3278:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a820c expref: 6 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.709227:0:3278:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594421120:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.709259:0:3278:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 240 pid: 16090 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.709265:0:3278:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594421248:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.709275:0:3278:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc23240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.709366:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419968 00000100:00100000:1.0:1746143768.709369:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419968 00000100:00100000:2.0:1746143768.709375:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594420864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.709384:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419712 00000100:00100000:1.0:1746143768.709385:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419712 00000100:00100000:2.0:1746143768.709391:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.709393:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420480 00000100:00100000:1.0:1746143768.709395:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420480 00000100:00100000:1.0:1746143768.709402:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419328 00000100:00100000:1.0:1746143768.709403:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419328 00000100:00100000:2.0:1746143768.709407:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419840 00000100:00100000:1.0:1746143768.709408:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420352 00000100:00100000:2.0:1746143768.709409:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419840 00000100:00100000:1.0:1746143768.709409:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420352 00000100:00100000:1.0:1746143768.709414:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420864 00000100:00100000:1.0:1746143768.709415:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420864 00000100:00100000:2.0:1746143768.709420:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13770 00000100:00100000:2.0:1746143768.709424:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3292:x1830963594419456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.709517:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13771 00000100:00100000:1.0:1746143768.709522:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3294:x1830963594419200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.709547:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13772 00000100:00100000:1.0:1746143768.709552:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3292:x1830963594419968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143768.709583:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143768.709586:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:2.0:1746143768.709588:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:2.0:1746143768.709590:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:2.0:1746143768.709591:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746143768.709611:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3292:x1830963594419456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (736us total) trans 17179873170 rc 0/0 00000100:00100000:2.0:1746143768.709616:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13770 00000100:00100000:2.0:1746143768.709626:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13773 00000100:00100000:2.0:1746143768.709630:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3294:x1830963594419712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.709630:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3292:x1830963594419968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (719us total) trans 17179873171 rc 0/0 00000100:00100000:1.0:1746143768.709635:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13772 00000100:00100000:1.0:1746143768.709642:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13774 00000100:00100000:1.0:1746143768.709645:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3292:x1830963594420480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.709701:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3294:x1830963594419712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (781us total) trans 17179873172 rc 0/0 00000100:00100000:2.0:1746143768.709709:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13773 00000100:00100000:2.0:1746143768.709717:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13775 00000100:00100000:1.0:1746143768.709720:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594420480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (782us total) trans 21474840494 rc 0/0 00000100:00100000:2.0:1746143768.709721:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3295:x1830963594419328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.709725:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13774 00000100:00100000:1.0:1746143768.709732:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13776 00000100:00100000:1.0:1746143768.709735:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3295:x1830963594420352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143768.709789:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:1.0:1746143768.709791:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143768.709793:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.709794:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143768.709796:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:1.0:1746143768.709815:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3295:x1830963594420352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (818us total) trans 21474840495 rc 0/0 00000100:00100000:1.0:1746143768.709819:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13776 00002000:00010000:2.0:1746143768.709820:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143768.709822:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.709824:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143766 -> 1746143766 00002000:00010000:2.0:1746143768.709825:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.709827:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746143768.709827:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13777 00000100:00100000:1.0:1746143768.709831:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1830963594419840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143768.709842:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3295:x1830963594419328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (887us total) trans 17179873173 rc 0/0 00000100:00100000:2.0:1746143768.709847:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13775 00000100:00100000:2.0:1746143768.709854:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13778 00000100:00100000:2.0:1746143768.709858:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3295:x1830963594420864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.709900:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1830963594419840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (923us total) trans 17179873174 rc 0/0 00000100:00100000:1.0:1746143768.709905:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13777 00000100:00100000:2.0:1746143768.709924:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3295:x1830963594420864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (533us total) trans 21474840496 rc 0/0 00000100:00100000:2.0:1746143768.709929:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13778 00000100:00100000:1.0:1746143768.709929:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.709936:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420992 00000100:00100000:2.0:1746143768.709938:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420992 00000100:00100000:1.0:1746143768.709948:0:3292:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873164 gen 2 00000100:00100000:2.0:1746143768.709949:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13779 00000004:00080000:1.0:1746143768.709951:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c276300, transno 17179873095 00000100:00100000:2.0:1746143768.709952:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594420992:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.709957:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f480, transno 17179873096 00000004:00080000:1.0:1746143768.709959:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe1180, transno 17179873097 00000004:00080000:1.0:1746143768.709961:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79e680, transno 17179873098 00000004:00080000:1.0:1746143768.709963:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0000, transno 17179873099 00000004:00080000:1.0:1746143768.709965:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0700, transno 17179873100 00000004:00080000:1.0:1746143768.709966:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c275c00, transno 17179873101 00000004:00080000:1.0:1746143768.709969:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bfe0a80, transno 17179873102 00000004:00080000:1.0:1746143768.709971:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814380, transno 17179873109 00000004:00080000:1.0:1746143768.709974:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0815f80, transno 17179873110 00000004:00080000:1.0:1746143768.709976:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814e00, transno 17179873111 00000004:00080000:1.0:1746143768.709978:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0815180, transno 17179873112 00000004:00080000:1.0:1746143768.709979:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814000, transno 17179873113 00000004:00080000:1.0:1746143768.709981:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0817480, transno 17179873114 00000004:00080000:1.0:1746143768.709983:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0815c00, transno 17179873115 00000004:00080000:1.0:1746143768.709985:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814700, transno 17179873116 00000004:00080000:1.0:1746143768.709988:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cea00, transno 17179873120 00000004:00080000:1.0:1746143768.709989:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cc380, transno 17179873121 00000004:00080000:1.0:1746143768.709991:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cd880, transno 17179873122 00000004:00080000:1.0:1746143768.709993:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ced80, transno 17179873123 00000004:00080000:1.0:1746143768.709995:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cd180, transno 17179873124 00000004:00080000:1.0:1746143768.709996:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cd500, transno 17179873125 00000004:00080000:1.0:1746143768.709998:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cdf80, transno 17179873126 00000004:00080000:1.0:1746143768.710000:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ce680, transno 17179873127 00000004:00080000:1.0:1746143768.710002:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ee300, transno 17179873128 00000004:00080000:1.0:1746143768.710004:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efad180, transno 17179873129 00000004:00080000:1.0:1746143768.710005:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008eface00, transno 17179873130 00000004:00080000:1.0:1746143768.710008:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efae680, transno 17179873131 00000004:00080000:1.0:1746143768.710009:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efac380, transno 17179873132 00000004:00080000:1.0:1746143768.710011:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efae300, transno 17179873133 00000004:00080000:1.0:1746143768.710013:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efac000, transno 17179873134 00000004:00080000:1.0:1746143768.710015:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efaca80, transno 17179873135 00000004:00080000:1.0:1746143768.710016:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f800, transno 17179873149 00000004:00080000:1.0:1746143768.710018:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79dc00, transno 17179873150 00000004:00080000:1.0:1746143768.710021:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1efb80, transno 17179873151 00000004:00080000:1.0:1746143768.710022:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79d180, transno 17179873152 00000004:00080000:1.0:1746143768.710025:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ee680, transno 17179873153 00000004:00080000:1.0:1746143768.710027:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79c000, transno 17179873154 00000004:00080000:1.0:1746143768.710029:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ec380, transno 17179873155 00000004:00080000:1.0:1746143768.710031:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79c700, transno 17179873156 00000004:00080000:1.0:1746143768.710033:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b05880, transno 17179873157 00000004:00080000:1.0:1746143768.710035:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b852a00, transno 17179873158 00000004:00080000:1.0:1746143768.710036:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093b04380, transno 17179873159 00000004:00080000:1.0:1746143768.710038:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b850700, transno 17179873160 00000004:00080000:1.0:1746143768.710040:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090764380, transno 17179873161 00000004:00080000:1.0:1746143768.710042:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b851180, transno 17179873162 00000004:00080000:1.0:1746143768.710044:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090767b80, transno 17179873163 00000004:00080000:1.0:1746143768.710046:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306300, transno 17179873164 00000100:00100000:1.0:1746143768.710050:0:3292:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009c274e00 x1830963594419456/t17179873170(17179873170) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143784 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143768.710057:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274e00/2, rc 0, transno 17179873170 00000100:00100000:1.0:1746143768.710061:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594419456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.710070:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c275f80/2, rc 0, transno 17179873171 00000100:00100000:1.0:1746143768.710073:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594419968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.710083:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878700/2, rc 0, transno 21474840494 00000100:00100000:1.0:1746143768.710090:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594420480:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143768.710301:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca6c700/2, rc 0, transno 17179873173 00000100:00100000:3.0:1746143768.710305:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594419328:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143768.710312:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274000/2, rc 0, transno 17179873174 00000100:00100000:3.0:1746143768.710315:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594419840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143768.710322:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0879c00/2, rc 0, transno 21474840495 00000100:00100000:3.0:1746143768.710325:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594420352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143768.710330:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a087b480/2, rc 0, transno 21474840496 00000100:00100000:3.0:1746143768.710333:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594420864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.710378:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 48 done 00000100:00100000:1.0:1746143768.710387:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143768.710392:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594421376:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143768.710403:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143768.710406:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143768.710408:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00000100:00100000:1.0:1746143768.710408:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746143768.710410:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143768.710412:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143768.710435:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3294:x1830963594419200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 913us (1537us total) trans 17179873175 rc 0/0 00000100:00100000:3.0:1746143768.710441:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13771 00000100:00100000:3.0:1746143768.710450:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421376 00000100:00100000:3.0:1746143768.710452:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421376 00000100:00100000:3.0:1746143768.710465:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13780 00000100:00100000:3.0:1746143768.710469:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594421376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143768.710544:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963594421376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (135us total) trans 21474840497 rc 0/0 00000100:00100000:3.0:1746143768.710549:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13780 00000100:00100000:0.0:1746143768.710929:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.710970:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360832 00000100:00100000:3.0:1746143768.710973:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360832 00000100:00100000:3.0:1746143768.710993:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9275 00000100:00100000:3.0:1746143768.710998:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594360832:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.711009:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.711019:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8213 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.711044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143768.711063:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.711072:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.711087:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.711089:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143768.711091:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091338800, rc 0) 00000100:00100000:3.0:1746143768.711112:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31532:x1830963594360832:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 114us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.711116:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9275 00000100:00100000:3.0:1746143768.711137:0:3278:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594421120:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.711167:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963594420992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1213us (1236us total) trans 21474840498 rc 0/0 00000100:00100000:2.0:1746143768.711173:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13779 00000100:00100000:2.0:1746143768.711186:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594360960 00000100:00100000:2.0:1746143768.711189:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594360960 00000100:00100000:2.0:1746143768.711204:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4001 00000100:00100000:2.0:1746143768.711208:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31529:x1830963594360960:12345-192.168.202.48@tcp:49:cat.0 00000004:00080000:1.0:1746143768.711208:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093805880/2, rc 0, transno 21474840497 00000100:00100000:1.0:1746143768.711211:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594421376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.711217:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093806d80/2, rc 0, transno 21474840498 00000100:00100000:1.0:1746143768.711220:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594420992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.711305:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31529:x1830963594360960:12345-192.168.202.48@tcp:49:cat.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.711310:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4001 00000100:00100000:2.0:1746143768.711325:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.711338:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594420736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.711359:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420224 00000100:00100000:0.0:1746143768.711361:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420224 00000100:00100000:0.0:1746143768.711433:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13781 00000100:00100000:0.0:1746143768.711440:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3294:x1830963594420224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143768.711515:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143768.711518:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.711520:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:0.0:1746143768.711522:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.711523:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143768.711544:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963594420224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (218us total) trans 21474840499 rc 0/0 00000100:00100000:0.0:1746143768.711548:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13781 00000100:00100000:0.0:1746143768.711572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.711639:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143768.711660:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca6d500/2, rc 0, transno 17179873175 00000100:00100000:2.0:1746143768.711663:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594419200:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143768.711669:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c275180/2, rc 0, transno 17179873172 00000100:00100000:2.0:1746143768.711671:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594419712:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143768.711676:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878e00/2, rc 0, transno 21474840499 00000100:00100000:2.0:1746143768.711679:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594420224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.711689:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.711897:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361088 00000100:00100000:3.0:1746143768.711900:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361088 00000100:00100000:3.0:1746143768.711915:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4002 00000100:00100000:3.0:1746143768.711919:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31536:x1830963594361088:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:3.0:1746143768.711952:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31536:x1830963594361088:12345-192.168.202.48@tcp:49:cat.0 Request processed in 33us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.711957:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4002 00000100:00100000:1.0:1746143768.712028:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420736 00000100:00100000:1.0:1746143768.712031:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420736 00000100:00100000:2.0:1746143768.712035:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594419584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.712045:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419072 00000100:00100000:1.0:1746143768.712046:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419072 00000100:00100000:2.0:1746143768.712051:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.712056:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419584 00000100:00100000:1.0:1746143768.712058:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419584 00000100:00100000:2.0:1746143768.712062:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594420096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.712067:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13782 00000100:00100000:1.0:1746143768.712070:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963594420736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.712074:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.712083:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594420608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.712094:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143768.712112:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420096 00000100:00100000:2.0:1746143768.712115:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420096 00000100:00100000:2.0:1746143768.712125:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420608 00000100:00100000:2.0:1746143768.712127:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420608 00000100:00100000:2.0:1746143768.712135:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13783 00000100:00100000:2.0:1746143768.712153:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594419072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.712177:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963594420736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (537us total) trans 21474840500 rc 0/0 00000100:00100000:1.0:1746143768.712182:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13782 00000100:00100000:1.0:1746143768.712192:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13784 00000100:00100000:1.0:1746143768.712196:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594419584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.712267:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594419584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (214us total) trans 17179873176 rc 0/0 00002000:00010000:2.0:1746143768.712272:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746143768.712272:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13784 00002000:00010000:2.0:1746143768.712275:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143767 -> 1746143767 00002000:00010000:2.0:1746143768.712277:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:2.0:1746143768.712278:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143767 -> 1746143767 00002000:00010000:2.0:1746143768.712280:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143768.712280:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13785 00000100:00100000:1.0:1746143768.712284:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963594420096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.712296:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594419072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (605us total) trans 17179873177 rc 0/0 00000100:00100000:2.0:1746143768.712300:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13783 00002000:00010000:1.0:1746143768.712343:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143768.712345:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.712346:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.712348:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143767 -> 1746143767 00002000:00010000:1.0:1746143768.712349:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:1.0:1746143768.712364:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963594420096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (288us total) trans 21474840501 rc 0/0 00000100:00100000:1.0:1746143768.712371:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13785 00000100:00100000:1.0:1746143768.712378:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13786 00000100:00100000:1.0:1746143768.712382:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963594420608:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143768.712404:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a087aa00/2, rc 0, transno 21474840500 00000100:00100000:2.0:1746143768.712408:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594420736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.712445:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963594420608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (349us total) trans 21474840502 rc 0/0 00000100:00100000:1.0:1746143768.712450:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13786 00000004:00080000:1.0:1746143768.712470:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fc27100/2, rc 0, transno 17179873177 00000100:00100000:1.0:1746143768.712474:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594419072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.712479:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274700/2, rc 0, transno 17179873176 00000100:00100000:1.0:1746143768.712481:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594419584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.712487:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0879180/2, rc 0, transno 21474840501 00000100:00100000:1.0:1746143768.712489:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594420096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.712495:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a087b800/2, rc 0, transno 21474840502 00000100:00100000:1.0:1746143768.712498:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594420608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143768.712782:0:3278:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3278:1830963594421248:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143768.712799:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143768.712806:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e15b000/0xe984082ccd730c85 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 2976 initiator: MDT0 00000100:00100000:0.0:1746143768.713341:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.713387:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361216 00000100:00100000:3.0:1746143768.713391:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361216 00000100:00100000:3.0:1746143768.713412:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9276 00000100:00100000:3.0:1746143768.713417:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594361216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.713428:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.713436:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091338200/0xe984082ccd730ca8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a821a expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.713482:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730caf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.713492:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730caf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.713500:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730caf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143768.713520:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143768.713523:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143768.713534:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730caf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.713550:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091338200/0xe984082ccd730ca8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a821a expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.713561:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730caf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a821a expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.713567:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.713570:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143768.713572:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091339200, rc 0) 00000100:00100000:3.0:1746143768.713603:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31532:x1830963594361216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 185us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.713611:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9276 00000100:00100000:2.0:1746143768.717562:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.717636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.717702:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361344 00000100:00100000:3.0:1746143768.717710:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361344 00000100:00100000:3.0:1746143768.717752:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361472 00000100:00100000:3.0:1746143768.717755:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361472 00000100:00100000:3.0:1746143768.717774:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13787 00000100:00100000:3.0:1746143768.717780:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963594361344:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:1.0:1746143768.717782:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13788 00000100:00100000:1.0:1746143768.717791:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1964:x1830963594361472:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.717793:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.717799:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.717807:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8221 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.717808:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8228 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.717824:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.717824:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.717825:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.717826:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.717832:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 6 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.717832:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 6 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.717843:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 6 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.717846:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 6 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.717852:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091339a00, rc 0) 00010000:00010000:1.0:1746143768.717852:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093238e00, rc 0) 00000100:00100000:1.0:1746143768.717885:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963594361472:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 97us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.717886:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1964:x1830963594361344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 106us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.717890:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13788 00000100:00100000:3.0:1746143768.717893:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13787 00000100:00100000:0.0:1746143768.718463:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.718478:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.718506:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.718520:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361728 00000100:00100000:1.0:1746143768.718523:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361728 00000100:00100000:3.0:1746143768.718531:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361600 00000100:00100000:0.0:1746143768.718533:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.718534:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361600 00000100:00100000:1.0:1746143768.718575:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361856 00000100:00100000:1.0:1746143768.718577:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361856 00000100:00100000:0.0:1746143768.718586:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594361984 00000100:00100000:0.0:1746143768.718588:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594361984 00000100:00100000:3.0:1746143768.718590:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13789 00000100:00100000:1.0:1746143768.718595:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13790 00000100:00100000:3.0:1746143768.718597:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594361728:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:1.0:1746143768.718599:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594361600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.718603:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143768.718603:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13791 00010000:00010000:1.0:1746143768.718606:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143768.718608:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594361856:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.718610:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8236 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.718612:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a822f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.718612:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.718619:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a823d expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.718621:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.718623:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.718624:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.718626:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.718627:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.718628:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.718629:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.718630:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.718633:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.718635:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 8 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.718638:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 9 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.718641:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.718642:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093238200, rc 0) 00010000:00010000:3.0:1746143768.718645:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091338a00, rc 0) 00010000:00010000:0.0:1746143768.718647:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c37400, rc 0) 00000100:00100000:1.0:1746143768.718659:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594361600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.718662:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594361728:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.718664:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13790 00000100:00100000:3.0:1746143768.718668:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13789 00000100:00100000:2.0:1746143768.718674:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13792 00000100:00100000:2.0:1746143768.718679:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1964:x1830963594361984:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.718685:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.718690:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8244 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.718699:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.718700:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.718703:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.718711:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 8 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.718725:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf13a00, rc 0) 00000100:00100000:0.0:1746143768.718757:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594361856:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 149us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.718762:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13791 00000100:00100000:2.0:1746143768.718818:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594361984:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 139us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.718823:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13792 00000100:00100000:0.0:1746143768.719232:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.719264:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.719303:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594362240 00000100:00100000:1.0:1746143768.719307:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594362240 00000100:00100000:2.0:1746143768.719311:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594362496 00000100:00100000:2.0:1746143768.719313:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594362496 00002000:00100000:2.0:1746143768.719328:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012e17ce00 x1830963594362496/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.719328:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094306680 x1830963594362240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.719337:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17ce00 with x1830963594362496 ext(3145728->4194303) 00002000:00100000:1.0:1746143768.719337:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306680 with x1830963594362240 ext(3145728->4194303) 00002000:00010000:2.0:1746143768.719340:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17ce00 00002000:00010000:1.0:1746143768.719340:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306680 00000100:00100000:1.0:1746143768.719351:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6521 00000100:00100000:1.0:1746143768.719356:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594362240:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.719363:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6522 00000100:00100000:2.0:1746143768.719367:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1964:x1830963594362496:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143768.722101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.722124:0:26144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594362752 00000100:00100000:0.0:1746143768.722131:0:26144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594362752 00002000:00100000:0.0:1746143768.722187:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012e17ed80 x1830963594362752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.722196:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17ed80 with x1830963594362752 ext(1048576->2097151) 00002000:00010000:0.0:1746143768.722199:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17ed80 00000100:00100000:0.0:1746143768.722229:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6523 00000100:00100000:0.0:1746143768.722236:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594362752:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.726421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.726454:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.726466:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.726484:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594363136 00000100:00100000:3.0:1746143768.726492:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594363136 00000100:00100000:1.0:1746143768.726499:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.726536:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594363264 00000100:00100000:3.0:1746143768.726538:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594363264 00000100:00100000:3.0:1746143768.726551:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594363520 00000100:00100000:3.0:1746143768.726553:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594363520 00000100:00100000:3.0:1746143768.726562:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594363776 00000100:00100000:3.0:1746143768.726564:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594363776 00000100:00100000:3.0:1746143768.726577:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6524 00000100:00100000:3.0:1746143768.726584:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594363136:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143768.726611:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.726623:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.726625:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.726630:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.726643:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.727043:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6525 00000100:00100000:2.0:1746143768.727052:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594363264:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143768.727072:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.727081:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.727082:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.727085:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.727093:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.727730:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6526 00000100:00100000:3.0:1746143768.727736:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594363520:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143768.727750:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.727756:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.727758:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.727760:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.727767:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.727853:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.727861:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594364288 00000100:00100000:3.0:1746143768.727864:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594364288 00000100:00100000:3.0:1746143768.727882:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6527 00000100:00100000:3.0:1746143768.727887:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594363776:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143768.727899:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.727905:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.727906:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.727909:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.727920:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.728309:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6528 00000100:00100000:2.0:1746143768.728316:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594364288:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143768.728331:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.728339:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.728340:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.728343:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.728351:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.728417:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.728916:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594364032 00000100:00100000:3.0:1746143768.728919:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594364032 00000100:00100000:3.0:1746143768.728937:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6529 00000100:00100000:3.0:1746143768.728941:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594364032:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143768.728953:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.728959:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.728960:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.728963:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.728969:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.732531:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.732549:0:8501:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 11 min 3 max 116 00000100:00100000:0.0:1746143768.732555:0:8501:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_011' 00000100:00100000:2.0:1746143768.732966:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1964:x1830963594362496:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13595us (13697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.732976:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6522 00002000:00100000:2.0:1746143768.732987:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012e17ce00 x1830963594362496/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.732996:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17ce00 with x1830963594362496 ext(3145728->4194303) 00002000:00010000:2.0:1746143768.733001:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17ce00 00000100:00100000:2.0:1746143768.733018:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594364544 00000100:00100000:2.0:1746143768.733024:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594364544 00000100:00100000:2.0:1746143768.733070:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6530 00000100:00100000:2.0:1746143768.733077:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594364544:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143768.733108:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.733121:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.733123:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.733128:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.733170:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.736736:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.736803:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594364800 00000100:00100000:1.0:1746143768.736810:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594364800 00000100:00100000:1.0:1746143768.736863:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6531 00000100:00100000:1.0:1746143768.736869:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594364800:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143768.736902:0:3269:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.736913:0:3269:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.736914:0:3269:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.736919:0:3269:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.736931:0:3269:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.737096:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594362752:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14860us (15001us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.737103:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6523 00002000:00100000:2.0:1746143768.737111:0:26144:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012e17ed80 x1830963594362752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.737119:0:26144:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17ed80 with x1830963594362752 ext(1048576->2097151) 00002000:00010000:2.0:1746143768.737123:0:26144:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17ed80 00010000:00010000:3.0:1746143768.740032:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.740046:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.740054:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.740064:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091338e00 already unused, calling callback (ffffffffa0870d70) 00000100:00100000:1.0:1746143768.740065:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594362240:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20705us (20830us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746143768.740067:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.740074:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.740074:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6521 00010000:00010000:3.0:1746143768.740089:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.740095:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091338e00/0xe984082ccd730ce0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.740127:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594363136:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 13542us (13712us total) trans 0 rc 1048576/1048576 00002000:00100000:1.0:1746143768.740386:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094306680 x1830963594362240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.740394:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306680 with x1830963594362240 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.740399:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306680 00000100:00100000:3.0:1746143768.742648:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6524 00010000:00010000:3.0:1746143768.746427:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.746442:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.746449:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.746455:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091339400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143768.746460:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.746467:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.746485:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.746490:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091339400/0xe984082ccd730cf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.746560:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594363776:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 18668us (20055us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.746569:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6527 00000100:00100000:3.0:1746143768.747353:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.747371:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594365056 00000100:00100000:0.0:1746143768.747378:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594365056 00002000:00100000:0.0:1746143768.747409:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88008efaed80 x1830963594365056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.747418:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaed80 with x1830963594365056 ext(1048576->2097151) 00002000:00010000:0.0:1746143768.747422:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaed80 00000100:00100000:0.0:1746143768.747447:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6532 00000100:00100000:0.0:1746143768.747452:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594365056:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143768.749924:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.749941:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.749948:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.749954:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fafb000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143768.749957:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.749970:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.749987:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.749999:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fafb000/0xe984082ccd730cfc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.750048:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594364288:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 21730us (22192us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.750057:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6528 00010000:00010000:3.0:1746143768.752554:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.752567:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.752574:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.752580:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fafbc00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143768.752583:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.752590:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.752608:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.752613:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fafbc00/0xe984082ccd730ce7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.752668:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594363264:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 25614us (26209us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143768.752677:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6525 00000100:00100000:0.0:1746143768.753075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.753099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.753114:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.753130:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.753168:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594365312 00000100:00100000:0.0:1746143768.753177:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594365568 00000100:00100000:1.0:1746143768.753178:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594365312 00000100:00100000:0.0:1746143768.753180:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594365568 00000100:00100000:1.0:1746143768.753203:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594365184 00000100:00100000:1.0:1746143768.753204:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594365184 00000100:00100000:2.0:1746143768.753207:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594365440 00000100:00100000:2.0:1746143768.753211:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594365440 00000100:00100000:0.0:1746143768.753851:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13793 00000100:00100000:1.0:1746143768.753856:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13794 00000100:00100000:0.0:1746143768.753857:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594365312:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143768.753863:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594365568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.753870:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143768.753871:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13795 00010000:00010000:0.0:1746143768.753871:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143768.753877:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594365184:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.753882:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8260 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.753882:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8252 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.753885:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.753892:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a824b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.753898:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.753898:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.753900:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.753900:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.753903:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.753904:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.753906:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.753906:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.753909:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.753917:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.753917:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.753919:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.753925:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095611e00, rc 0) 00010000:00010000:0.0:1746143768.753925:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e1800, rc 0) 00010000:00010000:2.0:1746143768.753926:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034b200, rc 0) 00000100:00100000:0.0:1746143768.753948:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594365312:12345-192.168.202.48@tcp:101:cat.0 Request processed in 92us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.753949:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594365184:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.753952:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594365568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 89us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.753967:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13793 00000100:00100000:2.0:1746143768.753971:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13795 00000100:00100000:1.0:1746143768.753975:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13794 00000100:00100000:0.0:1746143768.753980:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13796 00000100:00100000:0.0:1746143768.753984:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594365440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.753990:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.753995:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8259 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.754004:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.754005:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.754009:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.754016:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.754022:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800957e0a00, rc 0) 00000100:00100000:0.0:1746143768.754035:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594365440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 51us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.754042:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13796 00010000:00010000:2.0:1746143768.754327:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.754336:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.754342:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.754347:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091339c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143768.754350:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.754357:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.754368:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.754378:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091339c00/0xe984082ccd730cee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.754423:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594363520:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 26686us (27954us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.754431:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6526 00010000:00010000:2.0:1746143768.757727:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.757742:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.757750:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.757757:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d9200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143768.757761:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.757768:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.757784:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.757790:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941d9200/0xe984082ccd730d03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.757857:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594364032:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 28911us (29437us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.757867:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6529 00010000:00010000:2.0:1746143768.759889:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.759901:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.759908:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.759913:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fafa800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143768.759917:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.759923:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.759937:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.759943:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fafa800/0xe984082ccd730d0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.759995:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594364544:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 26916us (27467us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.760004:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6530 00000100:00100000:0.0:1746143768.762404:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.762525:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594365824 00000100:00100000:3.0:1746143768.762534:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594365824 00000100:00100000:3.0:1746143768.762570:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9277 00000100:00100000:3.0:1746143768.762577:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31538:x1830963594365824:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.762593:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.762607:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd730d34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8267 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.763084:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763095:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763103:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763113:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763122:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763126:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763338:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763347:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.763354:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.763378:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.763388:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 8 pid: 16090 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.763398:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594421504:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.763475:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a575ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.763545:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.763579:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594366080 00000100:00100000:2.0:1746143768.763583:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594366080 00002000:00100000:2.0:1746143768.763607:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800930d3100 x1830963594366080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.763616:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3100 with x1830963594366080 ext(4194304->4771839) 00002000:00010000:2.0:1746143768.763620:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d3100 00000100:00100000:2.0:1746143768.763633:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6533 00000100:00100000:2.0:1746143768.763639:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594366080:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143768.764447:0:3269:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.764456:0:3269:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.764462:0:3269:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.764468:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4de600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143768.764472:0:3269:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.764478:0:3269:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.764483:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594365056:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17029us (17130us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746143768.764491:0:3269:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.764491:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6532 00010000:00010000:1.0:1746143768.764497:0:3269:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4de600/0xe984082ccd730d11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746143768.764497:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88008efaed80 x1830963594365056/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.764504:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaed80 with x1830963594365056 ext(1048576->2097151) 00002000:00010000:0.0:1746143768.764507:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaed80 00000100:00100000:1.0:1746143768.764540:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594364800:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 27671us (27816us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.764546:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6531 00000100:00100000:0.0:1746143768.764681:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.764697:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594366208 00000100:00100000:0.0:1746143768.764700:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594366208 00010000:00010000:0.0:1746143768.764716:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.764746:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7406 00000100:00100000:0.0:1746143768.764752:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594366208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.764760:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.764768:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.764777:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.764790:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.764794:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143768.764801:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.764805:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093327200/0xe984082ccd730bf9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81bf expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.764806:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143768.764817:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.764820:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594421504:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.764834:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143768.764835:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1963:x1830963594366208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 83us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.764840:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7406 00010000:00010000:3.0:1746143768.764844:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.764848:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143768.764858:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.764990:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.764996:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765001:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765005:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d8400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.765008:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765012:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765019:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.765021:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143768.765024:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765028:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d49 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765039:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765047:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765051:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765055:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d9c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.765057:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765060:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765066:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.765067:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.765070:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765073:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9c00/0xe984082ccd730d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765079:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765083:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765087:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765090:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d8e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.765092:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765099:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765105:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1f4600) 00010000:00010000:3.0:1746143768.765107:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.765109:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765113:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8e00/0xe984082ccd730d42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.765174:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd730d34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8267 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.765180:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd730d34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8267 expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.765188:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d8200, rc 0) 00000100:00100000:3.0:1746143768.765214:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31538:x1830963594365824:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2637us (2818us total) trans 8589943622 rc 301/301 00000100:00100000:3.0:1746143768.765221:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9277 00000100:00100000:2.0:1746143768.768800:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594366080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5153us (5248us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143768.768809:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6533 00002000:00100000:2.0:1746143768.768818:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800930d3100 x1830963594366080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.768827:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3100 with x1830963594366080 ext(4194304->4771839) 00002000:00010000:2.0:1746143768.768832:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d3100 00000100:00100000:0.0:1746143768.770036:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.770118:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594366464 00000100:00100000:3.0:1746143768.770124:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594366464 00000100:00100000:3.0:1746143768.770187:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9278 00000100:00100000:3.0:1746143768.770193:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594366464:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1746143768.770230:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.770249:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730caf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a821a expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.770278:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.770282:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143768.770311:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.770320:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.770327:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00010000:3.0:1746143768.770440:0:16090:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800930d2d80 reply state ffff880093354000 transno 8589943623 ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:3.0:1746143768.770446:0:16090:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143768.770505:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31532:x1830963594366464:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 311us (471us total) trans 8589943623 rc 0/0 00000100:00100000:3.0:1746143768.770510:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9278 00010000:00010000:2.0:1746143768.771620:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.771628:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143768.772001:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.772030:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.772044:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594366592 00000100:00100000:0.0:1746143768.772048:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594366592 00000100:00100000:0.0:1746143768.772066:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594366848 00000100:00100000:0.0:1746143768.772067:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594366848 00000100:00100000:0.0:1746143768.772075:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13797 00000100:00100000:0.0:1746143768.772079:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594366592:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:0.0:1746143768.772243:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143768.772247:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143767 -> 1746143768 00002000:00010000:0.0:1746143768.772248:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143767 -> 1746143768 00002000:00010000:0.0:1746143768.772250:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143767 -> 1746143768 00002000:00010000:0.0:1746143768.772251:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:1.0:1746143768.772266:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13798 00000100:00100000:1.0:1746143768.772275:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594366848:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:0.0:1746143768.772277:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594366592:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 196us (278us total) trans 21474840503 rc 0/0 00000100:00100000:0.0:1746143768.772286:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13797 00000100:00100000:0.0:1746143768.772322:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.772379:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:1.0:1746143768.772389:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143768.772389:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594367104 00002000:00010000:1.0:1746143768.772392:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00000100:00100000:0.0:1746143768.772392:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594367104 00002000:00010000:1.0:1746143768.772394:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143767 -> 1746143768 00002000:00010000:1.0:1746143768.772396:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143768.772397:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143768.772404:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594366720 00000100:00100000:0.0:1746143768.772406:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594366720 00000100:00100000:0.0:1746143768.772417:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13799 00000100:00100000:1.0:1746143768.772420:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594366848:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 147us (388us total) trans 17179873178 rc 0/0 00000100:00100000:0.0:1746143768.772422:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594367104:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:1.0:1746143768.772426:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13798 00000100:00100000:1.0:1746143768.772436:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13800 00000100:00100000:1.0:1746143768.772441:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1962:x1830963594366720:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143768.772503:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143768.772506:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143767 -> 1746143768 00002000:00010000:1.0:1746143768.772507:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143767 -> 1746143768 00002000:00010000:1.0:1746143768.772509:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143767 -> 1746143768 00002000:00010000:1.0:1746143768.772510:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143768.772526:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594366720:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 85us (147us total) trans 17179873179 rc 0/0 00000100:00100000:1.0:1746143768.772532:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13800 00010000:00010000:2.0:1746143768.772606:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.772612:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091339e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.772616:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.772623:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.772633:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.772635:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143768.772638:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.772642:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d57 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00002000:00010000:0.0:1746143768.772644:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:0.0:1746143768.772647:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.772648:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143767 -> 1746143768 00002000:00010000:0.0:1746143768.772650:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.772652:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:0.0:1746143768.772672:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594367104:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 249us (349us total) trans 21474840504 rc 0/0 00000100:00100000:0.0:1746143768.772678:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13799 00000100:00100000:0.0:1746143768.772822:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.772864:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594366976 00000100:00100000:2.0:1746143768.772867:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594366976 00000100:00100000:0.0:1746143768.772867:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.772886:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594367232 00000100:00100000:2.0:1746143768.772888:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594367232 00000100:00100000:2.0:1746143768.772916:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13801 00000100:00100000:2.0:1746143768.772921:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594366976:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:1.0:1746143768.772955:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13802 00000100:00100000:1.0:1746143768.772962:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1962:x1830963594367232:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:2.0:1746143768.772997:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143768.773000:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.773002:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143767 -> 1746143768 00002000:00010000:2.0:1746143768.773003:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.773005:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143768.773026:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594366976:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 104us (204us total) trans 21474840505 rc 0/0 00002000:00010000:1.0:1746143768.773029:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143768.773032:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143768.773033:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143766 -> 1746143768 00002000:00010000:1.0:1746143768.773035:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00000100:00100000:2.0:1746143768.773037:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13801 00002000:00010000:1.0:1746143768.773037:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746143768.773054:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594367232:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 93us (187us total) trans 17179873180 rc 0/0 00000100:00100000:1.0:1746143768.773059:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13802 00000100:00100000:0.0:1746143768.773777:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.773843:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.773905:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594367488 00000100:00100000:2.0:1746143768.773909:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594367488 00002000:00100000:2.0:1746143768.773929:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800930d2a00 x1830963594367488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.773938:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2a00 with x1830963594367488 ext(1048576->2097151) 00002000:00010000:2.0:1746143768.773943:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d2a00 00000100:00100000:2.0:1746143768.773955:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6534 00000100:00100000:2.0:1746143768.773960:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594367488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.774045:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594367744 00000100:00100000:3.0:1746143768.774049:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594367744 00000100:00100000:3.0:1746143768.774070:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4003 00000100:00100000:3.0:1746143768.774075:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31529:x1830963594367744:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143768.774570:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31529:x1830963594367744:12345-192.168.202.48@tcp:35:cat.0 Request processed in 143us (376us total) trans 8589943624 rc 0/0 00000100:00100000:3.0:1746143768.774579:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4003 00000100:00100000:0.0:1746143768.777370:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.777491:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594368000 00000100:00100000:3.0:1746143768.777498:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594368000 00000100:00100000:3.0:1746143768.777536:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4004 00000100:00100000:3.0:1746143768.777543:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31532:x1830963594368000:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143768.777709:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31532:x1830963594368000:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 165us (344us total) trans 8589943625 rc 0/0 00000100:00100000:3.0:1746143768.777715:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4004 00010000:00010000:3.0:1746143768.781446:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143768.782872:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594367488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8904us (9089us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.782883:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6534 00002000:00100000:2.0:1746143768.782892:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800930d2a00 x1830963594367488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.782902:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2a00 with x1830963594367488 ext(1048576->2097151) 00002000:00010000:2.0:1746143768.782907:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d2a00 00000100:00100000:1.0:1746143768.783066:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.783729:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594368256 00000100:00100000:3.0:1746143768.783735:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594368256 00000100:00100000:3.0:1746143768.783769:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4005 00000100:00100000:3.0:1746143768.783775:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31532:x1830963594368256:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143768.783942:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31532:x1830963594368256:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 165us (874us total) trans 8589943626 rc 0/0 00000100:00100000:3.0:1746143768.783947:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4005 00000100:00100000:0.0:1746143768.798770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.798818:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.798842:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594368384 00000100:00100000:3.0:1746143768.798850:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594368384 00000100:00100000:3.0:1746143768.798885:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594368512 00000100:00100000:3.0:1746143768.798888:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594368512 00000100:00100000:3.0:1746143768.798970:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13803 00000100:00100000:3.0:1746143768.798977:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594368384:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.798992:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.799006:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a826e expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.799027:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.799028:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.799035:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 18 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.799051:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 18 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.799060:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091338c00, rc 0) 00000100:00100000:3.0:1746143768.799096:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594368384:12345-192.168.202.48@tcp:101:cat.0 Request processed in 118us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.799100:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13803 00000100:00100000:3.0:1746143768.799113:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13804 00000100:00100000:3.0:1746143768.799117:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594368512:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.799123:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.799131:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8275 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.799176:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.799177:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.799182:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.799191:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 23 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.799197:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091338000, rc 0) 00000100:00100000:3.0:1746143768.799210:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594368512:12345-192.168.202.48@tcp:101:cat.0 Request processed in 94us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.799215:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13804 00000100:00100000:0.0:1746143768.821378:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.821417:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.821431:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.821455:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.821474:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.821494:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594368896 00000100:00100000:0.0:1746143768.821502:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594368896 00000100:00100000:1.0:1746143768.821533:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594369024 00000100:00100000:1.0:1746143768.821537:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594369024 00002000:00100000:0.0:1746143768.821539:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f3c8e00 x1830963594368896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.821548:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8e00 with x1830963594368896 ext(2097152->3145727) 00002000:00010000:0.0:1746143768.821553:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8e00 00000100:00100000:3.0:1746143768.821555:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594369792 00000100:00100000:3.0:1746143768.821559:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594369792 00000100:00100000:0.0:1746143768.821565:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594369408 00000100:00100000:0.0:1746143768.821567:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594369408 00002000:00100000:0.0:1746143768.821576:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009e5cf480 x1830963594369408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.821584:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cf480 with x1830963594369408 ext(3145728->4194303) 00002000:00010000:0.0:1746143768.821586:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cf480 00000100:00100000:3.0:1746143768.821589:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9279 00000100:00100000:3.0:1746143768.821595:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31542:x1830963594369792:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:0.0:1746143768.821599:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594369280 00000100:00100000:0.0:1746143768.821601:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594369280 00002000:00100000:0.0:1746143768.821609:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009e5ce680 x1830963594369280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143768.821612:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746143768.821614:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ce680 with x1830963594369280 ext(2097152->3145727) 00002000:00010000:0.0:1746143768.821616:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5ce680 00010000:00010000:3.0:1746143768.821625:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a827c expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143768.821658:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f3c8380 x1830963594369024/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.821665:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8380 with x1830963594369024 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.821668:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8380 00000100:00100000:1.0:1746143768.821681:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6535 00000100:00100000:1.0:1746143768.821687:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963594368896:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143768.821719:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821729:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821738:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821748:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821753:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821757:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143768.821796:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6536 00000100:00100000:2.0:1746143768.821803:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594369408:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143768.821842:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd730d81 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00000100:00100000:1.0:1746143768.821842:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6537 00000100:00100000:1.0:1746143768.821848:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594369280:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143768.821849:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd730d81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821854:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd730d81 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:3.0:1746143768.821862:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.821923:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821928:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821933:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.821937:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091339200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.821940:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00000100:00100000:2.0:1746143768.821996:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6538 00000100:00100000:2.0:1746143768.822001:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963594369024:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143768.823466:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823478:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143768.823480:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.823483:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823488:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091339200/0xe984082ccd730d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823502:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823506:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823510:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823517:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091339c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143768.823520:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823523:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823527:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f1f4d00) 00010000:00010000:3.0:1746143768.823529:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143768.823531:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823534:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091339c00/0xe984082ccd730d7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.823569:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091339e00/0xe984082ccd730d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a827c expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.823577:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd730d81 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a827c expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.823582:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.823584:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143768.823586:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d9200, rc 0) 00000100:00100000:3.0:1746143768.823628:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31542:x1830963594369792:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2033us (2255us total) trans 8589943627 rc 0/0 00000100:00100000:3.0:1746143768.823634:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9279 00000100:00100000:1.0:1746143768.836578:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594368896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14883us (15151us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.836589:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6535 00002000:00100000:1.0:1746143768.836599:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f3c8e00 x1830963594368896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.836608:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8e00 with x1830963594368896 ext(2097152->3145727) 00002000:00010000:1.0:1746143768.836613:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8e00 00000100:00100000:2.0:1746143768.840273:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594369024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18218us (18787us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.840285:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6538 00002000:00100000:2.0:1746143768.840296:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f3c8380 x1830963594369024/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.840305:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8380 with x1830963594369024 ext(3145728->4194303) 00002000:00010000:2.0:1746143768.840311:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8380 00000100:00100000:0.0:1746143768.841706:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.841759:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370048 00000100:00100000:3.0:1746143768.841766:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370048 00000100:00100000:3.0:1746143768.841807:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9280 00000100:00100000:3.0:1746143768.841813:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31542:x1830963594370048:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.841830:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.841833:0:16090:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746143768.841852:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9200/0xe984082ccd730d81 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a827c expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.841885:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf12a00/0xe984082ccd730c9a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a820c expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.841894:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.841897:0:16090:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143768.841981:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d8f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8283 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.842021:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.842030:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 241 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.842036:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.842040:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143768.842061:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.842074:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 9 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.842083:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594421632:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.842168:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 241 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.842175:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 241 pid: 16090 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.842182:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594421760:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.842202:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.842458:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594369408:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20654us (20999us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.842466:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6536 00002000:00100000:2.0:1746143768.842473:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009e5cf480 x1830963594369408/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.842480:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cf480 with x1830963594369408 ext(3145728->4194303) 00002000:00010000:2.0:1746143768.842483:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cf480 00000100:00100000:3.0:1746143768.845320:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594421632:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.845333:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594421760:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.845354:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143768.845457:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.845607:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.845645:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370176 00000100:00100000:1.0:1746143768.845651:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370176 00010000:00010000:1.0:1746143768.845679:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.845696:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370304 00000100:00100000:1.0:1746143768.845699:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370304 00010000:00010000:1.0:1746143768.845709:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 242 pid: 16090 timeout: 947 lvb_type: 0 00000100:00100000:1.0:1746143768.845726:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7407 00000100:00100000:1.0:1746143768.845733:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594370176:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.845743:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143768.845747:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.845755:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.845771:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091338800/0xe984082ccd730ca1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8213 expref: 10 pid: 2976 timeout: 947 lvb_type: 0 00010000:00010000:1.0:1746143768.845784:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143768.845787:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143768.845794:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143768.845798:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.845955:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594369280:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24105us (24478us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.845963:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6537 00000100:00100000:0.0:1746143768.845963:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7408 00000100:00100000:0.0:1746143768.845968:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1964:x1830963594370304:12345-192.168.202.48@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746143768.845970:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009e5ce680 x1830963594369280/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746143768.845977:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746143768.845978:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5ce680 with x1830963594369280 ext(2097152->3145727) 00002000:00010000:2.0:1746143768.845981:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5ce680 00010000:00010000:0.0:1746143768.845981:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 242 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.845989:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 242 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.846000:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf13c00/0xe984082ccd730c8c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81fe expref: 242 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:0.0:1746143768.846011:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.846014:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143768.846020:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143768.846026:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143768.846039:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.846053:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:1964:x1830963594370304:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.846058:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7408 00000100:00100000:1.0:1746143768.846334:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594370176:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 600us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.846339:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7407 00010000:00010000:2.0:1746143768.846420:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.846427:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143768.846866:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.846884:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370432 00000100:00100000:0.0:1746143768.846888:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370432 00000100:00100000:0.0:1746143768.846975:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9281 00000100:00100000:0.0:1746143768.846981:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31536:x1830963594370432:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.846997:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.847006:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a828a expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.847038:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143768.847045:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 242 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.847055:0:2976:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16090 initiator: MDT0 00010000:00010000:0.0:1746143768.847064:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 242 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.847073:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.847075:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143768.847077:0:2976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 242 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.847082:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4de600, rc 0) 00000100:00100000:0.0:1746143768.847098:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31536:x1830963594370432:12345-192.168.202.48@tcp:101:cat.0 Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.847103:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9281 00000040:00080000:2.0:1746143768.848657:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2732, 88 off230960 00000004:00080000:2.0:1746143768.848668:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847858527591ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849345:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2743, 88 off232104 00000004:00080000:2.0:1746143768.849350:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859210551ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.849415:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2744, 88 off232192 00000004:00080000:2.0:1746143768.849420:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859279856ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.849429:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2733, 88 off231048 00000004:00080000:2.0:1746143768.849432:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859291916ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849441:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2734, 88 off231136 00000004:00080000:2.0:1746143768.849443:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859303496ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849449:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2745, 88 off232280 00000004:00080000:2.0:1746143768.849452:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859312209ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.849470:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2746, 88 off232368 00000004:00080000:2.0:1746143768.849473:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859333264ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.849479:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2747, 88 off232456 00000004:00080000:2.0:1746143768.849481:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859341676ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.849488:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2735, 88 off231224 00000004:00080000:2.0:1746143768.849490:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859350284ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849501:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2748, 88 off232544 00000004:00080000:2.0:1746143768.849503:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859363682ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.849508:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2736, 88 off231312 00000004:00080000:2.0:1746143768.849511:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859371356ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849519:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2749, 88 off232632 00000004:00080000:2.0:1746143768.849522:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859382719ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143768.849529:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2737, 88 off231400 00000004:00080000:2.0:1746143768.849531:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859391648ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849539:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2738, 88 off231488 00000004:00080000:2.0:1746143768.849541:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859401642ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849552:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2739, 88 off231576 00000004:00080000:2.0:1746143768.849555:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859415004ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849562:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2740, 88 off231664 00000004:00080000:2.0:1746143768.849564:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 847859424179ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143768.849570:0:16090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2750, 88 off232720 00000004:00080000:2.0:1746143768.849572:0:16090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 847859432079ns, next at 833304778357ns, rc = 0 00000001:00080000:1.0:1746143768.872005:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943628 is committed 00000004:00080000:1.0:1746143768.872012:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2085 committed 00000004:00080000:1.0:1746143768.872019:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2075 committed 00000004:00080000:1.0:1746143768.872024:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2074 committed 00000004:00080000:1.0:1746143768.872025:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2073 committed 00000004:00080000:1.0:1746143768.872026:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2072 committed 00000004:00080000:1.0:1746143768.872028:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2084 committed 00000004:00080000:1.0:1746143768.872030:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2071 committed 00000004:00080000:1.0:1746143768.872031:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2083 committed 00000004:00080000:1.0:1746143768.872032:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2070 committed 00000004:00080000:1.0:1746143768.872034:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2082 committed 00000004:00080000:1.0:1746143768.872035:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2081 committed 00000004:00080000:1.0:1746143768.872036:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2080 committed 00000004:00080000:1.0:1746143768.872037:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2069 committed 00000004:00080000:1.0:1746143768.872039:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2068 committed 00000004:00080000:1.0:1746143768.872040:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2079 committed 00000004:00080000:1.0:1746143768.872041:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2078 committed 00000004:00080000:1.0:1746143768.872042:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2067 committed 00000001:00080000:1.0:1746143768.872049:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943626 is committed 00000001:00080000:1.0:1746143768.872056:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943622 is committed 00000100:00100000:1.0:1746143768.872224:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422144:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143768.872241:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.872250:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.872253:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143768.872256:0:16090:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 240 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.872264:0:16090:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 240 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.872270:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 240 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.872272:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143768.872288:0:16090:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 240 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.872292:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143768.872296:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594422912:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143768.872304:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.872339:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594421888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143768.872340:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.872352:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422144 00000100:00100000:2.0:1746143768.872357:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422144 00000100:00100000:2.0:1746143768.872386:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422656 00000100:00100000:2.0:1746143768.872388:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422656 00000100:00100000:2.0:1746143768.872399:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13805 00000100:00100000:2.0:1746143768.872404:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963594422144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143768.872540:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143768.872543:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.872545:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.872547:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.872549:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746143768.872591:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13806 00000100:00100000:0.0:1746143768.872597:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3292:x1830963594422656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.872878:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.872894:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.872905:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.872914:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.872923:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143768.872926:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.872936:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.872943:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.872952:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.872960:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.872969:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.872976:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.872985:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.873287:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423296 00000100:00100000:1.0:1746143768.873291:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423296 00000100:00100000:1.0:1746143768.873309:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423808 00000100:00100000:1.0:1746143768.873310:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423808 00000100:00100000:1.0:1746143768.873318:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422272 00000100:00100000:1.0:1746143768.873320:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422272 00000100:00100000:1.0:1746143768.873325:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422784 00000100:00100000:1.0:1746143768.873326:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422784 00000100:00100000:1.0:1746143768.873332:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423424 00000100:00100000:1.0:1746143768.873333:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423424 00000100:00100000:1.0:1746143768.873339:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423936 00000100:00100000:1.0:1746143768.873340:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423936 00000100:00100000:1.0:1746143768.873347:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13807 00000100:00100000:1.0:1746143768.873352:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963594423296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143768.873447:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:1.0:1746143768.873450:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143768.873451:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143768.873453:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143768.873455:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:1.0:1746143768.873478:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963594423296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (582us total) trans 21474840506 rc 0/0 00000100:00100000:1.0:1746143768.873484:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13807 00000100:00100000:1.0:1746143768.873496:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13808 00000100:00100000:1.0:1746143768.873500:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3292:x1830963594423808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143768.873511:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.873523:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594422400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143768.873537:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.873547:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143768.873559:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.873565:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.873566:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3292:x1830963594423808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (651us total) trans 21474840507 rc 0/0 00000100:00100000:1.0:1746143768.873571:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13808 00000100:00100000:3.0:1746143768.873577:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.873578:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421888 00000100:00100000:1.0:1746143768.873580:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421888 00000100:00100000:3.0:1746143768.873584:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746143768.873587:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422400 00000100:00100000:3.0:1746143768.873588:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594422016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.873589:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422400 00000100:00100000:1.0:1746143768.873594:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423040 00000100:00100000:1.0:1746143768.873595:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423040 00000100:00100000:3.0:1746143768.873599:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.873600:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423552 00000100:00100000:1.0:1746143768.873602:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423552 00000100:00100000:3.0:1746143768.873604:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594422528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.873607:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422016 00000100:00100000:1.0:1746143768.873609:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422016 00000100:00100000:3.0:1746143768.873614:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143768.873616:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13809 00000100:00100000:3.0:1746143768.873620:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.873620:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594422272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143768.873630:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.873635:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143768.873646:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143768.873662:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422528 00000100:00100000:3.0:1746143768.873664:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422528 00000100:00100000:3.0:1746143768.873674:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423168 00000100:00100000:3.0:1746143768.873676:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423168 00002000:00010000:1.0:1746143768.873678:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1746143768.873680:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423680 00002000:00010000:1.0:1746143768.873680:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00000100:00100000:3.0:1746143768.873682:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423680 00002000:00010000:1.0:1746143768.873683:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143768.873684:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143768.873686:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143768.873688:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13810 00000100:00100000:3.0:1746143768.873692:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963594422784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.873703:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963594422272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (766us total) trans 17179873183 rc 0/0 00000100:00100000:3.0:1746143768.873769:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3292:x1830963594422784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (815us total) trans 17179873184 rc 0/0 00000100:00100000:3.0:1746143768.873774:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13810 00000100:00100000:3.0:1746143768.873787:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13811 00000100:00100000:3.0:1746143768.873790:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963594423424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143768.873857:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594423424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (887us total) trans 21474840508 rc 0/0 00000100:00100000:3.0:1746143768.873862:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13811 00000100:00100000:3.0:1746143768.873871:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13812 00000100:00100000:3.0:1746143768.873875:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3292:x1830963594423936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.874171:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3292:x1830963594422656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1573us (1864us total) trans 17179873182 rc 0/0 00000100:00100000:0.0:1746143768.874176:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13806 00000100:00100000:0.0:1746143768.874187:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13813 00000100:00100000:0.0:1746143768.874191:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963594421888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143768.874254:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143768.874257:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.874258:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.874260:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.874261:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143768.874282:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963594421888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (770us total) trans 17179873185 rc 0/0 00000100:00100000:0.0:1746143768.874287:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13813 00000100:00100000:0.0:1746143768.874296:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13814 00000100:00100000:0.0:1746143768.874300:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963594422400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143768.874366:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963594422400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (827us total) trans 17179873186 rc 0/0 00000100:00100000:0.0:1746143768.874370:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13814 00000100:00100000:0.0:1746143768.874379:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13815 00000100:00100000:0.0:1746143768.874383:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594423040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.874457:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13809 00000100:00100000:2.0:1746143768.874468:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594422144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2064us (2196us total) trans 17179873181 rc 0/0 00000100:00100000:1.0:1746143768.874468:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13816 00000100:00100000:1.0:1746143768.874472:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594423552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.874473:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13805 00000100:00100000:2.0:1746143768.874481:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13817 00000100:00100000:2.0:1746143768.874486:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963594422016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143768.874507:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13818 00000100:00100000:1.0:1746143768.874512:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963594422528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143768.874547:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143768.874549:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.874551:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.874553:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143768.874555:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143768.874572:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963594422016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (971us total) trans 17179873187 rc 0/0 00000100:00100000:1.0:1746143768.874572:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963594422528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (956us total) trans 17179873188 rc 0/0 00000100:00100000:1.0:1746143768.874576:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13818 00000100:00100000:2.0:1746143768.874587:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13817 00000100:00100000:1.0:1746143768.874793:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13819 00000100:00100000:2.0:1746143768.874797:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13820 00000100:00100000:1.0:1746143768.874799:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594423168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143768.874801:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3294:x1830963594423680:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.874845:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c275c00/2, rc 0, transno 17179873183 00000100:00100000:1.0:1746143768.874850:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.874856:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0815180/2, rc 0, transno 17179873184 00000100:00100000:1.0:1746143768.874858:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422784:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.874865:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cea00/2, rc 0, transno 21474840508 00000100:00100000:1.0:1746143768.874870:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.874876:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5ce300/2, rc 0, transno 21474840506 00000100:00100000:1.0:1746143768.874879:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.874883:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5ced80/2, rc 0, transno 21474840507 00000100:00100000:1.0:1746143768.874886:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143768.874891:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c276300/2, rc 0, transno 17179873181 00000100:00100000:1.0:1746143768.874893:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143768.874898:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814e00/2, rc 0, transno 17179873182 00000100:00100000:1.0:1746143768.874900:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594422656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143768.875086:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3292:x1830963594423936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1210us (2099us total) trans 21474840509 rc 0/0 00000100:00100000:3.0:1746143768.875091:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13812 00000004:00080000:3.0:1746143768.875111:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a2300/2, rc 0, transno 17179873187 00000100:00100000:3.0:1746143768.875114:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594422016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143768.875120:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0815f80/2, rc 0, transno 17179873188 00000100:00100000:3.0:1746143768.875122:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594422528:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143768.875128:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800935a1880/2, rc 0, transno 17179873185 00000100:00100000:3.0:1746143768.875130:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594421888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143768.875135:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814380/2, rc 0, transno 17179873186 00000100:00100000:3.0:1746143768.875149:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594422400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143768.875255:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.875271:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370560 00000100:00100000:3.0:1746143768.875275:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370560 00002000:00010000:0.0:1746143768.875282:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143768.875284:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.875286:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.875288:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.875289:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143768.875295:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4006 00000100:00100000:3.0:1746143768.875299:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31536:x1830963594370560:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:0.0:1746143768.875306:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594423168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 508us (1675us total) trans 21474840510 rc 0/0 00000100:00100000:0.0:1746143768.875311:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13819 00000100:00100000:3.0:1746143768.875362:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31536:x1830963594370560:12345-192.168.202.48@tcp:49:cat.0 Request processed in 62us (107us total) trans 0 rc 0/0 00002000:00010000:0.0:1746143768.875366:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746143768.875368:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4006 00002000:00010000:0.0:1746143768.875368:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.875370:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.875372:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143768.875373:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:3.0:1746143768.875378:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143768.875384:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e5cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594424064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.875388:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3294:x1830963594423040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1006us (1829us total) trans 21474840511 rc 0/0 00000100:00100000:0.0:1746143768.875392:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13815 00000100:00100000:3.0:1746143768.875403:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143768.875424:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cfb80/2, rc 0, transno 21474840510 00000100:00100000:3.0:1746143768.875428:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423168:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143768.875433:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cd880/2, rc 0, transno 21474840511 00000100:00100000:3.0:1746143768.875436:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.875451:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594424064 00000100:00100000:0.0:1746143768.875454:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594424064 00000100:00100000:0.0:1746143768.875467:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13821 00000100:00100000:0.0:1746143768.875471:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830963594424064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.875548:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3295:x1830963594424064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (143us total) trans 21474840512 rc 0/0 00000100:00100000:0.0:1746143768.875552:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13821 00000004:00080000:1.0:1746143768.875612:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cdf80/2, rc 0, transno 21474840509 00000100:00100000:1.0:1746143768.875616:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594423936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143768.875685:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3294:x1830963594423552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1212us (2106us total) trans 21474840513 rc 0/0 00000100:00100000:1.0:1746143768.875690:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13816 00000100:00100000:0.0:1746143768.875886:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3294:x1830963594423680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1083us (2238us total) trans 21474840514 rc 0/0 00000100:00100000:0.0:1746143768.875890:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13820 00000100:00100000:2.0:1746143768.875958:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594422912:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.875981:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8400/0xe984082ccd730d8f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 8 pid: 16090 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143768.875995:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 7 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.876009:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d8600, rc 0) 00000100:00100000:2.0:1746143768.876038:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31542:x1830963594370048:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 34225us (34335us total) trans 8589943628 rc 0/0 00000100:00100000:2.0:1746143768.876044:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9280 00000004:00080000:3.0:1746143768.876244:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cc000/2, rc 0, transno 21474840512 00000100:00100000:3.0:1746143768.876249:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594424064:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143768.876264:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cf800/2, rc 0, transno 21474840514 00000100:00100000:3.0:1746143768.876268:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423680:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143768.876274:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e5cc380/2, rc 0, transno 21474840513 00000100:00100000:3.0:1746143768.876276:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e5cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594423552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143768.880360:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.880417:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370688 00000100:00100000:2.0:1746143768.880425:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370688 00000100:00100000:2.0:1746143768.880470:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13822 00000100:00100000:2.0:1746143768.880477:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31542:x1830963594370688:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143768.880491:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.880504:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8291 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.880529:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.880537:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.880544:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.880549:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.880551:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.880554:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.880779:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.880797:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 10 pid: 25369 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.880808:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594424192:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.880903:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 10 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.880911:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 10 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.880919:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594424320:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.880946:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.880953:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 22 pid: 9527 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.880960:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594424448:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.880974:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.883342:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594424192:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.883354:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594424320:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.883832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.883863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.883897:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370816 00000100:00100000:1.0:1746143768.883902:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370816 00000100:00100000:0.0:1746143768.883918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143768.883931:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 11 pid: 25369 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.883935:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594370944 00000100:00100000:0.0:1746143768.883937:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594370944 00010000:00010000:0.0:1746143768.883951:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 11 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.883965:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371072 00000100:00100000:1.0:1746143768.883968:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371072 00000100:00100000:0.0:1746143768.883968:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7409 00000100:00100000:0.0:1746143768.883974:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594370816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.883979:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 23 pid: 9527 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.883984:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143768.883992:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7410 00000100:00100000:1.0:1746143768.883997:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7411 00000100:00100000:3.0:1746143768.883999:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594370944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.884003:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 11 pid: 25369 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.884004:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.884010:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 11 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.884012:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 11 pid: 25369 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.884014:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594371072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.884021:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.884099:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 11 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.884183:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594424448:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.884327:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e0a00/0xe984082ccd730d2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8259 expref: 11 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.884331:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 9 type: EXT [1847296->2097151] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 11 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.884340:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143768.884343:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a034a600, rc 0) 00000100:00100000:3.0:1746143768.884372:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594370944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 374us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.884373:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31542:x1830963594370688:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3896us (4025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.884379:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13822 00000100:00100000:3.0:1746143768.884381:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7410 00010000:00010000:0.0:1746143768.884620:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093238200/0xe984082ccd730ccb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a822f expref: 11 pid: 25369 timeout: 947 lvb_type: 1 00010000:00010000:1.0:1746143768.884624:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 23 pid: 9527 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.884630:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143768.884638:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 23 pid: 9527 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.884645:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594370816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 672us (816us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143768.884649:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5d0600/0xe984082ccd730c69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81db expref: 23 pid: 9527 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.884651:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7409 00010000:00010000:1.0:1746143768.884658:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.884660:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143768.884665:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.884672:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.884697:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 8 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.884707:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594424576:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143768.884774:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.886498:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594424576:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143768.886511:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143768.886534:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594371072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2532us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.886541:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7411 00000100:00100000:0.0:1746143768.886978:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.887025:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371328 00000100:00100000:2.0:1746143768.887030:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371328 00002000:00100000:2.0:1746143768.887057:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1847296->1851391) req@ffff880094763800 x1830963594371328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.887066:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763800 with x1830963594371328 ext(1847296->1851391) 00002000:00010000:2.0:1746143768.887069:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763800 00000100:00100000:2.0:1746143768.887093:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6539 00000100:00100000:2.0:1746143768.887099:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594371328:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143768.887338:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594371328:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 238us (360us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143768.887343:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6539 00002000:00100000:2.0:1746143768.887348:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1847296->1851391) req@ffff880094763800 x1830963594371328/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.887355:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763800 with x1830963594371328 ext(1847296->1851391) 00002000:00010000:2.0:1746143768.887358:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763800 00000100:00100000:0.0:1746143768.891319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.891404:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.891463:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371584 00000100:00100000:2.0:1746143768.891471:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371584 00002000:00100000:2.0:1746143768.891505:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094760000 x1830963594371584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.891514:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760000 with x1830963594371584 ext(2097152->3145727) 00002000:00010000:2.0:1746143768.891519:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760000 00000100:00100000:3.0:1746143768.891523:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371712 00000100:00100000:3.0:1746143768.891526:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371712 00000100:00100000:2.0:1746143768.891536:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6540 00000100:00100000:2.0:1746143768.891543:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594371584:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.891644:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13823 00000100:00100000:3.0:1746143768.891651:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31542:x1830963594371712:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143768.891660:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.891673:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8298 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.891693:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.891700:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.891707:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.891712:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.891713:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143768.891716:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 13 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.891740:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 10 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.891750:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 10 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.891760:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594424704:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.891818:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.891825:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 13 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.891832:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594424832:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.891853:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.891867:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 17 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.891873:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594424960:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.891889:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.892033:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.892098:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.892172:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372224 00000100:00100000:0.0:1746143768.892172:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594371968 00000100:00100000:3.0:1746143768.892175:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372224 00000100:00100000:0.0:1746143768.892175:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594371968 00002000:00100000:3.0:1746143768.892190:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094760e00 x1830963594372224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.892190:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094760a80 x1830963594371968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.892197:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760e00 with x1830963594372224 ext(3145728->4194303) 00002000:00010000:3.0:1746143768.892200:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094760e00 00002000:00100000:0.0:1746143768.892202:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760a80 with x1830963594371968 ext(3145728->4194303) 00002000:00010000:0.0:1746143768.892205:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760a80 00000100:00100000:0.0:1746143768.892224:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6541 00000100:00100000:0.0:1746143768.892229:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594372224:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.892241:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6542 00000100:00100000:1.0:1746143768.892249:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594371968:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.895202:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.895220:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.895236:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.896274:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372352 00000100:00100000:0.0:1746143768.896283:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372352 00010000:00010000:0.0:1746143768.896312:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 14 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.896353:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372608 00000100:00100000:0.0:1746143768.896356:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372608 00010000:00010000:0.0:1746143768.896365:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 20 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.896378:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372480 00000100:00100000:0.0:1746143768.896379:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372480 00010000:00010000:0.0:1746143768.896386:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 11 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.896399:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7412 00000100:00100000:0.0:1746143768.896405:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594372352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.896416:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.896433:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 14 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.896448:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 14 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.896465:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095611e00/0xe984082ccd730d1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8260 expref: 14 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.896479:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.896509:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594372352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.896515:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7412 00000100:00100000:0.0:1746143768.896528:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7413 00000100:00100000:0.0:1746143768.896533:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594372608:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.896538:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.896544:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 20 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.896551:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 20 pid: 12618 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.896561:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.896571:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594372608:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 38us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.896576:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7413 00000100:00100000:0.0:1746143768.896583:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7414 00000100:00100000:0.0:1746143768.896587:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594372480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.896593:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.896597:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 11 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.896605:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 11 pid: 8495 timeout: 947 lvb_type: 1 00010000:00010000:0.0:1746143768.896613:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.896615:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.896620:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.896626:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.896650:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.896661:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594425088:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143768.896707:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5357c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.897457:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594424832:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.897513:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a64de000/0xe984082ccd730c5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81e2 expref: 19 pid: 12618 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.897523:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594424960:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.897534:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091338a00/0xe984082ccd730cc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8236 expref: 11 pid: 8495 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.897541:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594424704:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.897564:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.897579:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336aa00, rc 0) 00000100:00100000:3.0:1746143768.897604:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31542:x1830963594371712:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5953us (6198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.897610:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13823 00000100:00100000:0.0:1746143768.905979:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.906275:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594425088:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.906292:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.906325:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594372480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 9736us (11087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.906371:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7414 00000100:00100000:1.0:1746143768.906425:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594371968:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14177us (14432us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143768.906432:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6542 00002000:00100000:1.0:1746143768.906440:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094760a80 x1830963594371968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.906449:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760a80 with x1830963594371968 ext(3145728->4194303) 00002000:00010000:1.0:1746143768.906453:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760a80 00000100:00100000:3.0:1746143768.906499:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594372864 00000100:00100000:3.0:1746143768.906505:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594372864 00002000:00100000:3.0:1746143768.906529:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1089536->1093631) req@ffff880094763480 x1830963594372864/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.906536:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963594372864 ext(1089536->1093631) 00002000:00010000:3.0:1746143768.906538:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:3.0:1746143768.906563:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6543 00000100:00100000:3.0:1746143768.906568:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594372864:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143768.906687:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594372864:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 119us (716us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.906693:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6543 00002000:00100000:3.0:1746143768.906697:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1089536->1093631) req@ffff880094763480 x1830963594372864/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.906704:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763480 with x1830963594372864 ext(1089536->1093631) 00002000:00010000:3.0:1746143768.906706:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094763480 00000100:00100000:2.0:1746143768.909735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.910088:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373120 00000100:00100000:3.0:1746143768.910095:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373120 00000100:00100000:3.0:1746143768.910136:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4007 00000100:00100000:3.0:1746143768.910168:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:31542:x1830963594373120:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143768.910943:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31542:x1830963594373120:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 772us (1209us total) trans 8589943629 rc 0/0 00000100:00100000:3.0:1746143768.910951:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4007 00000100:00100000:0.0:1746143768.911305:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594372224:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19075us (19206us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143768.911313:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6541 00002000:00100000:0.0:1746143768.911320:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880094760e00 x1830963594372224/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.911334:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760e00 with x1830963594372224 ext(3145728->4194303) 00002000:00010000:0.0:1746143768.911338:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094760e00 00000100:00100000:2.0:1746143768.911433:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594371584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19890us (20120us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143768.911440:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6540 00002000:00100000:2.0:1746143768.911445:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094760000 x1830963594371584/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.911452:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760000 with x1830963594371584 ext(2097152->3145727) 00002000:00010000:2.0:1746143768.911454:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094760000 00000100:00100000:0.0:1746143768.918407:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.918445:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.918521:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.918546:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373248 00000100:00100000:0.0:1746143768.918552:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373248 00000100:00100000:0.0:1746143768.918581:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373376 00000100:00100000:0.0:1746143768.918583:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373376 00000100:00100000:0.0:1746143768.918604:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373504 00000100:00100000:0.0:1746143768.918606:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373504 00000100:00100000:0.0:1746143768.918620:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13824 00000100:00100000:0.0:1746143768.918626:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31538:x1830963594373248:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143768.918642:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.918657:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a829f expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.918683:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13825 00010000:00010000:0.0:1746143768.918687:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 8 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.918692:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594373376:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.918695:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 24 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.918699:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.918702:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.918707:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff25800/0xe984082ccd730db9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82a6 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.918712:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.918714:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.918717:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3784704->4194303] (req 3784704->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.918737:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 9 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.918748:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 9 pid: 4582 timeout: 947 lvb_type: 1 00000100:00100000:1.0:1746143768.918750:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594425344:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143768.918757:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425216:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.918827:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.918835:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 25 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.918842:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425472:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.918861:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 8 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.918868:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 8 pid: 8495 timeout: 947 lvb_type: 0 00000100:00100000:0.0:1746143768.918880:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425600:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.918894:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5357c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.918910:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13826 00000100:00100000:0.0:1746143768.918916:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594373504:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143768.918923:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143768.918932:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135181200/0xe984082ccd730dc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82ad expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.918942:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.918953:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594425728:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143768.918980:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.921740:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.921808:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594425728:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143768.921833:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135181200/0xe984082ccd730dc0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82ad expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.921846:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135181200/0xe984082ccd730dc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82ad expref: 18 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.921860:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135181200, rc 0) 00000100:00100000:1.0:1746143768.921864:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594425344:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143768.921882:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff25800/0xe984082ccd730db9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82a6 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.921892:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff25800/0xe984082ccd730db9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82a6 expref: 25 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.921942:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff25800, rc 0) 00000100:00100000:0.0:1746143768.921942:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594373504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3025us (3419us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143768.921949:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13826 00000100:00100000:1.0:1746143768.921963:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594373376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3274us (3517us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143768.921968:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13825 00000100:00100000:1.0:1746143768.922041:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.922050:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094763b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425216:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.922059:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425472:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.922068:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425600:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.922086:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [3784704->4194303] (req 3784704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 23 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.922102:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135180400, rc 0) 00000100:00100000:2.0:1746143768.922128:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31538:x1830963594373248:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3501us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.922132:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373632 00000100:00100000:2.0:1746143768.922133:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13824 00000100:00100000:3.0:1746143768.922168:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373632 00010000:00010000:3.0:1746143768.922191:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 10 pid: 4582 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.922208:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373760 00000100:00100000:3.0:1746143768.922211:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373760 00010000:00010000:3.0:1746143768.922219:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 9 pid: 8495 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.922229:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7415 00000100:00100000:3.0:1746143768.922234:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594373632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143768.922234:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7416 00000100:00100000:2.0:1746143768.922240:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594373760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.922242:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.922247:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.922254:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 10 pid: 4582 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.922255:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 9 pid: 8495 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.922263:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 10 pid: 4582 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.922272:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 9 pid: 8495 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.922330:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf13a00/0xe984082ccd730cd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8244 expref: 10 pid: 4582 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.922351:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.922370:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594373632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 136us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.922375:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7415 00010000:00010000:2.0:1746143768.922426:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2d600/0xe984082ccd730c7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81f7 expref: 9 pid: 8495 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.922448:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.922472:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594373760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 232us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.922477:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7416 00000100:00100000:0.0:1746143768.924268:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.925191:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594373888 00000100:00100000:2.0:1746143768.925198:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594373888 00010000:00010000:2.0:1746143768.925223:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 23 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.925256:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7417 00000100:00100000:2.0:1746143768.925261:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594373888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.925270:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.925285:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 23 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.925295:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 23 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.925310:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091338000/0xe984082ccd730d65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8275 expref: 23 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:0.0:1746143768.925362:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143768.925477:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.925479:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.925485:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.925493:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.925519:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 22 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.925528:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594425856:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143768.925556:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374144 00000100:00100000:3.0:1746143768.925560:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374144 00002000:00100000:3.0:1746143768.925585:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880094760380 x1830963594374144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.925593:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760380 with x1830963594374144 ext(4194304->4771839) 00002000:00010000:3.0:1746143768.925597:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094760380 00000100:00100000:3.0:1746143768.925609:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6544 00000100:00100000:3.0:1746143768.925615:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594374144:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.925800:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.927230:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.927340:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594425856:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.927353:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.927391:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594373888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2128us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.927398:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7417 00000100:00100000:1.0:1746143768.927708:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374400 00000100:00100000:1.0:1746143768.927714:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374400 00002000:00100000:1.0:1746143768.927738:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3784704->3788799) req@ffff880094762d80 x1830963594374400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.927747:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762d80 with x1830963594374400 ext(3784704->3788799) 00002000:00010000:1.0:1746143768.927751:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094762d80 00000100:00100000:1.0:1746143768.927772:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6545 00000100:00100000:1.0:1746143768.927778:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594374400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143768.928218:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594374400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 440us (990us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143768.928224:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6545 00002000:00100000:1.0:1746143768.928229:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3784704->3788799) req@ffff880094762d80 x1830963594374400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143768.928235:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762d80 with x1830963594374400 ext(3784704->3788799) 00002000:00010000:1.0:1746143768.928237:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094762d80 00000100:00100000:3.0:1746143768.931421:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594374144:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5800us (6052us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143768.931431:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6544 00002000:00100000:3.0:1746143768.931439:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880094760380 x1830963594374144/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/440 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.931719:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094760380 with x1830963594374144 ext(4194304->4771839) 00002000:00010000:3.0:1746143768.931724:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094760380 00000100:00100000:0.0:1746143768.933873:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.933912:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.933940:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374528 00000100:00100000:2.0:1746143768.933947:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374528 00000100:00100000:2.0:1746143768.933978:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374656 00000100:00100000:2.0:1746143768.933979:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374656 00000100:00100000:2.0:1746143768.934004:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13827 00000100:00100000:2.0:1746143768.934010:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594374528:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.934023:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.934035:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730dc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82b4 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.934069:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13828 00000100:00100000:2.0:1746143768.934078:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425984:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143768.934078:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594374656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143768.934085:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.934094:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1400/0xe984082ccd730dce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82bb expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.934128:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594426112:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143768.934133:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.934217:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.935121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.935220:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374784 00000100:00100000:2.0:1746143768.935224:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374784 00000100:00100000:2.0:1746143768.935252:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13829 00000100:00100000:2.0:1746143768.935258:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31538:x1830963594374784:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143768.935265:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.935272:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82c2 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.935288:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.935296:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.935303:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.935308:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.935310:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.935313:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.935329:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 9 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.935339:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 9 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.935348:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594426240:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.935431:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 20 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.935438:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 20 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.935446:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594426368:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.935467:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.935474:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 11 pid: 15784 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.935481:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594426496:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.935492:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.935992:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594425984:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143768.935993:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594426112:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143768.936009:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730dc7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82b4 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.936009:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1400/0xe984082ccd730dce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82bb expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.936018:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730dc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82b4 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.936019:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1400/0xe984082ccd730dce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82bb expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.936029:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4600, rc 0) 00010000:00010000:1.0:1746143768.936031:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1400, rc 0) 00000100:00100000:2.0:1746143768.936060:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594374528:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2050us (2193us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143768.936066:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13827 00000100:00100000:1.0:1746143768.936067:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963594374656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1991us (2153us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143768.936073:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13828 00000100:00100000:0.0:1746143768.937336:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.937340:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594426240:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.937348:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594426368:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.937354:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594426496:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.937368:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.937368:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143768.937384:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d5200, rc 0) 00000100:00100000:0.0:1746143768.937415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.937416:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31538:x1830963594374784:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2157us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.937422:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13829 00000100:00100000:2.0:1746143768.937433:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375168 00000100:00100000:2.0:1746143768.937436:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375168 00000100:00100000:2.0:1746143768.937452:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13830 00000100:00100000:2.0:1746143768.937457:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:31536:x1830963594375168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.937464:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.937471:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82c9 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.937483:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.937485:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.937490:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.937501:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.937507:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4c00, rc 0) 00000100:00100000:2.0:1746143768.937521:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31536:x1830963594375168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.937526:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13830 00000100:00100000:3.0:1746143768.937544:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375040 00000100:00100000:3.0:1746143768.937548:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375040 00010000:00010000:3.0:1746143768.937564:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 12 pid: 15784 timeout: 947 lvb_type: 0 00000100:00100000:3.0:1746143768.937579:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594374912 00000100:00100000:3.0:1746143768.937581:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594374912 00010000:00010000:3.0:1746143768.937588:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 10 pid: 8497 timeout: 947 lvb_type: 1 00000100:00100000:3.0:1746143768.937601:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7418 00000100:00100000:3.0:1746143768.937605:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594375040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.937612:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.937622:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 12 pid: 15784 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.937629:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 12 pid: 15784 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.937641:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091338400/0xe984082ccd730c93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8205 expref: 12 pid: 15784 timeout: 947 lvb_type: 0 00010000:00010000:3.0:1746143768.937653:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.937668:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594375040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 63us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.937674:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7418 00000100:00100000:3.0:1746143768.937684:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7419 00000100:00100000:3.0:1746143768.937688:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594374912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.937693:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.937699:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 10 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.937711:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 10 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.937721:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c37400/0xe984082ccd730cd2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a823d expref: 10 pid: 8497 timeout: 947 lvb_type: 1 00010000:00010000:3.0:1746143768.937728:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.937741:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594374912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.937746:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7419 00000100:00100000:0.0:1746143768.939197:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.939235:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375296 00000100:00100000:2.0:1746143768.939241:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375296 00010000:00010000:2.0:1746143768.939259:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 19 pid: 15784 timeout: 947 lvb_type: 1 00000100:00100000:2.0:1746143768.939276:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7420 00000100:00100000:2.0:1746143768.939280:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594375296:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.939289:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.939301:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 19 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.939310:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 19 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.939323:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091338c00/0xe984082ccd730d5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a826e expref: 19 pid: 15784 timeout: 947 lvb_type: 1 00010000:00010000:2.0:1746143768.939346:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.939347:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.939352:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.939359:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.939382:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.939393:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594426624:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143768.939593:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.940291:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.940315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.940332:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375552 00000100:00100000:1.0:1746143768.940336:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375552 00000100:00100000:0.0:1746143768.940342:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.940365:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375424 00000100:00100000:2.0:1746143768.940366:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375680 00000100:00100000:1.0:1746143768.940366:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375424 00000100:00100000:2.0:1746143768.940368:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375680 00000100:00100000:1.0:1746143768.940382:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13831 00000100:00100000:2.0:1746143768.940387:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13832 00000100:00100000:1.0:1746143768.940387:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594375552:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143768.940391:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594375424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143768.940397:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.940397:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.940405:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4800/0xe984082ccd730dea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82d0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.940405:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730de3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82d7 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.940407:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13833 00000100:00100000:3.0:1746143768.940414:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594375680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143768.940420:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.940427:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cde7800/0xe984082ccd730df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82de expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.940429:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594426880:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143768.940429:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594426752:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143768.940443:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cde7800/0xe984082ccd730df1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82de expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.940456:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cde7800/0xe984082ccd730df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82de expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143768.940459:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa96c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143768.940463:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cde7800, rc 0) 00000100:00100000:1.0:1746143768.940467:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.940482:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594375680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 69us (139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143768.940486:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13833 00000100:00100000:2.0:1746143768.940751:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594426624:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143768.940760:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.940777:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594375296:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1497us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.940783:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7420 00000100:00100000:0.0:1746143768.945261:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.945361:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594426752:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143768.945388:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730de3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82d7 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.945401:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730de3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82d7 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.945413:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1200, rc 0) 00000100:00100000:1.0:1746143768.945448:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594375552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5060us (5157us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143768.945455:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13831 00000100:00100000:3.0:1746143768.945812:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594375936 00000100:00100000:3.0:1746143768.945818:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594375936 00002000:00100000:3.0:1746143768.945848:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4730880->4734975) req@ffff8800930d1f80 x1830963594375936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.945856:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1f80 with x1830963594375936 ext(4730880->4734975) 00002000:00010000:3.0:1746143768.945859:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1f80 00000100:00100000:3.0:1746143768.945885:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6546 00000100:00100000:3.0:1746143768.945891:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594375936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143768.945964:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594426880:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143768.945980:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4800/0xe984082ccd730dea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82d0 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.945989:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4800/0xe984082ccd730dea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82d0 expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.945996:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4800, rc 0) 00000100:00100000:3.0:1746143768.946206:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594375936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 314us (952us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143768.946212:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6546 00000100:00100000:2.0:1746143768.946213:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594375424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5820us (5896us total) trans 0 rc 301/301 00002000:00100000:3.0:1746143768.946218:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4730880->4734975) req@ffff8800930d1f80 x1830963594375936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143768.946219:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13832 00002000:00100000:3.0:1746143768.946224:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1f80 with x1830963594375936 ext(4730880->4734975) 00002000:00010000:3.0:1746143768.946227:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1f80 00000100:00100000:0.0:1746143768.948028:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.948071:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.948074:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376320 00000100:00100000:3.0:1746143768.948081:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376320 00000100:00100000:2.0:1746143768.948115:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376448 00000100:00100000:2.0:1746143768.948118:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376448 00002000:00100000:2.0:1746143768.948134:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4767744->4771839) req@ffff88009e5cdc00 x1830963594376448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.948171:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cdc00 with x1830963594376448 ext(4767744->4771839) 00002000:00010000:2.0:1746143768.948174:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cdc00 00000100:00100000:2.0:1746143768.948188:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6547 00000100:00100000:2.0:1746143768.948192:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594376448:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143768.948206:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4008 00000100:00100000:3.0:1746143768.948213:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31538:x1830963594376320:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143768.948299:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594376448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 105us (227us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143768.948305:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6547 00002000:00100000:2.0:1746143768.948309:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4767744->4771839) req@ffff88009e5cdc00 x1830963594376448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746143779 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143768.948316:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cdc00 with x1830963594376448 ext(4767744->4771839) 00002000:00010000:2.0:1746143768.948318:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e5cdc00 00000100:00100000:3.0:1746143768.948353:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31538:x1830963594376320:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 139us (328us total) trans 8589943630 rc 0/0 00000100:00100000:3.0:1746143768.948359:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4008 00000100:00100000:0.0:1746143768.952674:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.952796:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376704 00000100:00100000:3.0:1746143768.952803:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376704 00000100:00100000:3.0:1746143768.952855:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4009 00000100:00100000:3.0:1746143768.952860:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31536:x1830963594376704:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143768.953023:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31536:x1830963594376704:12345-192.168.202.48@tcp:35:cat.0 Request processed in 161us (353us total) trans 8589943631 rc 0/0 00000100:00100000:3.0:1746143768.953032:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4009 00000100:00100000:0.0:1746143768.967686:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.967791:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376832 00000100:00100000:2.0:1746143768.967798:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376832 00000100:00100000:2.0:1746143768.967835:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9282 00000100:00100000:2.0:1746143768.967842:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31547:x1830963594376832:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.967860:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.967874:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd730df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82e5 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.967929:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.967939:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.967948:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.967958:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.967962:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.967967:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968060:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968066:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968071:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143768.968101:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:2.0:1746143768.968105:0:16090:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143768.968118:0:16090:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968126:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968134:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968174:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968181:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968185:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d5a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.968189:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968195:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968204:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143768.968206:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143768.968209:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968214:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5a00/0xe984082ccd730dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968239:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968244:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968248:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968252:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d5000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143768.968254:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968259:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968264:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f0f2200) 00010000:00010000:2.0:1746143768.968265:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143768.968267:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968271:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5000/0xe984082ccd730e06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143768.968292:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd730df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.968301:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 7 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.968306:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.968308:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143768.968310:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d5600, rc 0) 00000100:00100000:2.0:1746143768.968346:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31547:x1830963594376832:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 504us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.968351:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9282 00000100:00100000:0.0:1746143768.971331:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.971363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.971735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.971790:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377088 00000100:00100000:2.0:1746143768.971797:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377088 00000100:00100000:0.0:1746143768.971800:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.971833:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377344 00000100:00100000:2.0:1746143768.971835:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377344 00000100:00100000:2.0:1746143768.971847:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594376960 00000100:00100000:2.0:1746143768.971849:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594376960 00000100:00100000:2.0:1746143768.971855:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377216 00000100:00100000:2.0:1746143768.971856:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377216 00000100:00100000:1.0:1746143768.971862:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13834 00000100:00100000:1.0:1746143768.971873:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594377088:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:3.0:1746143768.971878:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13835 00000100:00100000:3.0:1746143768.971886:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594377344:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143768.971887:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.971893:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.971901:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1600/0xe984082ccd730e14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82f3 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.971903:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336b800/0xe984082ccd730e1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8301 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.971940:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594427008:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143768.971940:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594427136:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143768.972036:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.972085:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13836 00000100:00100000:2.0:1746143768.972092:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594376960:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.972099:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.972107:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d5c00/0xe984082ccd730e22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82ec expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.972129:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594427264:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143768.972181:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.972194:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13837 00000100:00100000:2.0:1746143768.972199:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594377216:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.972204:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.972209:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5800/0xe984082ccd730e29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a82fa expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.972224:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5800/0xe984082ccd730e29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82fa expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.972231:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5800/0xe984082ccd730e29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82fa expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.972239:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d5800, rc 0) 00000100:00100000:2.0:1746143768.972253:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594377216:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 54us (453us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143768.972258:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13837 00000100:00100000:3.0:1746143768.972343:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143768.973400:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594427136:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143768.973418:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594427008:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143768.973418:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1600/0xe984082ccd730e14 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82f3 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143768.973427:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594427264:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143768.973427:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1600/0xe984082ccd730e14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82f3 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.973435:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336b800/0xe984082ccd730e1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8301 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.973439:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1600, rc 0) 00010000:00010000:2.0:1746143768.973441:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d5c00/0xe984082ccd730e22 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82ec expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.973450:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336b800/0xe984082ccd730e1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8301 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.973450:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d5c00/0xe984082ccd730e22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82ec expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.973457:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d5c00, rc 0) 00010000:00010000:3.0:1746143768.973462:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336b800, rc 0) 00000100:00100000:1.0:1746143768.973462:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594377088:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1592us (2139us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143768.973468:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13834 00000100:00100000:2.0:1746143768.973475:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594376960:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1384us (1739us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143768.973479:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594377344:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1594us (2115us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143768.973481:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13836 00000100:00100000:3.0:1746143768.973484:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13835 00000100:00100000:0.0:1746143768.975979:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.976120:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377600 00000100:00100000:2.0:1746143768.976127:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377600 00000100:00100000:2.0:1746143768.976254:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9283 00000100:00100000:2.0:1746143768.976259:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31547:x1830963594377600:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.976270:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.976281:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4600/0xe984082ccd730e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8308 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.976362:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.976373:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.976379:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.976401:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.976411:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 8 pid: 16090 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.976420:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594427392:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.976504:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.978300:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594427392:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.978322:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143768.978509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.978570:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377728 00000100:00100000:2.0:1746143768.978574:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377728 00010000:00010000:2.0:1746143768.978595:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.978621:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7421 00000100:00100000:2.0:1746143768.978627:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594377728:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.978638:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.978642:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.978649:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.978664:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5600/0xe984082ccd730e0d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82e5 expref: 9 pid: 16090 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.978679:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.978682:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.978689:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.978694:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.978720:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.978753:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594377728:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.978763:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7421 00010000:00010000:0.0:1746143768.978872:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143768.978879:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:0.0:1746143768.978899:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:0.0:1746143768.979019:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4600/0xe984082ccd730e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.979042:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.979048:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:0.0:1746143768.979051:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143768.979053:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d5e00, rc 0) 00000100:00100000:0.0:1746143768.979084:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594377600:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2824us (3111us total) trans 8589943632 rc 0/0 00000100:00100000:0.0:1746143768.979090:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9283 00000100:00100000:0.0:1746143768.980766:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.980903:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377856 00000100:00100000:2.0:1746143768.980908:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377856 00000100:00100000:2.0:1746143768.980998:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9284 00000100:00100000:2.0:1746143768.981004:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594377856:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.981020:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.981032:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd730e45 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a830f expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.981090:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.981105:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.981111:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.981131:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.981164:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 9 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.981174:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594427520:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.981245:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.982460:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594427520:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.982474:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143768.982990:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.983067:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594377984 00000100:00100000:2.0:1746143768.983071:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594377984 00010000:00010000:2.0:1746143768.983091:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 10 pid: 14762 timeout: 947 lvb_type: 0 00000100:00100000:2.0:1746143768.983109:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7422 00000100:00100000:2.0:1746143768.983115:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594377984:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.983124:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.983129:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 10 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.983174:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 10 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.983193:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5e00/0xe984082ccd730e37 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8308 expref: 10 pid: 14762 timeout: 947 lvb_type: 0 00010000:00010000:2.0:1746143768.983205:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143768.983208:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.983215:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.983219:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143768.983246:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.983283:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594377984:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 168us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.983289:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7422 00010000:00010000:3.0:1746143768.983387:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.983394:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143768.983425:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143768.983429:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143768.983441:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.983463:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd730e45 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a830f expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.983489:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a830f expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.983495:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.983497:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143768.983499:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4200, rc 0) 00000100:00100000:3.0:1746143768.983528:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594377856:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2524us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.983535:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9284 00000100:00100000:0.0:1746143768.985108:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.985171:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378112 00000100:00100000:0.0:1746143768.985172:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.985176:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378112 00000100:00100000:3.0:1746143768.985207:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378240 00000100:00100000:3.0:1746143768.985209:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378240 00000100:00100000:3.0:1746143768.985231:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13838 00000100:00100000:3.0:1746143768.985237:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594378112:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:0.0:1746143768.985239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143768.985248:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.985261:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009336b800/0xe984082ccd730e53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8316 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.985294:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378368 00000100:00100000:2.0:1746143768.985298:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378368 00000100:00100000:3.0:1746143768.985301:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594427648:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143768.985301:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13839 00000100:00100000:1.0:1746143768.985310:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594378240:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:2.0:1746143768.985316:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13840 00000100:00100000:2.0:1746143768.985321:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1965:x1830963594378368:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143768.985322:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.985327:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143768.985331:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0200/0xe984082ccd730e5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a831d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.985338:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4000/0xe984082ccd730e61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8324 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.985348:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143768.985354:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4000/0xe984082ccd730e61 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8324 expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143768.985356:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594427776:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143768.985362:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4000/0xe984082ccd730e61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8324 expref: 12 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.985375:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4000, rc 0) 00000100:00100000:1.0:1746143768.985378:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.985393:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594378368:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 72us (154us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143768.985398:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13840 00000100:00100000:0.0:1746143768.986461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.986529:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378496 00000100:00100000:2.0:1746143768.986533:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378496 00000100:00100000:2.0:1746143768.986551:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13841 00000100:00100000:2.0:1746143768.986556:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594378496:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143768.986564:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143768.986572:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd730e68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a832b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.986602:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594427904:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143768.986656:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143768.986880:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594427648:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143768.986901:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009336b800/0xe984082ccd730e53 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8316 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.986911:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009336b800/0xe984082ccd730e53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8316 expref: 12 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143768.986920:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009336b800, rc 0) 00000100:00100000:1.0:1746143768.986953:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594427776:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143768.986968:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0200/0xe984082ccd730e5a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a831d expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.986977:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e0200/0xe984082ccd730e5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a831d expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143768.986991:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594378112:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1752us (1884us total) trans 0 rc 301/301 00010000:00010000:1.0:1746143768.986994:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e0200, rc 0) 00000100:00100000:3.0:1746143768.986997:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13838 00000100:00100000:1.0:1746143768.987052:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594378240:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1743us (1912us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143768.987057:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13839 00000100:00100000:2.0:1746143768.987827:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594427904:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143768.987841:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd730e68 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a832b expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.987850:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd730e68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a832b expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.987866:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4e00, rc 0) 00000100:00100000:2.0:1746143768.987895:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594378496:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1338us (1436us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143768.987903:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13841 00000100:00100000:0.0:1746143768.989384:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.989440:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378752 00000100:00100000:3.0:1746143768.989446:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378752 00000100:00100000:3.0:1746143768.989485:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9285 00000100:00100000:3.0:1746143768.989491:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594378752:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143768.989504:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143768.989516:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd730e6f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8332 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.989591:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652b000/0xe984082ccd730e76 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.989602:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652b000/0xe984082ccd730e76 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143768.989611:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652b000/0xe984082ccd730e76 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143768.989621:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143768.989711:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652a800/0xe984082ccd730e6f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8332 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.989724:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652b000/0xe984082ccd730e76 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8332 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.989731:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143768.989733:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143768.989735:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a652b000, rc 0) 00000100:00100000:3.0:1746143768.989771:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31547:x1830963594378752:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 280us (389us total) trans 8589943633 rc 0/0 00000100:00100000:3.0:1746143768.989777:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9285 00000100:00100000:0.0:1746143768.991474:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.991504:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.991526:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.991558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.991573:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594378880 00000100:00100000:0.0:1746143768.991578:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594378880 00000100:00100000:0.0:1746143768.991598:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379008 00000100:00100000:0.0:1746143768.991600:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379008 00000100:00100000:0.0:1746143768.991609:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379136 00000100:00100000:0.0:1746143768.991611:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379136 00000100:00100000:0.0:1746143768.991618:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379264 00000100:00100000:0.0:1746143768.991619:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379264 00000100:00100000:0.0:1746143768.991630:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13842 00000100:00100000:0.0:1746143768.991635:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594378880:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143768.991661:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.991674:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 17 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.991682:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.991688:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.991693:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.991695:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.991697:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.991726:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13843 00010000:00010000:0.0:1746143768.991732:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143768.991734:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594379008:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:0.0:1746143768.991742:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 10 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143768.991753:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.991757:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13844 00000100:00100000:0.0:1746143768.991759:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594428032:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.991763:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 21 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143768.991765:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594379136:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143768.991771:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.991777:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.991781:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.991783:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.991784:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.991786:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.991791:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 7 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143768.991796:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.991797:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143768.991799:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.991800:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 10 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143768.991808:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 10 pid: 25369 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.991813:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 10 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143768.991814:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 7 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.991822:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594428160:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143768.991822:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 7 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143768.991822:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 10 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143768.991830:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594428288:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.991831:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594428416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.991849:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 7 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143768.991851:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 17 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143768.991854:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783900 going to sleep for 11 seconds 00010000:00010000:2.0:1746143768.991856:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 7 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.991859:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 17 pid: 9527 timeout: 948 lvb_type: 1 00000100:00100000:2.0:1746143768.991864:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594428544:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.991866:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594428672:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.991884:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 21 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143768.991887:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a2037e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746143768.991891:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 21 pid: 6929 timeout: 948 lvb_type: 1 00000100:00100000:2.0:1746143768.991898:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594428800:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.991911:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143768.991924:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13845 00000100:00100000:2.0:1746143768.991929:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594379264:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143768.991944:0:2839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.991953:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.991964:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143768.991965:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143768.991967:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.991979:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 10 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.991992:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 10 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143768.992000:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594428928:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.992022:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.992442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.992476:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.992976:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379520 00000100:00100000:2.0:1746143768.992976:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379392 00000100:00100000:3.0:1746143768.992982:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379520 00000100:00100000:2.0:1746143768.992982:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379392 00000100:00100000:3.0:1746143768.993017:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13846 00000100:00100000:3.0:1746143768.993022:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594379520:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:2.0:1746143768.993022:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13847 00000100:00100000:2.0:1746143768.993027:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594379392:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143768.993039:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.993043:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.993050:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.993053:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.993055:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143768.993057:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143768.993059:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.993060:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.993070:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143768.993071:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143768.993073:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 21 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.993073:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.993081:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 21 pid: 25369 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143768.993088:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.993089:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594429056:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143768.993096:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 17 pid: 8495 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143768.993104:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594429184:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.993177:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143768.993186:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.993194:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 17 pid: 8495 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143768.993201:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594429312:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.993226:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5aa90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143768.993560:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.993574:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379904 00000100:00100000:0.0:1746143768.993577:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379904 00000100:00100000:2.0:1746143768.993579:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594428032:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143768.993590:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594428288:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.993590:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 11 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:2.0:1746143768.993597:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594428672:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.993606:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7423 00010000:00010000:2.0:1746143768.993612:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.993612:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594379904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.993618:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.993636:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 11 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.993643:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 11 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.993660:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a034b200/0xe984082ccd730d26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a824b expref: 11 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.993684:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.993702:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594379904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.993708:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7423 00000100:00100000:0.0:1746143768.993742:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.993752:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380160 00000100:00100000:0.0:1746143768.993754:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380160 00000100:00100000:1.0:1746143768.993761:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594428416:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.993763:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 8 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143768.993775:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143768.993775:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7424 00000100:00100000:0.0:1746143768.993779:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1962:x1830963594380160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.993785:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.993795:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 8 pid: 8497 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143768.993839:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594428160:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.993847:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594428544:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143768.994170:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 8 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.994184:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800957e1800/0xe984082ccd730d18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8252 expref: 8 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.994192:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.994206:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1962:x1830963594380160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 427us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.994211:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7424 00000100:00100000:0.0:1746143768.994930:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143768.994956:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.994959:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594428928:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143768.994968:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.994969:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379648 00010000:00010000:2.0:1746143768.994971:0:2839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143768.994973:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379648 00010000:00010000:1.0:1746143768.994987:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 12 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143768.995131:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594428800:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.995170:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.995287:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380288 00000100:00100000:2.0:1746143768.995291:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380288 00000100:00100000:1.0:1746143768.995291:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380416 00000100:00100000:0.0:1746143768.995293:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.995294:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380416 00010000:00010000:1.0:1746143768.995306:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 22 pid: 6929 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143768.995318:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143768.995325:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594379776 00000100:00100000:1.0:1746143768.995327:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594379776 00000100:00100000:0.0:1746143768.995336:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7425 00010000:00010000:1.0:1746143768.995337:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 12 pid: 25369 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143768.995341:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594379648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143768.995347:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7426 00010000:00010000:0.0:1746143768.995349:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143768.995352:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594380416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143768.995359:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143768.995361:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 12 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143768.995369:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 22 pid: 6929 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.995369:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 12 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143768.995377:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 22 pid: 6929 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143768.995380:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 18 pid: 9527 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.995382:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091339a00/0xe984082ccd730cb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8221 expref: 12 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143768.995388:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5546c00/0xe984082ccd730c54 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81d4 expref: 22 pid: 6929 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.995391:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.995394:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7427 00010000:00010000:1.0:1746143768.995396:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143768.995399:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594379776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143768.995406:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143768.995407:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594379648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 66us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143768.995413:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594380416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 61us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.995413:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7425 00010000:00010000:2.0:1746143768.995416:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 12 pid: 25369 timeout: 948 lvb_type: 1 00000100:00100000:1.0:1746143768.995418:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7426 00000100:00100000:0.0:1746143768.995424:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7428 00010000:00010000:2.0:1746143768.995425:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 12 pid: 25369 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143768.995428:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594380288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143768.995433:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143768.995436:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093238e00/0xe984082ccd730cbd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8228 expref: 12 pid: 25369 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143768.995440:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 18 pid: 9527 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143768.995445:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143768.995446:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.995447:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 18 pid: 9527 timeout: 948 lvb_type: 1 00000100:00100000:1.0:1746143768.995448:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143768.995449:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.995456:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6c400/0xe984082ccd730c62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a81cd expref: 18 pid: 9527 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143768.995461:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.995464:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.995466:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143768.995469:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.995474:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143768.995487:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143768.995498:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594380288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143768.995504:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7428 00000100:00100000:0.0:1746143768.995521:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380032 00000100:00100000:0.0:1746143768.995524:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380032 00000100:00100000:1.0:1746143768.995530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:0.0:1746143768.995542:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1847296->2097151) req@ffff880094459f80 x1830963594380032/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.995550:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963594380032 ext(1847296->2097151) 00010000:00010000:0.0:1746143768.995555:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 7 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143768.995563:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 7 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746143768.995568:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094459f80 00000100:00100000:0.0:1746143768.995577:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1849 00000100:00100000:0.0:1746143768.995581:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1965:x1830963594380032:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143768.995853:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380544 00000100:00100000:3.0:1746143768.995856:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380544 00010000:00010000:2.0:1746143768.995867:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143768.995871:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1093631) req@ffff88012b7cd500 x1830963594380544/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.995877:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cd500 with x1830963594380544 ext(1048576->1093631) 00010000:00010000:3.0:1746143768.995882:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 10 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143768.995888:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594379776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 487us (594us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143768.995889:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 10 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143768.995894:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cd500 00000100:00100000:2.0:1746143768.995894:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7427 00000100:00100000:3.0:1746143768.995904:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380672 00000100:00100000:3.0:1746143768.995906:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380672 00000100:00100000:2.0:1746143768.995913:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1850 00002000:00100000:3.0:1746143768.995915:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3784704->4194303) req@ffff88012b7cdf80 x1830963594380672/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143768.995919:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594380544:12345-192.168.202.48@tcp:4:multiop.0 00002000:00100000:3.0:1746143768.995922:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdf80 with x1830963594380672 ext(3784704->4194303) 00010000:00010000:3.0:1746143768.995926:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 21 pid: 25369 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143768.995933:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 21 pid: 25369 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143768.995938:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7cdf80 00000100:00100000:3.0:1746143768.995946:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1851 00000100:00100000:3.0:1746143768.995951:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594380672:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:2.0:1746143768.996003:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996011:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996025:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996032:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996038:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996044:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135181800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143768.996047:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996054:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996064:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143768.996069:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135181800/0xe984082ccd730e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143768.996120:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594378880:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 4483us (4649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143768.996127:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13842 00000100:00100000:2.0:1746143768.996197:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594429184:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143768.996297:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594429056:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143768.996311:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996325:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996331:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996343:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996349:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996355:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996359:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d4600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143768.996362:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996374:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996387:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143768.996392:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4600/0xe984082ccd730e8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.996434:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594379008:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 4701us (4928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.996439:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13843 00000100:00100000:1.0:1746143768.996625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143768.996646:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594429312:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143768.996655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143768.996658:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380800 00010000:00010000:2.0:1746143768.996658:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143768.996661:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380800 00010000:00010000:3.0:1746143768.996674:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 17 pid: 8495 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143768.996720:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7429 00000100:00100000:3.0:1746143768.996725:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594380800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143768.996730:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143768.996739:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 17 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143768.996751:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 17 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143768.996762:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d4c00/0xe984082ccd730ddc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4734976->18446744073709551615] (req 4767744->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c9 expref: 17 pid: 8495 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746143768.996795:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594380928 00000100:00100000:0.0:1746143768.996798:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594380928 00002000:00100000:0.0:1746143768.996812:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4734975) req@ffff88012b7cd180 x1830963594380928/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/0 e 0 to 0 dl 1746143779 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143768.996818:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cd180 with x1830963594380928 ext(4194304->4734975) 00010000:00010000:0.0:1746143768.996823:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143768.996830:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746143768.996840:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cd180 00000100:00100000:0.0:1746143768.996849:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1852 00000100:00100000:0.0:1746143768.996854:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594380928:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:3.0:1746143768.997067:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143768.997089:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594380800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 363us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143768.997095:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7429 00000100:00100000:3.0:1746143768.999221:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594380544:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 3296us (3766us total) trans 21474840515 rc 0/0 00000100:00100000:3.0:1746143768.999229:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1850 00002000:00100000:3.0:1746143768.999237:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1093631) req@ffff88012b7cd500 x1830963594380544/t21474840515(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143768.999244:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cd500 with x1830963594380544 ext(1048576->1093631) 00010000:00010000:3.0:1746143768.999251:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143768.999260:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143768.999266:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cd500 00000100:00100000:2.0:1746143769.000402:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594380032:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 4816us (5079us total) trans 17179873189 rc 0/0 00000100:00100000:2.0:1746143769.000409:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1849 00002000:00100000:2.0:1746143769.000415:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1847296->2097151) req@ffff880094459f80 x1830963594380032/t17179873189(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.000422:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094459f80 with x1830963594380032 ext(1847296->2097151) 00010000:00010000:2.0:1746143769.000434:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 9 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.000443:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 9 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.000449:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094459f80 00000100:00100000:0.0:1746143769.002461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.002636:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.002982:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594381056 00000100:00100000:2.0:1746143769.002990:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594381056 00010000:00010000:2.0:1746143769.003014:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.003035:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594381184 00000100:00100000:2.0:1746143769.003038:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594381184 00010000:00010000:2.0:1746143769.003048:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 9 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.003078:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7430 00000100:00100000:2.0:1746143769.003084:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594381056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.003095:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.003112:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.003120:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.003166:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009336aa00/0xe984082ccd730dab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8298 expref: 12 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.003177:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7431 00010000:00010000:2.0:1746143769.003183:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.003185:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143769.003185:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594381184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.003189:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003192:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.003196:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003204:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 9 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.003212:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143769.003212:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 9 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.003223:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a034a600/0xe984082ccd730da4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1847296->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8291 expref: 9 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.003232:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.003233:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.003235:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.003238:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594381056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 155us (784us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143769.003241:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.003244:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7430 00010000:00010000:1.0:1746143769.003254:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143769.003262:0:2839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.003269:0:2839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.003271:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594381184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.003277:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7431 00010000:00010000:2.0:1746143769.003282:0:2839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.003290:0:2839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.003296:0:2839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.003305:0:2839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d42f000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143769.003309:0:2839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.003315:0:2839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003319:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.003323:0:2839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003326:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.003327:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d42f000/0xe984082ccd730e99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003338:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003344:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003350:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.003355:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594379264:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 11425us (11796us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143769.003355:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0e0e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143769.003357:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.003361:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13845 00010000:00010000:1.0:1746143769.003362:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003371:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.003377:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0e0e00/0xe984082ccd730e92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.003412:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594379136:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 11649us (11885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.003418:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13844 00000100:00100000:3.0:1746143769.006838:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594380672:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10878us (11300us total) trans 17179873190 rc 0/0 00000100:00100000:3.0:1746143769.006848:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1851 00002000:00100000:3.0:1746143769.006859:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3784704->4194303) req@ffff88012b7cdf80 x1830963594380672/t17179873190(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.006868:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cdf80 with x1830963594380672 ext(3784704->4194303) 00010000:00010000:3.0:1746143769.006877:0:21518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 23 pid: 25369 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.006887:0:21518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 23 pid: 25369 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143769.006893:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b7cdf80 00000100:00100000:2.0:1746143769.009566:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.009640:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594381312 00000100:00100000:1.0:1746143769.009648:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594381312 00010000:00010000:1.0:1746143769.009674:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 23 pid: 25369 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.009698:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7432 00000100:00100000:1.0:1746143769.009704:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594381312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.009715:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.009731:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 23 pid: 25369 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.009742:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 23 pid: 25369 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.009759:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135180400/0xe984082ccd730db2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3784704->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a829f expref: 23 pid: 25369 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.009771:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.009772:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.009776:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.009783:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.009955:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.009988:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594381312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 283us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.009994:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7432 00010000:00010000:3.0:1746143769.010118:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010126:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010166:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010173:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010179:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010184:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a652a000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143769.010187:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010193:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010208:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.010213:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a652a000/0xe984082ccd730ea0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.010252:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594379520:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 17229us (17775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.010259:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13846 00000100:00100000:0.0:1746143769.010335:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594380928:12345-192.168.202.48@tcp:4:cat.0 Request processed in 13479us (13678us total) trans 21474840516 rc 0/0 00000100:00100000:0.0:1746143769.010343:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1852 00002000:00100000:0.0:1746143769.010350:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4734975) req@ffff88012b7cd180 x1830963594380928/t21474840516(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:164/0 lens 488/448 e 0 to 0 dl 1746143779 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.010358:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7cd180 with x1830963594380928 ext(4194304->4734975) 00010000:00010000:0.0:1746143769.010365:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143769.010376:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746143769.010382:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7cd180 00000100:00100000:0.0:1746143769.013817:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.013898:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594381440 00000100:00100000:1.0:1746143769.013906:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594381440 00010000:00010000:1.0:1746143769.013933:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.013968:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7433 00000100:00100000:1.0:1746143769.013976:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594381440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.013987:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.014005:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.014015:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.014034:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2d5200/0xe984082ccd730dd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4734975] (req 4194304->4734975) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a82c2 expref: 18 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.014046:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.014048:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.014051:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.014062:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.014091:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.014121:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594381440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 146us (310us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143769.014122:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.014127:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7433 00010000:00010000:3.0:1746143769.014131:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.014179:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.014187:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.014192:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.014199:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63d9a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143769.014201:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.014208:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.014218:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.014223:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a63d9a00/0xe984082ccd730ea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.014258:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594379392:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 21230us (21816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.014265:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13847 00000100:00100000:0.0:1746143769.015880:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.015956:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594381696 00000100:00100000:3.0:1746143769.015962:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594381696 00000100:00100000:3.0:1746143769.016001:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9286 00000100:00100000:3.0:1746143769.016006:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31547:x1830963594381696:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1746143769.016047:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.016066:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730e4c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a830f expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.016078:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143769.016082:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143769.016111:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.016121:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 7 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.016128:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 242 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.016133:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.016186:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 242 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.016197:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 242 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.016207:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594429440:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.016402:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 7 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.016409:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 7 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.016416:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594429568:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.016435:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.017202:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594429440:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.017209:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594429568:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.017329:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143769.017908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.017993:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594381952 00000100:00100000:2.0:1746143769.017998:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594381952 00010000:00010000:2.0:1746143769.018019:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 243 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746143769.018027:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.018044:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594381824 00000100:00100000:2.0:1746143769.018050:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594381824 00010000:00010000:2.0:1746143769.018061:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 8 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.018087:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7434 00000100:00100000:2.0:1746143769.018092:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1964:x1830963594381952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.018100:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.018104:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 243 pid: 2976 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.018112:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 243 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.018123:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7435 00010000:00010000:2.0:1746143769.018126:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd730d9d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a828a expref: 243 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.018131:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1964:x1830963594381824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.018167:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143769.018171:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.018177:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143769.018179:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.018185:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 8 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.018194:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 8 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.018204:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd730d96 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8283 expref: 8 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.018205:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1964:x1830963594381952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.018211:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7434 00010000:00010000:1.0:1746143769.018214:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143769.018216:0:11106:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.018222:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.018226:0:11106:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.018256:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.018273:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+7:1964:x1830963594381824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 143us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.018277:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7435 00010000:00010000:2.0:1746143769.018334:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.018340:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000040:00080000:2.0:1746143769.018974:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2741, 88 off231752 00000004:00080000:2.0:1746143769.018980:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848028840485ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019029:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2751, 88 off232808 00000004:00080000:2.0:1746143769.019033:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848028893166ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.019056:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2752, 88 off232896 00000004:00080000:2.0:1746143769.019059:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848028919169ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.019066:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2742, 88 off231840 00000004:00080000:2.0:1746143769.019068:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848028928624ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019076:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2743, 88 off231928 00000004:00080000:2.0:1746143769.019079:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848028938972ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019087:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2753, 88 off232984 00000004:00080000:2.0:1746143769.019090:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848028950020ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.019188:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2754, 88 off233072 00000004:00080000:2.0:1746143769.019192:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848029052590ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.019215:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2755, 88 off233160 00000004:00080000:2.0:1746143769.019218:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848029077940ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.019224:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2744, 88 off232016 00000004:00080000:2.0:1746143769.019227:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848029087021ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019244:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2756, 88 off233248 00000004:00080000:2.0:1746143769.019247:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848029107681ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.019397:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2745, 88 off232104 00000004:00080000:2.0:1746143769.019400:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848029260800ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019418:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2757, 88 off233336 00000004:00080000:2.0:1746143769.019421:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848029281154ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.019428:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2746, 88 off232192 00000004:00080000:2.0:1746143769.019430:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848029290575ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019439:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2747, 88 off232280 00000004:00080000:2.0:1746143769.019441:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848029301640ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019448:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2748, 88 off232368 00000004:00080000:2.0:1746143769.019451:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848029311339ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019458:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2749, 88 off232456 00000004:00080000:2.0:1746143769.019460:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848029320092ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.019465:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2758, 88 off233424 00000004:00080000:2.0:1746143769.019468:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848029328359ns, next at 833304778357ns, rc = 0 00000001:00080000:0.0:1746143769.033518:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943632 is committed 00000001:00080000:0.0:1746143769.033528:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943634 is committed 00000004:00010000:1.0:1746143769.033530:0:14762:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009445b800 reply state ffff88009443a000 transno 8589943634 ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00080000:0.0:1746143769.033534:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2093 committed 00000100:00100000:1.0:1746143769.033539:0:14762:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1746143769.033539:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2084 committed 00000004:00080000:0.0:1746143769.033543:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2083 committed 00000004:00080000:0.0:1746143769.033545:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2082 committed 00000004:00080000:0.0:1746143769.033546:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2081 committed 00000004:00080000:0.0:1746143769.033547:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2092 committed 00000004:00080000:0.0:1746143769.033548:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2080 committed 00000004:00080000:0.0:1746143769.033549:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2091 committed 00000004:00080000:0.0:1746143769.033550:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2079 committed 00000004:00080000:0.0:1746143769.033552:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2090 committed 00000004:00080000:0.0:1746143769.033553:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2089 committed 00000004:00080000:0.0:1746143769.033554:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2088 committed 00000004:00080000:0.0:1746143769.033555:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2078 committed 00000004:00080000:0.0:1746143769.033556:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2077 committed 00000004:00080000:0.0:1746143769.033558:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2087 committed 00000004:00080000:0.0:1746143769.033559:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2086 committed 00000004:00080000:0.0:1746143769.033560:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2076 committed 00000001:00080000:0.0:1746143769.033567:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943631 is committed 00000001:00080000:0.0:1746143769.033571:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943629 is committed 00010000:00080000:1.0:1746143769.033618:0:14762:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143769.033686:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143769.033700:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594429696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.033740:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.033785:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594381696:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 17776us (17907us total) trans 8589943634 rc 0/0 00000100:00100000:3.0:1746143769.033786:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594430208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.033793:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9286 00010000:00010000:3.0:1746143769.033810:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.033817:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.033822:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.033827:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009075e400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143769.033831:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.033837:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.033848:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143769.033851:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143769.033854:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.033858:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009075e400/0xe984082ccd730eae lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143769.033874:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594429824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.033980:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594430080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.033980:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594429952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.033996:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.034007:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594430592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.034011:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.034021:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.034022:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594430464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.034030:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594431104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.034033:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.034041:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.034043:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594430976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.034050:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594431616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.034054:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.034061:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.034062:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594431488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.034070:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143769.034072:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.034074:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594430720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.034084:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.034090:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429696 00000100:00100000:2.0:1746143769.034093:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594431232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.034096:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429696 00000100:00100000:2.0:1746143769.034104:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.034122:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430080 00000100:00100000:2.0:1746143769.034124:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429952 00000100:00100000:0.0:1746143769.034124:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430080 00000100:00100000:2.0:1746143769.034126:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429952 00000100:00100000:0.0:1746143769.034130:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430592 00000100:00100000:0.0:1746143769.034132:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430592 00000100:00100000:2.0:1746143769.034134:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430464 00000100:00100000:2.0:1746143769.034135:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430464 00000100:00100000:0.0:1746143769.034163:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431104 00000100:00100000:0.0:1746143769.034165:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431104 00000100:00100000:2.0:1746143769.034168:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430976 00000100:00100000:2.0:1746143769.034170:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430976 00000100:00100000:2.0:1746143769.034175:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431616 00000100:00100000:0.0:1746143769.034176:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431488 00000100:00100000:2.0:1746143769.034177:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431616 00000100:00100000:0.0:1746143769.034177:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431488 00000100:00100000:2.0:1746143769.034182:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431232 00000100:00100000:0.0:1746143769.034182:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430720 00000100:00100000:2.0:1746143769.034184:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431232 00000100:00100000:0.0:1746143769.034184:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430720 00000100:00100000:2.0:1746143769.034191:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13848 00000100:00100000:2.0:1746143769.034195:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963594429696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.034421:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13849 00000100:00100000:0.0:1746143769.034427:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963594430080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.034513:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13850 00000100:00100000:1.0:1746143769.034517:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13851 00000100:00100000:3.0:1746143769.034519:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963594429952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.034522:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963594430592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.034544:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13852 00000100:00100000:3.0:1746143769.034548:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3293:x1830963594430464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.034617:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3293:x1830963594430464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (582us total) trans 21474840518 rc 0/0 00000100:00100000:1.0:1746143769.034617:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3294:x1830963594430592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (594us total) trans 21474840517 rc 0/0 00000100:00100000:1.0:1746143769.034622:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13851 00000100:00100000:0.0:1746143769.034673:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3294:x1830963594430080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 246us (676us total) trans 21474840519 rc 0/0 00000100:00100000:3.0:1746143769.034691:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13852 00000100:00100000:3.0:1746143769.034702:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13853 00000100:00100000:3.0:1746143769.034706:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963594431104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.034760:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3294:x1830963594429696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 564us (1019us total) trans 21474840520 rc 0/0 00000100:00100000:2.0:1746143769.034765:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13848 00000100:00100000:2.0:1746143769.034774:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13854 00000100:00100000:2.0:1746143769.034778:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3293:x1830963594430976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143769.034780:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143769.034783:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143769.034785:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143769.034786:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143769.034788:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143769.034804:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594431104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (761us total) trans 17179873191 rc 0/0 00000100:00100000:3.0:1746143769.034808:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13853 00000100:00100000:3.0:1746143769.034816:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13855 00000100:00100000:3.0:1746143769.034820:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3293:x1830963594431488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.034848:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3293:x1830963594430976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (793us total) trans 17179873192 rc 0/0 00000100:00100000:2.0:1746143769.034853:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13854 00000100:00100000:2.0:1746143769.034861:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13856 00000100:00100000:2.0:1746143769.034864:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594431616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.034879:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3293:x1830963594431488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (806us total) trans 17179873193 rc 0/0 00000100:00100000:3.0:1746143769.034884:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13855 00000100:00100000:3.0:1746143769.034891:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13857 00000100:00100000:3.0:1746143769.034895:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3294:x1830963594430720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.034924:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594431616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (862us total) trans 17179873194 rc 0/0 00000100:00100000:2.0:1746143769.034929:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13856 00000100:00100000:2.0:1746143769.034936:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13858 00000100:00100000:2.0:1746143769.034940:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594431232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.034958:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3294:x1830963594430720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (872us total) trans 17179873195 rc 0/0 00000100:00100000:3.0:1746143769.034963:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13857 00000100:00100000:3.0:1746143769.035039:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3293:x1830963594429952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 521us (1026us total) trans 21474840521 rc 0/0 00000100:00100000:3.0:1746143769.035043:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13850 00000100:00080000:1.0:1746143769.035051:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143769.035053:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143769.035060:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.035075:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429824 00000100:00100000:1.0:1746143769.035075:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594430336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.035078:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429824 00000100:00100000:1.0:1746143769.035091:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.035092:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13859 00000100:00100000:3.0:1746143769.035097:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3292:x1830963594429824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.035100:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594430848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.035112:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.035120:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594431360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.035133:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.035177:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430336 00000100:00100000:1.0:1746143769.035179:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430336 00000100:00100000:1.0:1746143769.035191:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430848 00000100:00100000:1.0:1746143769.035193:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430848 00000100:00100000:1.0:1746143769.035199:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431360 00000100:00100000:3.0:1746143769.035201:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594429824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (140us total) trans 21474840522 rc 0/0 00000100:00100000:1.0:1746143769.035201:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431360 00000100:00100000:3.0:1746143769.035206:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13859 00000100:00100000:1.0:1746143769.035208:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13860 00000100:00100000:1.0:1746143769.035212:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3292:x1830963594430336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.035213:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13861 00000100:00100000:3.0:1746143769.035217:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963594430848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.035279:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963594430848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (165us total) trans 17179873196 rc 0/0 00000100:00100000:1.0:1746143769.035279:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3292:x1830963594430336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (186us total) trans 21474840523 rc 0/0 00000100:00100000:3.0:1746143769.035284:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13861 00000100:00100000:3.0:1746143769.035304:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13862 00000100:00100000:3.0:1746143769.035309:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3292:x1830963594431360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.035329:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.035348:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430208 00000100:00100000:2.0:1746143769.035350:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430208 00000100:00100000:2.0:1746143769.035359:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13863 00000100:00100000:2.0:1746143769.035362:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3295:x1830963594430208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.035377:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3292:x1830963594431360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (242us total) trans 17179873197 rc 0/0 00000100:00100000:3.0:1746143769.035382:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13862 00000100:00100000:2.0:1746143769.035431:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3295:x1830963594430208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (100us total) trans 21474840524 rc 0/0 00000100:00100000:2.0:1746143769.035435:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13863 00000004:00080000:2.0:1746143769.035458:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445b480/2, rc 0, transno 21474840524 00000100:00100000:2.0:1746143769.035465:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594430208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.035479:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7ce680/2, rc 0, transno 17179873195 00000100:00100000:2.0:1746143769.035482:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594430720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143769.035488:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459c00/2, rc 0, transno 21474840519 00000100:00100000:2.0:1746143769.035490:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594430080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.035495:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459500/2, rc 0, transno 21474840517 00000100:00100000:2.0:1746143769.035497:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594430592:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.035502:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cea00/2, rc 0, transno 17179873191 00000100:00100000:2.0:1746143769.035504:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594431104:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143769.035509:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1efb80/2, rc 0, transno 17179873194 00000100:00100000:2.0:1746143769.035511:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594431616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143769.035517:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094458000/2, rc 0, transno 21474840520 00000100:00100000:2.0:1746143769.035519:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594429696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.035580:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3294:x1830963594431232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 639us (1474us total) trans 17179873198 rc 0/0 00000100:00100000:2.0:1746143769.035584:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13858 00000004:00080000:2.0:1746143769.035599:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7ced80/2, rc 0, transno 17179873198 00000100:00100000:2.0:1746143769.035602:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594431232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.035641:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13860 00000004:00080000:1.0:1746143769.035662:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459880/2, rc 0, transno 21474840522 00000100:00100000:1.0:1746143769.035665:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594429824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.035670:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445aa00/2, rc 0, transno 21474840523 00000100:00100000:1.0:1746143769.035672:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594430336:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.035677:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cc380/2, rc 0, transno 17179873196 00000100:00100000:1.0:1746143769.035679:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594430848:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143769.035683:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ec700/2, rc 0, transno 17179873197 00000100:00100000:1.0:1746143769.035685:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594431360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.035788:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13849 00000100:00100000:2.0:1746143769.035905:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594431744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.035921:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.035947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.036118:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431744 00000100:00100000:1.0:1746143769.036122:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431744 00000004:00080000:0.0:1746143769.036128:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094458380/2, rc 0, transno 21474840521 00000100:00100000:0.0:1746143769.036132:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594429952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143769.036160:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445bb80/2, rc 0, transno 21474840518 00000100:00100000:1.0:1746143769.036163:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13864 00000100:00100000:0.0:1746143769.036163:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594430464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.036169:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3295:x1830963594431744:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143769.036173:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b7cd880/2, rc 0, transno 17179873192 00000100:00100000:0.0:1746143769.036175:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594430976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143769.036179:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ee300/2, rc 0, transno 17179873193 00000100:00100000:0.0:1746143769.036181:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594431488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.036246:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3295:x1830963594431744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (323us total) trans 21474840525 rc 0/0 00000100:00100000:1.0:1746143769.036253:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13864 00000100:00100000:1.0:1746143769.036265:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382080 00000100:00100000:1.0:1746143769.036267:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382080 00000100:00100000:1.0:1746143769.036281:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9287 00000100:00100000:1.0:1746143769.036286:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31547:x1830963594382080:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143769.036296:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.036307:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8339 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.036342:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.036352:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.036364:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:1.0:1746143769.036366:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143769.036368:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a717a00, rc 0) 00000100:00100000:1.0:1746143769.036387:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594382080:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 101us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.036392:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9287 00000004:00080000:3.0:1746143769.036448:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093806680/2, rc 0, transno 21474840525 00000100:00100000:3.0:1746143769.036452:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594431744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.040087:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.040111:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382208 00000100:00100000:2.0:1746143769.040118:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382208 00000100:00100000:2.0:1746143769.040185:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9288 00000100:00100000:2.0:1746143769.040191:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594382208:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143769.040204:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.040217:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd730ebc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8340 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.040280:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd730ec3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.040288:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd730ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.040296:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd730ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143769.040314:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:2.0:1746143769.040318:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143769.040329:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd730ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.040346:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26800/0xe984082ccd730ebc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8340 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.040357:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd730ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8340 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.040363:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143769.040365:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143769.040368:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26c00, rc 0) 00000100:00100000:2.0:1746143769.040404:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31547:x1830963594382208:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 213us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.040409:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9288 00000100:00100000:0.0:1746143769.042097:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.042180:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382336 00000100:00100000:2.0:1746143769.042185:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382336 00000100:00100000:2.0:1746143769.042222:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13865 00000100:00100000:2.0:1746143769.042227:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594382336:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143769.042237:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.042251:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8347 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143769.042269:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a18, blocks: 0x80f 00010000:00010000:2.0:1746143769.042281:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.042283:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.042289:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.042299:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.042306:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26400, rc 0) 00000100:00100000:2.0:1746143769.042342:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594382336:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 114us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.042347:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13865 00000100:00100000:0.0:1746143769.042390:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.042402:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382464 00000100:00100000:2.0:1746143769.042405:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382464 00000100:00100000:2.0:1746143769.042420:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13866 00000100:00100000:2.0:1746143769.042425:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594382464:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143769.042432:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.042440:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a834e expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143769.042452:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a18, blocks: 0x821 00010000:00010000:2.0:1746143769.042527:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.042529:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.042533:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.042542:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 9 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.042549:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba26a00, rc 0) 00000100:00100000:2.0:1746143769.042567:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594382464:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 142us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.042572:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13866 00000100:00100000:0.0:1746143769.042980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.042998:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.043014:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382720 00000100:00100000:2.0:1746143769.043017:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382720 00000100:00100000:0.0:1746143769.043019:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.043037:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.043041:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382976 00000100:00100000:2.0:1746143769.043043:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382976 00000100:00100000:0.0:1746143769.043049:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382592 00000100:00100000:0.0:1746143769.043052:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382592 00000100:00100000:2.0:1746143769.043053:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594382848 00000100:00100000:2.0:1746143769.043054:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594382848 00000100:00100000:2.0:1746143769.043063:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13867 00000100:00100000:2.0:1746143769.043067:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594382720:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:0.0:1746143769.043067:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13868 00000100:00100000:0.0:1746143769.043070:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594382976:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143769.043073:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.043075:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.043081:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a835c expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.043081:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a836a expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143769.043091:0:8496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a18, blocks: 0x81f 00002000:00010000:0.0:1746143769.043091:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a18, blocks: 0x102b 00010000:00010000:2.0:1746143769.043097:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.043097:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.043099:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.043099:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.043103:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.043103:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.043111:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 11 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.043111:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.043118:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba27800, rc 0) 00010000:00010000:0.0:1746143769.043118:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095386000, rc 0) 00000100:00100000:0.0:1746143769.043134:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594382976:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 63us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.043170:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13868 00000100:00100000:3.0:1746143769.043174:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13869 00000100:00100000:0.0:1746143769.043179:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13870 00000100:00100000:3.0:1746143769.043180:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594382848:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:0.0:1746143769.043183:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594382592:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143769.043186:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.043186:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.043193:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8355 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.043197:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8363 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143769.043201:0:8497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a18, blocks: 0x81f 00010000:00010000:0.0:1746143769.043208:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.043209:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143769.043210:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a18, blocks: 0x14a9 00010000:00010000:0.0:1746143769.043212:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.043215:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.043216:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.043219:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.043219:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.043225:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095386600, rc 0) 00010000:00010000:3.0:1746143769.043227:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.043232:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e1200, rc 0) 00000100:00100000:2.0:1746143769.043275:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594382720:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 206us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.043280:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13867 00000100:00100000:3.0:1746143769.043362:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594382848:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 183us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.043362:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594382592:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 178us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.043366:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13869 00000100:00100000:0.0:1746143769.043372:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13870 00000100:00100000:0.0:1746143769.048818:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.048855:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.048876:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594383232 00000100:00100000:2.0:1746143769.048883:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594383232 00000100:00100000:2.0:1746143769.048930:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594383488 00000100:00100000:2.0:1746143769.048932:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594383488 00000100:00100000:2.0:1746143769.048948:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6548 00000100:00100000:2.0:1746143769.048954:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594383232:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143769.048980:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.048991:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.048992:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.048996:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.049012:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.049198:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6549 00000100:00100000:1.0:1746143769.049206:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594383488:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143769.049221:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.049231:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.049232:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.049235:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.049241:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.054311:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.054342:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594383744 00000100:00100000:2.0:1746143769.054349:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594383744 00000100:00100000:2.0:1746143769.054410:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6550 00000100:00100000:2.0:1746143769.054418:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594383744:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143769.054447:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.054460:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.054462:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.054466:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.054476:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.055290:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.055529:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594384000 00000100:00100000:3.0:1746143769.055539:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594384000 00000100:00100000:3.0:1746143769.055590:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6551 00000100:00100000:3.0:1746143769.055597:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594384000:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143769.055628:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.055640:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.055642:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.055646:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.055657:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.056971:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.057050:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594384256 00000100:00100000:1.0:1746143769.057056:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594384256 00000100:00100000:1.0:1746143769.057168:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6552 00000100:00100000:1.0:1746143769.057175:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594384256:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143769.057200:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.057211:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.057212:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.057216:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.057226:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.057598:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.057614:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.057665:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594384512 00000100:00100000:0.0:1746143769.057669:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594384512 00000100:00100000:0.0:1746143769.057694:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594384768 00000100:00100000:0.0:1746143769.057696:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594384768 00000100:00100000:0.0:1746143769.057738:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6553 00000100:00100000:0.0:1746143769.057743:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594384512:12345-192.168.202.48@tcp:3:lfs.0 00000100:00100000:2.0:1746143769.057751:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6554 00000100:00100000:2.0:1746143769.057759:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1964:x1830963594384768:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143769.057761:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.057768:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.057769:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.057772:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.057773:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.057780:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.057780:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.057781:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.057783:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.057797:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.059322:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.059332:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.059339:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.059344:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ba27400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143769.059347:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.059353:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.059366:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.059371:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27400/0xe984082ccd730ef4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.059425:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594383232:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 10469us (10612us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.059432:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6548 00000100:00100000:0.0:1746143769.063985:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.064257:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594385024 00000100:00100000:3.0:1746143769.064265:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594385024 00000100:00100000:3.0:1746143769.064307:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6555 00000100:00100000:3.0:1746143769.064313:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:1964:x1830963594385024:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143769.064338:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.064349:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.064351:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.064356:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.064367:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.064587:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.064597:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.064609:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.064614:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a717200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143769.064617:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.064634:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.064647:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.064648:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.064653:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a717200/0xe984082ccd730efb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.064658:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.064664:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.064668:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095197e00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143769.064671:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.064677:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.064687:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.064693:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095197e00/0xe984082ccd730f02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.064717:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594383488:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 15512us (15860us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.064724:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6549 00000100:00100000:2.0:1746143769.064742:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594383744:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 10324us (10439us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.064751:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6550 00010000:00010000:3.0:1746143769.066385:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.066395:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.066401:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.066405:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d8600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143769.066408:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.066413:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.066428:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.066433:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941d8600/0xe984082ccd730f09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.066489:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594384000:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 10890us (11199us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.066495:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6551 00010000:00010000:2.0:1746143769.069172:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.069183:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.069189:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.069194:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cab9200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143769.069197:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.069203:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.069218:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.069223:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cab9200/0xe984082ccd730f17 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.069288:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594384512:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 11540us (11685us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.069296:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6553 00010000:00010000:1.0:1746143769.071511:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.071524:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.071531:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.071538:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a717000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143769.071542:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.071548:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.071562:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.071568:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a717000/0xe984082ccd730f10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.071645:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594384256:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 14467us (14674us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.071654:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6552 00010000:00010000:2.0:1746143769.072751:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.072761:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.072766:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.072771:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6de000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143769.072773:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.072785:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.072795:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.072801:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6de000/0xe984082ccd730f1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.072851:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594384768:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 15090us (15232us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.072857:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6554 00010000:00010000:3.0:1746143769.074375:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.074385:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.074391:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.074395:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091339a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143769.074398:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.074403:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.074414:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.074424:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091339a00/0xe984082ccd730f25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.074482:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594385024:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 10165us (10501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.074490:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6555 00000100:00100000:0.0:1746143769.078757:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.079052:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594385280 00000100:00100000:2.0:1746143769.079060:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594385280 00000100:00100000:2.0:1746143769.079112:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9289 00000100:00100000:2.0:1746143769.079118:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31547:x1830963594385280:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:2.0:1746143769.079232:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.079253:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba26c00/0xe984082ccd730ec3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8340 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.079551:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143769.079555:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143769.079588:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.079599:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.079607:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00010000:2.0:1746143769.079743:0:14762:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a5c20000 reply state ffff880130a58000 transno 8589943635 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143769.079748:0:14762:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143769.080019:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31547:x1830963594385280:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 899us (1265us total) trans 8589943635 rc 0/0 00000100:00100000:2.0:1746143769.080026:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9289 00010000:00010000:3.0:1746143769.081814:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.081822:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.081828:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.081832:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f9d1a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143769.081836:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.081841:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.081852:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143769.081854:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143769.081857:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.081934:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f9d1a00/0xe984082ccd730f2c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143769.082806:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.082904:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.082931:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.082943:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.082954:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.082970:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.083032:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594385408 00000100:00100000:3.0:1746143769.083039:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594385408 00000100:00100000:3.0:1746143769.083067:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594385664 00000100:00100000:3.0:1746143769.083075:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594385664 00000100:00100000:3.0:1746143769.083086:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594385920 00000100:00100000:3.0:1746143769.083088:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594385920 00000100:00100000:0.0:1746143769.083093:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594385536 00000100:00100000:0.0:1746143769.083096:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594385536 00000100:00100000:3.0:1746143769.083098:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594385792 00000100:00100000:3.0:1746143769.083099:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594385792 00000100:00100000:3.0:1746143769.083107:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594386048 00000100:00100000:3.0:1746143769.083108:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594386048 00000100:00100000:0.0:1746143769.083114:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13871 00000100:00100000:0.0:1746143769.083119:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594385408:12345-192.168.202.48@tcp:2:lfs.0 00000100:00100000:3.0:1746143769.083265:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13872 00000100:00100000:3.0:1746143769.083270:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594385664:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:0.0:1746143769.083279:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143769.083282:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083284:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083285:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083287:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:0.0:1746143769.083318:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594385408:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 198us (515us total) trans 21474840526 rc 0/0 00000100:00100000:0.0:1746143769.083323:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13871 00000100:00100000:0.0:1746143769.083346:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13873 00002000:00010000:3.0:1746143769.083349:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143769.083350:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594385920:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143769.083351:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083353:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083355:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083356:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143769.083372:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594385664:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 102us (468us total) trans 17179873199 rc 0/0 00000100:00100000:3.0:1746143769.083377:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13872 00000100:00100000:3.0:1746143769.083388:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13874 00000100:00100000:3.0:1746143769.083392:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594385792:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:0.0:1746143769.083402:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:0.0:1746143769.083404:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083406:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083407:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083409:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:0.0:1746143769.083423:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594385920:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 73us (492us total) trans 21474840527 rc 0/0 00000100:00100000:0.0:1746143769.083429:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13873 00002000:00010000:3.0:1746143769.083438:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143769.083440:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13875 00002000:00010000:3.0:1746143769.083441:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083443:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00000100:00100000:0.0:1746143769.083444:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594385536:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143769.083445:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083446:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746143769.083460:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594385792:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 68us (505us total) trans 21474840528 rc 0/0 00000100:00100000:3.0:1746143769.083465:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13874 00000100:00100000:3.0:1746143769.083474:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13876 00000100:00100000:3.0:1746143769.083477:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594386048:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:0.0:1746143769.083499:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143769.083501:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083502:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083504:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.083505:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143769.083520:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594385536:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 76us (576us total) trans 17179873200 rc 0/0 00000100:00100000:0.0:1746143769.083525:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13875 00002000:00010000:3.0:1746143769.083536:0:4582:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143769.083538:0:4582:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083540:0:4582:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083541:0:4582:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.083542:0:4582:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:3.0:1746143769.083556:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594386048:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 79us (586us total) trans 17179873201 rc 0/0 00000100:00100000:3.0:1746143769.083723:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13876 00000100:00100000:0.0:1746143769.084468:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.084524:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594386304 00000100:00100000:3.0:1746143769.084527:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594386304 00000100:00100000:3.0:1746143769.084561:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4010 00000100:00100000:3.0:1746143769.084567:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31547:x1830963594386304:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:3.0:1746143769.084605:0:28880:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2d9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652b000/0xe984082ccd730e76 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8332 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.084637:0:28880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143769.084646:0:28880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.084651:0:28880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143769.084677:0:28880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.084687:0:28880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 9 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.084698:0:28880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:28880:1830963594431872:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.085127:0:28880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a97240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.085641:0:28880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093805c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:28880:1830963594431872:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.085654:0:28880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000100:00100000:0.0:1746143769.086068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.086231:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594386432 00000100:00100000:3.0:1746143769.086235:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594386432 00010000:00010000:3.0:1746143769.086253:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 10 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.086282:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7436 00000100:00100000:3.0:1746143769.086287:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1964:x1830963594386432:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.086295:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.086300:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 10 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.086312:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 10 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.086324:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717a00/0xe984082ccd730eb5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8339 expref: 10 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.086337:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143769.086340:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143769.086347:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143769.086352:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143769.086373:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.086408:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094761c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594386432:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 120us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.086414:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7436 00010000:00010000:2.0:1746143769.086414:0:28880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00010000:00010000:2.0:1746143769.086422:0:28880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000040:00080000:2.0:1746143769.086937:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2750, 88 off232544 00000004:00080000:2.0:1746143769.086943:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848096802912ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.086987:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2759, 88 off233512 00000004:00080000:2.0:1746143769.086992:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848096852167ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.087016:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2760, 88 off233600 00000004:00080000:2.0:1746143769.087020:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848096879947ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.087028:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2751, 88 off232632 00000004:00080000:2.0:1746143769.087030:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848096890490ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087038:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2752, 88 off232720 00000004:00080000:2.0:1746143769.087041:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848096901210ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087048:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2761, 88 off233688 00000004:00080000:2.0:1746143769.087050:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848096910180ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.087058:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2762, 88 off233776 00000004:00080000:2.0:1746143769.087060:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848096920738ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.087068:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2763, 88 off233864 00000004:00080000:2.0:1746143769.087070:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848096930697ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.087078:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2753, 88 off232808 00000004:00080000:2.0:1746143769.087081:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848096941025ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087087:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2764, 88 off233952 00000004:00080000:2.0:1746143769.087089:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848096949380ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.087096:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2754, 88 off232896 00000004:00080000:2.0:1746143769.087099:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848096959382ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087107:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2765, 88 off234040 00000004:00080000:2.0:1746143769.087109:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848096969573ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143769.087115:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2755, 88 off232984 00000004:00080000:2.0:1746143769.087117:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848096977700ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087135:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2756, 88 off233072 00000004:00080000:2.0:1746143769.087175:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848097035097ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087187:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2757, 88 off233160 00000004:00080000:2.0:1746143769.087190:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848097050565ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087199:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2758, 88 off233248 00000004:00080000:2.0:1746143769.087201:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848097061287ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143769.087209:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2766, 88 off234128 00000004:00080000:2.0:1746143769.087212:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848097072135ns, next at 833304778357ns, rc = 0 00000001:00080000:0.0:1746143769.102832:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943636 is committed 00000004:00080000:0.0:1746143769.102840:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2101 committed 00000004:00080000:0.0:1746143769.102849:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2093 committed 00000004:00080000:0.0:1746143769.102854:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2092 committed 00000004:00080000:0.0:1746143769.102855:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2091 committed 00000004:00080000:0.0:1746143769.102857:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2090 committed 00000004:00080000:0.0:1746143769.102858:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2100 committed 00000004:00080000:0.0:1746143769.102860:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2089 committed 00000004:00080000:0.0:1746143769.102861:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2099 committed 00000004:00080000:0.0:1746143769.102862:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2088 committed 00000004:00080000:0.0:1746143769.102864:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2098 committed 00000004:00080000:0.0:1746143769.102865:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2097 committed 00000004:00080000:0.0:1746143769.102866:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2096 committed 00000004:00080000:0.0:1746143769.102868:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2087 committed 00000004:00080000:0.0:1746143769.102869:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2086 committed 00000004:00080000:0.0:1746143769.102870:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2095 committed 00000004:00080000:0.0:1746143769.102871:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2094 committed 00000004:00080000:0.0:1746143769.102873:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2085 committed 00000004:00010000:3.0:1746143769.102888:0:28880:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094763b80 reply state ffff8800a6503000 transno 8589943636 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000100:00100000:3.0:1746143769.102899:0:28880:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746143769.102905:0:28880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:3.0:1746143769.102908:0:28880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143769.102915:0:28880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a652b000/0xe984082ccd730e76 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8332 expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.102991:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594432000:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746143769.102998:0:28880:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143769.103006:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31547:x1830963594386304:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 18440us (18538us total) trans 8589943636 rc 0/0 00000100:00100000:3.0:1746143769.103015:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4010 00000100:00100000:0.0:1746143769.103029:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.103036:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594432384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.103047:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594432512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.103053:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143769.103060:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594432128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.103067:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594432896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.103072:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.103083:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432000 00000100:00100000:0.0:1746143769.103084:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594432640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.103088:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432000 00000100:00100000:0.0:1746143769.103094:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.103108:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432384 00000100:00100000:3.0:1746143769.103110:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432384 00000100:00100000:3.0:1746143769.103119:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432128 00000100:00100000:3.0:1746143769.103120:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432128 00000100:00100000:3.0:1746143769.103127:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432640 00000100:00100000:3.0:1746143769.103129:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432640 00000100:00100000:3.0:1746143769.103169:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13877 00000100:00100000:3.0:1746143769.103176:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3292:x1830963594432000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143769.103320:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143769.103322:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.103324:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.103326:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.103328:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143769.103348:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3292:x1830963594432000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (319us total) trans 17179873202 rc 0/0 00000100:00100000:3.0:1746143769.103353:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13877 00000100:00100000:0.0:1746143769.103362:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13878 00000100:00100000:0.0:1746143769.103367:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3295:x1830963594432384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.103370:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13879 00000100:00100000:3.0:1746143769.103374:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963594432128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.103392:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13880 00000100:00100000:3.0:1746143769.103396:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3293:x1830963594432640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143769.103436:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143769.103439:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143769.103441:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143769.103443:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143769.103444:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143769.103459:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3295:x1830963594432384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (405us total) trans 17179873203 rc 0/0 00000100:00100000:0.0:1746143769.103464:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13878 00000100:00100000:3.0:1746143769.103474:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3293:x1830963594432640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (379us total) trans 17179873204 rc 0/0 00000004:00080000:1.0:1746143769.103506:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136918380/2, rc 0, transno 17179873204 00000100:00100000:1.0:1746143769.103511:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594432640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.103616:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143769.103623:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.103643:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.103658:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.103659:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594432256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.103670:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143769.103681:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28880 initiator: MDT0 00000100:00100000:1.0:1746143769.103681:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433664:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143769.103689:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28880 initiator: MDT0 00000100:00100000:1.0:1746143769.103692:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143769.103695:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28880 initiator: MDT0 00010000:00010000:2.0:1746143769.103701:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d4200 already unused, calling callback (ffffffffa1387690) 00000100:00100000:1.0:1746143769.103701:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1746143769.103704:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28880 initiator: MDT0 00000100:00100000:1.0:1746143769.103705:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433536:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143769.103710:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28880 initiator: MDT0 00000100:00100000:1.0:1746143769.103715:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143769.103721:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff880093484f00) 00010000:00010000:2.0:1746143769.103723:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143769.103726:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28880 initiator: MDT0 00010000:00010000:2.0:1746143769.103730:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4200/0xe984082ccd730f33 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28880 initiator: MDT0 00000100:00100000:1.0:1746143769.103730:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433024 00000100:00100000:1.0:1746143769.103732:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433024 00000100:00100000:2.0:1746143769.103749:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433152 00000100:00100000:2.0:1746143769.103752:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433152 00000100:00100000:0.0:1746143769.103772:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433664 00000100:00100000:0.0:1746143769.103775:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433664 00000100:00100000:3.0:1746143769.104415:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13880 00000100:00100000:1.0:1746143769.104423:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433536 00000100:00100000:1.0:1746143769.104426:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433536 00000100:00100000:3.0:1746143769.104427:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13881 00000100:00100000:3.0:1746143769.104432:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963594433024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.104437:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13882 00000100:00100000:1.0:1746143769.104440:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3293:x1830963594433536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.104478:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.104497:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594433408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.104513:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.104522:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594433920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.104533:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143769.104547:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136919180/2, rc 0, transno 17179873203 00000100:00100000:1.0:1746143769.104548:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3293:x1830963594433536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (832us total) trans 21474840529 rc 0/0 00000100:00100000:3.0:1746143769.104551:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594432384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.104553:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13882 00000100:00100000:1.0:1746143769.104560:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432896 00000100:00100000:3.0:1746143769.104563:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433408 00000100:00100000:1.0:1746143769.104563:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432896 00000100:00100000:3.0:1746143769.104564:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433408 00000100:00100000:1.0:1746143769.104571:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433920 00000100:00100000:1.0:1746143769.104573:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433920 00000100:00100000:3.0:1746143769.104575:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13883 00000100:00100000:3.0:1746143769.104579:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3295:x1830963594432896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.104581:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13884 00000100:00100000:1.0:1746143769.104584:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3295:x1830963594433408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.104654:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3295:x1830963594433408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (138us total) trans 21474840530 rc 0/0 00000100:00100000:1.0:1746143769.104659:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13884 00000100:00100000:1.0:1746143769.104667:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13885 00000100:00100000:1.0:1746143769.104671:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3295:x1830963594433920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.104672:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13886 00000100:00100000:2.0:1746143769.104677:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3293:x1830963594433152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143769.104754:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143769.104757:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143769.104759:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143769.104760:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143769.104762:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746143769.104782:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3293:x1830963594433152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (1111us total) trans 21474840531 rc 0/0 00000100:00100000:2.0:1746143769.104787:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13886 00000100:00100000:2.0:1746143769.104804:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.104819:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594432768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.104834:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.104844:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594433280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.104855:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.104862:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594433792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.104871:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.104885:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432256 00000100:00100000:2.0:1746143769.104887:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432256 00000100:00100000:2.0:1746143769.104896:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432768 00000100:00100000:2.0:1746143769.104898:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432768 00000100:00100000:2.0:1746143769.104902:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433280 00000100:00100000:2.0:1746143769.104904:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433280 00000100:00100000:0.0:1746143769.104904:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433792 00000100:00100000:0.0:1746143769.104907:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433792 00000100:00100000:2.0:1746143769.104911:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13887 00000100:00100000:2.0:1746143769.104914:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3294:x1830963594432256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.104915:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13888 00000100:00100000:0.0:1746143769.104918:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3293:x1830963594433664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143769.104980:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143769.104982:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143769.104984:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143769.104986:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00000100:00100000:0.0:1746143769.104986:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3293:x1830963594433664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1292us total) trans 21474840532 rc 0/0 00002000:00010000:2.0:1746143769.104988:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746143769.104991:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13888 00000100:00100000:0.0:1746143769.105000:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13889 00000100:00100000:0.0:1746143769.105004:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963594432768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.105005:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963594432256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (200us total) trans 17179873206 rc 0/0 00000100:00100000:2.0:1746143769.105009:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13887 00000100:00100000:2.0:1746143769.105016:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13890 00000100:00100000:2.0:1746143769.105020:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3294:x1830963594433280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.105071:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3294:x1830963594432768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (235us total) trans 17179873207 rc 0/0 00002000:00010000:2.0:1746143769.105074:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:2.0:1746143769.105076:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00000100:00100000:0.0:1746143769.105076:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13889 00002000:00010000:2.0:1746143769.105078:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143769.105080:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143769.105081:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:0.0:1746143769.105083:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13891 00000100:00100000:0.0:1746143769.105087:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594433792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.105095:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594433280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (239us total) trans 21474840533 rc 0/0 00000100:00100000:2.0:1746143769.105099:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13890 00000004:00080000:2.0:1746143769.105118:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ec380/2, rc 0, transno 17179873206 00000100:00100000:2.0:1746143769.105122:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594432256:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143769.105128:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691bb80/2, rc 0, transno 17179873207 00000100:00100000:2.0:1746143769.105130:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594432768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143769.105136:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c10380/2, rc 0, transno 21474840533 00000100:00100000:2.0:1746143769.105168:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594433280:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.105177:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c13100/2, rc 0, transno 21474840534 00000100:00100000:0.0:1746143769.105177:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3294:x1830963594433792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (304us total) trans 21474840534 rc 0/0 00000100:00100000:2.0:1746143769.105180:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594433792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.105182:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13891 00000100:00100000:0.0:1746143769.105225:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143769.105245:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094762a00/2, rc 0, transno 17179873202 00000100:00100000:0.0:1746143769.105249:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594432000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.105257:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432512 00000100:00100000:0.0:1746143769.105259:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432512 00000100:00100000:0.0:1746143769.105271:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13892 00000100:00100000:0.0:1746143769.105274:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3292:x1830963594432512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.105300:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594434048:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.105318:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.105335:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594434048 00000100:00100000:2.0:1746143769.105337:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594434048 00000100:00100000:2.0:1746143769.105347:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13893 00000100:00100000:0.0:1746143769.105347:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3292:x1830963594432512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (120us total) trans 17179873208 rc 0/0 00000100:00100000:2.0:1746143769.105350:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594434048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.105352:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13892 00000100:00100000:2.0:1746143769.105425:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3292:x1830963594434048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (105us total) trans 21474840535 rc 0/0 00000100:00100000:2.0:1746143769.105430:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13893 00000004:00080000:2.0:1746143769.105448:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f533b80/2, rc 0, transno 21474840535 00000100:00100000:2.0:1746143769.105451:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594434048:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.105457:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136918e00/2, rc 0, transno 17179873208 00000100:00100000:2.0:1746143769.105459:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594432512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.105652:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3295:x1830963594433920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 979us (1116us total) trans 21474840536 rc 0/0 00000100:00100000:1.0:1746143769.105657:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13885 00000100:00100000:3.0:1746143769.105664:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3295:x1830963594432896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1085us (1185us total) trans 17179873205 rc 0/0 00000100:00100000:3.0:1746143769.105669:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13883 00000004:00080000:3.0:1746143769.105689:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c11c00/2, rc 0, transno 21474840530 00000100:00100000:3.0:1746143769.105692:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594433408:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143769.105697:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531f80/2, rc 0, transno 21474840536 00000100:00100000:3.0:1746143769.105699:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594433920:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143769.105705:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691b100/2, rc 0, transno 17179873205 00000100:00100000:3.0:1746143769.105707:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594432896:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143769.105769:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143769.105771:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.105773:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.105775:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:3.0:1746143769.105777:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:1.0:1746143769.105780:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143769.105782:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.105784:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.105786:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.105787:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:3.0:1746143769.105796:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3293:x1830963594432128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2421us (2723us total) trans 17179873209 rc 0/0 00000100:00100000:3.0:1746143769.105801:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13879 00000100:00100000:1.0:1746143769.105801:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3293:x1830963594433024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1370us (2157us total) trans 21474840537 rc 0/0 00000100:00100000:1.0:1746143769.105805:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13881 00000004:00080000:1.0:1746143769.105823:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c10000/2, rc 0, transno 21474840529 00000100:00100000:1.0:1746143769.105826:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433536:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.105831:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c11f80/2, rc 0, transno 21474840531 00000100:00100000:1.0:1746143769.105833:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.105838:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c13800/2, rc 0, transno 21474840532 00000100:00100000:1.0:1746143769.105840:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.105845:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c11180/2, rc 0, transno 21474840537 00000100:00100000:1.0:1746143769.105847:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594433024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143769.105853:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f1ee680/2, rc 0, transno 17179873209 00000100:00100000:1.0:1746143769.105861:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594432128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.106230:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.106246:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594386560 00000100:00100000:2.0:1746143769.106249:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594386560 00000100:00100000:2.0:1746143769.106267:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9290 00000100:00100000:2.0:1746143769.106271:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31547:x1830963594386560:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143769.106281:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.106293:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8371 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.106331:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.106341:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.106357:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.106359:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143769.106362:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4277400, rc 0) 00000100:00100000:2.0:1746143769.106393:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31547:x1830963594386560:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 122us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.106398:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9290 00000100:00100000:0.0:1746143769.109044:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.109119:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594386816 00000100:00100000:3.0:1746143769.109125:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594386816 00000100:00100000:3.0:1746143769.109267:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4011 00000100:00100000:3.0:1746143769.109275:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31547:x1830963594386816:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143769.109532:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31547:x1830963594386816:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 257us (492us total) trans 8589943637 rc 0/0 00000100:00100000:3.0:1746143769.109538:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4011 00000100:00100000:0.0:1746143769.124869:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.124958:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594387072 00000100:00100000:2.0:1746143769.124965:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594387072 00000100:00100000:2.0:1746143769.125000:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9291 00000100:00100000:2.0:1746143769.125006:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:31554:x1830963594387072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.125024:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.125038:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4276800/0xe984082ccd730f41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8378 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.125211:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125222:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125230:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125241:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125246:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125251:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125678:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125685:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125692:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143769.125699:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143769.125767:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125773:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125778:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125783:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a61cb600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.125786:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125791:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125800:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143769.125802:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.125805:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125810:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cb600/0xe984082ccd730f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125845:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125850:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125855:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125858:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a61caa00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.125860:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125865:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125870:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5c04400) 00010000:00010000:2.0:1746143769.125872:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.125873:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125877:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61caa00/0xe984082ccd730f4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.125911:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4276800/0xe984082ccd730f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.125922:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 8 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.125927:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.125929:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143769.125931:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffbe00, rc 0) 00000100:00100000:2.0:1746143769.126958:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31554:x1830963594387072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1948us (2095us total) trans 8589943638 rc 0/0 00000100:00100000:2.0:1746143769.126965:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9291 00000100:00100000:0.0:1746143769.129877:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.129945:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.130018:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594387456 00000100:00100000:1.0:1746143769.130026:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594387456 00000100:00100000:1.0:1746143769.130071:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13894 00000100:00100000:3.0:1746143769.130074:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594387328 00000100:00100000:3.0:1746143769.130078:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594387328 00000100:00100000:1.0:1746143769.130078:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31554:x1830963594387456:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.130092:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143769.130100:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9292 00000100:00100000:3.0:1746143769.130105:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31551:x1830963594387328:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.130105:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8386 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.130115:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.130123:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd730f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a837f expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.130123:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.130126:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.130132:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.130175:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 12 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.130184:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a716600, rc 0) 00000100:00100000:1.0:1746143769.130219:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31554:x1830963594387456:12345-192.168.202.48@tcp:101:cat.0 Request processed in 142us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.130225:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13894 00010000:00010000:3.0:1746143769.130384:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143769.130396:0:16090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.130402:0:16090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:3.0:1746143769.130426:0:16090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.130437:0:16090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 9 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.130447:0:16090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594434176:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.130505:0:16090:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d25c900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.131334:0:16090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093804700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1830963594434176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.131348:0:16090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143769.131489:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.132454:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594387584 00000100:00100000:1.0:1746143769.132459:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594387584 00010000:00010000:1.0:1746143769.132477:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 10 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.132507:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7437 00000100:00100000:1.0:1746143769.132513:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594387584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.132520:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.132525:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 10 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.132534:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 10 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.132548:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f56 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8378 expref: 10 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.132564:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.132568:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143769.132574:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143769.132579:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16090 initiator: MDT0 00010000:00010000:1.0:1746143769.132601:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.132627:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1964:x1830963594387584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 110us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.132633:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7437 00000100:00100000:1.0:1746143769.132716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143769.132773:0:16090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.132779:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143769.132792:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143769.132895:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd730f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.132921:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 9 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.132926:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.132929:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143769.132931:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7e00, rc 0) 00000100:00100000:3.0:1746143769.132990:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594387840 00000100:00100000:3.0:1746143769.132994:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594387840 00002000:00100000:3.0:1746143769.133018:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a5d81c00 x1830963594387840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.133027:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81c00 with x1830963594387840 ext(0->1048575) 00002000:00010000:3.0:1746143769.133031:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81c00 00000100:00100000:3.0:1746143769.133042:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6556 00000100:00100000:3.0:1746143769.133047:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594387840:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.133300:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31551:x1830963594387328:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3193us (3427us total) trans 8589943639 rc 0/0 00000100:00100000:2.0:1746143769.133305:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9292 00000100:00100000:2.0:1746143769.146667:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594387840:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13612us (13944us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.146677:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6556 00002000:00100000:2.0:1746143769.146687:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a5d81c00 x1830963594387840/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.146697:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81c00 with x1830963594387840 ext(0->1048575) 00002000:00010000:2.0:1746143769.146702:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81c00 00000100:00100000:1.0:1746143769.153075:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.153960:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594387968 00000100:00100000:0.0:1746143769.153969:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594387968 00000100:00100000:0.0:1746143769.154017:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13895 00000100:00100000:0.0:1746143769.154023:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31554:x1830963594387968:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143769.154037:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.154051:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a838d expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.154071:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.154072:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.154079:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.154091:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.154101:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a717600, rc 0) 00000100:00100000:0.0:1746143769.154190:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31554:x1830963594387968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 167us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.154196:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13895 00000100:00100000:0.0:1746143769.159606:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.159672:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594388096 00000100:00100000:2.0:1746143769.159678:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594388096 00000100:00100000:2.0:1746143769.159727:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9293 00000100:00100000:2.0:1746143769.159734:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31554:x1830963594388096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.159753:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.159767:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffaa00/0xe984082ccd730f87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8394 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.159814:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffaa00/0xe984082ccd730f87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8394 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.159825:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffaa00/0xe984082ccd730f87 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8394 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.159840:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.159843:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143769.159845:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fffaa00, rc 0) 00000100:00100000:2.0:1746143769.159892:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31554:x1830963594388096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 157us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.159898:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9293 00000100:00100000:3.0:1746143769.168468:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.168522:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594388352 00000100:00100000:0.0:1746143769.168529:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594388352 00002000:00100000:0.0:1746143769.168566:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093804700 x1830963594388352/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.168575:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963594388352 ext(1048576->2097151) 00002000:00010000:0.0:1746143769.168579:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:0.0:1746143769.169462:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6557 00000100:00100000:0.0:1746143769.169471:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594388352:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.175518:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.175615:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594388608 00000100:00100000:2.0:1746143769.175621:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594388608 00000100:00100000:2.0:1746143769.175663:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9294 00000100:00100000:2.0:1746143769.175670:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31557:x1830963594388608:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143769.175692:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.175706:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffba00/0xe984082ccd730f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a839b expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.175791:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175801:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175810:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175821:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175827:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175837:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175924:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175931:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.175937:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143769.175944:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143769.176013:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176023:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176028:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176033:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fffbe00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.176037:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176042:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176050:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143769.176053:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.176055:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176060:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffbe00/0xe984082ccd730f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176075:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176079:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176084:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176088:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800938ba400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.176090:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176097:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176102:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5c04000) 00010000:00010000:2.0:1746143769.176104:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.176106:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176110:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd730f9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.176172:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffba00/0xe984082ccd730f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.176184:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 242 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.176190:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.176192:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143769.176195:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095070e00, rc 0) 00000100:00100000:2.0:1746143769.178477:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31557:x1830963594388608:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2800us (2959us total) trans 8589943640 rc 0/0 00000100:00100000:2.0:1746143769.178485:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9294 00000100:00100000:1.0:1746143769.179284:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1962:x1830963594388352:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9814us (10822us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.179291:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6557 00002000:00100000:1.0:1746143769.179299:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093804700 x1830963594388352/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.179307:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804700 with x1830963594388352 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.179311:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093804700 00000100:00100000:0.0:1746143769.181911:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.182114:0:16090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594388864 00000100:00100000:2.0:1746143769.182122:0:16090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594388864 00000100:00100000:2.0:1746143769.182202:0:16090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9295 00000100:00100000:2.0:1746143769.182209:0:16090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31559:x1830963594388864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.182227:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.182241:0:16090:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095133c00/0xe984082ccd730fb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83a2 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.182332:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00000100:00100000:0.0:1746143769.182664:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.182730:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.182776:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594389248 00000100:00100000:1.0:1746143769.182780:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594389248 00000100:00100000:1.0:1746143769.182801:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9296 00000100:00100000:1.0:1746143769.182806:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31551:x1830963594389248:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.182814:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.182815:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143769.182832:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fffaa00/0xe984082ccd730f87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8394 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.182848:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.182852:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143769.182859:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ae00/0xe984082ccd730fbf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83b0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.182885:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.182893:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.182900:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.182906:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.182926:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.182936:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.182946:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594434304:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143769.183330:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183340:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183353:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183358:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183362:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183452:0:16090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183459:0:16090:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183464:0:16090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 00000004:00200000:2.0:1746143769.183471:0:16090:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143769.183540:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183546:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183551:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183556:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a61cde00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.183559:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183564:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183570:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.183572:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1746143769.183575:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183579:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61cde00/0xe984082ccd730fd4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183587:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183592:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183596:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183599:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095132800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.183602:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183606:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183615:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143769.183618:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.183620:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183624:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095132800/0xe984082ccd730fb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183631:0:16090:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183636:0:16090:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183640:0:16090:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183644:0:16090:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095133a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.183646:0:16090:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183651:0:16090:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183656:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5c04400) 00010000:00010000:2.0:1746143769.183658:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.183660:0:16090:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183664:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095133a00/0xe984082ccd730fcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 00010000:00010000:2.0:1746143769.183692:0:16090:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095133c00/0xe984082ccd730fb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a2 expref: 244 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.183699:0:16090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095133c00/0xe984082ccd730fb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a2 expref: 244 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.183705:0:16090:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095133c00, rc 0) 00010000:00010000:1.0:1746143769.183785:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.183827:0:16090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31559:x1830963594388864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1617us (1920us total) trans 8589943641 rc 301/301 00000100:00100000:2.0:1746143769.183834:0:16090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9295 00000100:00100000:2.0:1746143769.183868:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594388992 00000100:00100000:2.0:1746143769.183872:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594388992 00010000:00010000:1.0:1746143769.183983:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 7 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.183989:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13896 00000100:00100000:2.0:1746143769.183995:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31554:x1830963594388992:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143769.183995:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594434432:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143769.184003:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.184011:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83a9 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.184019:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7839c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143769.184027:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.184029:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.184034:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.184043:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 10 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.184050:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61cc800, rc 0) 00000100:00100000:2.0:1746143769.184066:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31554:x1830963594388992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 72us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.184074:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13896 00000100:00100000:1.0:1746143769.185818:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594434304:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143769.185826:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594434432:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143769.185843:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143769.186099:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.186330:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594389376 00000100:00100000:3.0:1746143769.186338:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594389376 00010000:00010000:3.0:1746143769.186376:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.186424:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7438 00000100:00100000:3.0:1746143769.186432:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1965:x1830963594389376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.186443:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.186448:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.186456:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.186472:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095070e00/0xe984082ccd730fa3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a839b expref: 243 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.186485:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.186489:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.186494:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.186499:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.186524:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1965:x1830963594389376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.186524:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.186529:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7438 00000100:00100000:1.0:1746143769.186543:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594389504 00000100:00100000:1.0:1746143769.186546:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594389504 00010000:00010000:1.0:1746143769.186559:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 8 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.186575:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7439 00000100:00100000:1.0:1746143769.186579:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594389504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.186584:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.186588:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 8 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746143769.186588:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143769.186595:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 8 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.186605:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4277400/0xe984082ccd730f3a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8371 expref: 8 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.186615:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.186617:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.186623:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.186629:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143769.186632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143769.186641:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.186652:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594389632 00000100:00100000:0.0:1746143769.186657:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594389632 00000100:00100000:1.0:1746143769.186658:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:1965:x1830963594389504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.186664:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7439 00010000:00010000:1.0:1746143769.186678:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.186684:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143769.186706:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594389760 00000100:00100000:0.0:1746143769.186711:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594389760 00000100:00100000:0.0:1746143769.186735:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9297 00000100:00100000:0.0:1746143769.186743:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31554:x1830963594389632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143769.186757:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.186768:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83b7 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.186805:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143769.186814:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.186827:0:2976:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143769.186838:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.186847:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:0.0:1746143769.186850:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143769.186853:0:2976:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.186858:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4de800, rc 0) 00000100:00100000:0.0:1746143769.186884:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31554:x1830963594389632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 140us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.186889:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9297 00000100:00100000:0.0:1746143769.186900:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9298 00000100:00100000:0.0:1746143769.186905:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31559:x1830963594389760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143769.186914:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.186920:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717200/0xe984082ccd730ff0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83be expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.186959:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143769.186967:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.186972:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:0.0:1746143769.186990:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 11 pid: 16090 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.187000:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 11 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746143769.187010:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc27480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594434560:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143769.187067:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d180 going to sleep for 11 seconds 00000040:00080000:1.0:1746143769.187602:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2759, 88 off233336 00000004:00080000:1.0:1746143769.187608:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197468010ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187654:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2767, 88 off234216 00000004:00080000:1.0:1746143769.187658:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197518372ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143769.187678:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2768, 88 off234304 00000004:00080000:1.0:1746143769.187681:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197541859ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143769.187693:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2760, 88 off233424 00000004:00080000:1.0:1746143769.187696:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197556292ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187704:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2761, 88 off233512 00000004:00080000:1.0:1746143769.187707:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197566977ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187712:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2769, 88 off234392 00000004:00080000:1.0:1746143769.187715:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197575312ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143769.187725:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2770, 88 off234480 00000004:00080000:1.0:1746143769.187728:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197588325ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143769.187734:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2771, 88 off234568 00000004:00080000:1.0:1746143769.187736:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197596582ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143769.187742:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2762, 88 off233600 00000004:00080000:1.0:1746143769.187744:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197604575ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187752:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2772, 88 off234656 00000004:00080000:1.0:1746143769.187754:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197614397ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143769.187760:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2763, 88 off233688 00000004:00080000:1.0:1746143769.187762:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197622515ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187768:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2773, 88 off234744 00000004:00080000:1.0:1746143769.187770:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197630592ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143769.187780:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2764, 88 off233776 00000004:00080000:1.0:1746143769.187783:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197643290ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187789:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2765, 88 off233864 00000004:00080000:1.0:1746143769.187791:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197651567ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187797:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2766, 88 off233952 00000004:00080000:1.0:1746143769.187800:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197660672ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187806:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2767, 88 off234040 00000004:00080000:1.0:1746143769.187808:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 848197668204ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143769.187813:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2774, 88 off234832 00000004:00080000:1.0:1746143769.187816:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 848197676235ns, next at 833304778357ns, rc = 0 00000100:00100000:1.0:1746143769.192362:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc27480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594434560:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143769.192382:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:1.0:1746143769.192536:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.192554:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594389888 00000100:00100000:1.0:1746143769.192558:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594389888 00010000:00010000:1.0:1746143769.192580:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 13 pid: 16090 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.192599:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7440 00000100:00100000:1.0:1746143769.192604:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594389888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.192615:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.192619:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 13 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.192627:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 13 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.192641:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0xe984082ccd730f72 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a837f expref: 13 pid: 16090 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.192655:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.192658:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143769.192664:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143769.192669:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 12 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.192677:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143769.192681:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.192708:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594389888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.192713:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7440 00010000:00010000:1.0:1746143769.209287:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.209300:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.209302:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143769.209305:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143769.209313:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00000001:00080000:0.0:1746143769.209313:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943642 is committed 00010000:00010000:1.0:1746143769.209317:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00000004:00080000:0.0:1746143769.209319:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2109 committed 00010000:00010000:1.0:1746143769.209322:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.209328:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746143769.209332:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2102 committed 00010000:00010000:1.0:1746143769.209333:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746143769.209341:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2101 committed 00000004:00080000:0.0:1746143769.209343:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2100 committed 00000004:00080000:0.0:1746143769.209346:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2099 committed 00000004:00080000:0.0:1746143769.209347:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2108 committed 00000004:00080000:0.0:1746143769.209349:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2098 committed 00000004:00080000:0.0:1746143769.209351:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2107 committed 00000004:00080000:0.0:1746143769.209353:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2097 committed 00000004:00080000:0.0:1746143769.209354:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2106 committed 00000004:00080000:0.0:1746143769.209356:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2105 committed 00000004:00080000:0.0:1746143769.209357:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2104 committed 00000004:00080000:0.0:1746143769.209359:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2096 committed 00000004:00080000:0.0:1746143769.209360:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2095 committed 00000004:00080000:0.0:1746143769.209362:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2103 committed 00000004:00080000:0.0:1746143769.209364:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2102 committed 00000004:00080000:0.0:1746143769.209365:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2094 committed 00000001:00080000:0.0:1746143769.209371:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943641 is committed 00010000:00010000:1.0:1746143769.209373:0:14762:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 11 pid: 2976 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746143769.209383:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943637 is committed 00000100:00100000:1.0:1746143769.209386:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594434688:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143769.209454:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7830c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143769.209465:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:1.0:1746143769.209478:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:1.0:1746143769.209516:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:1.0:1746143769.209520:0:2976:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1746143769.209524:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594434816:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746143769.209533:0:2976:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143769.209558:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746143769.209560:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a717200/0xe984082ccd730ff0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 242 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.209572:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 241 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.209576:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594435328:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143769.209578:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.209580:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746143769.209582:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075f200, rc 0) 00000100:00100000:3.0:1746143769.209590:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.209604:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143769.209606:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31559:x1830963594389760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 22700us (22973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.209608:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594435200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.209613:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9298 00000100:00100000:3.0:1746143769.209621:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.209632:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594435712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.209642:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.209656:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594435072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.209670:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.209679:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594435584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.209690:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.209699:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143769.209703:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594434944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.209715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.209723:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594435456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.209733:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.209827:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.209854:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.209865:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.209878:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.209888:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143769.209893:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594435840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.209905:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.209916:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.209927:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.209941:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594435968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.209954:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.209964:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594436480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.209977:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.209984:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143769.209988:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594436096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.210001:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143769.210008:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594436608:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143769.210020:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143769.210075:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594434816 00000100:00100000:1.0:1746143769.210081:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594434816 00000100:00100000:2.0:1746143769.210086:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435328 00000100:00100000:2.0:1746143769.210090:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435328 00000100:00100000:1.0:1746143769.210101:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435200 00000100:00100000:1.0:1746143769.210103:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435200 00000100:00100000:2.0:1746143769.210104:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435712 00000100:00100000:2.0:1746143769.210106:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435712 00000100:00100000:1.0:1746143769.210110:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435072 00000100:00100000:1.0:1746143769.210112:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435072 00000100:00100000:2.0:1746143769.210114:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435584 00000100:00100000:2.0:1746143769.210116:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435584 00000100:00100000:1.0:1746143769.210118:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594434944 00000100:00100000:1.0:1746143769.210119:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594434944 00000100:00100000:2.0:1746143769.210123:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435456 00000100:00100000:2.0:1746143769.210125:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435456 00000100:00100000:1.0:1746143769.210126:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436224 00000100:00100000:1.0:1746143769.210127:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436224 00000100:00100000:2.0:1746143769.210131:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436736 00000100:00100000:2.0:1746143769.210133:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436736 00000100:00100000:1.0:1746143769.210133:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435840 00000100:00100000:1.0:1746143769.210135:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435840 00000100:00100000:1.0:1746143769.210166:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436352 00000100:00100000:2.0:1746143769.210167:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435968 00000100:00100000:1.0:1746143769.210168:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436352 00000100:00100000:2.0:1746143769.210170:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435968 00000100:00100000:1.0:1746143769.210175:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436480 00000100:00100000:1.0:1746143769.210176:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436480 00000100:00100000:2.0:1746143769.210178:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436096 00000100:00100000:2.0:1746143769.210179:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436096 00000100:00100000:1.0:1746143769.210185:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13897 00000100:00100000:1.0:1746143769.210190:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3293:x1830963594434816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.210290:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436608 00000100:00100000:0.0:1746143769.210293:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436608 00002000:00010000:1.0:1746143769.210318:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143769.210320:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.210322:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.210324:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.210326:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:1.0:1746143769.210345:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594434816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (787us total) trans 21474840538 rc 0/0 00000100:00100000:2.0:1746143769.210868:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13898 00000100:00100000:2.0:1746143769.210874:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594435328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143769.210958:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:3293:x1830963594435328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1366us total) trans 21474840539 rc 0/0 00000100:00100000:2.0:1746143769.210963:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13898 00000100:00100000:2.0:1746143769.210973:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13899 00000100:00100000:2.0:1746143769.210977:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594435200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.211213:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13897 00000100:00100000:0.0:1746143769.211218:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13900 00000100:00100000:0.0:1746143769.211223:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594435712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.211229:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13901 00000100:00100000:1.0:1746143769.211235:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3295:x1830963594435072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143769.211301:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:1.0:1746143769.211303:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00000100:00100000:0.0:1746143769.211303:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3293:x1830963594435712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1659us total) trans 21474840540 rc 0/0 00002000:00010000:1.0:1746143769.211305:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.211307:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.211308:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:0.0:1746143769.211308:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13900 00000100:00100000:0.0:1746143769.211317:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13902 00000100:00100000:0.0:1746143769.211321:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3295:x1830963594435584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.211326:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3295:x1830963594435072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1655us total) trans 21474840541 rc 0/0 00000100:00100000:1.0:1746143769.211330:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13901 00000100:00100000:1.0:1746143769.211338:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13903 00000100:00100000:1.0:1746143769.211342:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3295:x1830963594434944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143769.211373:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13904 00000100:00100000:0.0:1746143769.211377:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3295:x1830963594435456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143769.211405:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143769.211407:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.211408:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.211410:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00000100:00100000:0.0:1746143769.211410:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3295:x1830963594435584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1719us total) trans 21474840542 rc 0/0 00002000:00010000:1.0:1746143769.211411:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143769.211415:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13902 00000100:00100000:0.0:1746143769.211423:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13905 00000100:00100000:1.0:1746143769.211426:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3295:x1830963594434944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1709us total) trans 21474840543 rc 0/0 00000100:00100000:0.0:1746143769.211427:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963594436224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.211430:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13903 00000100:00100000:1.0:1746143769.211437:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13906 00000100:00100000:1.0:1746143769.211441:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963594435840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143769.211513:0:12618:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143769.211515:0:12618:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.211516:0:12618:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.211518:0:12618:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:1.0:1746143769.211519:0:12618:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143769.211521:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3295:x1830963594435456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (1786us total) trans 21474840544 rc 0/0 00000100:00100000:0.0:1746143769.211526:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13904 00000100:00100000:0.0:1746143769.211535:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13907 00000100:00100000:1.0:1746143769.211537:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963594435840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1631us total) trans 17179873210 rc 0/0 00000100:00100000:0.0:1746143769.211539:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963594436736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.211544:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13906 00000100:00100000:1.0:1746143769.211551:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13908 00000100:00100000:1.0:1746143769.211555:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3292:x1830963594436352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.211612:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3292:x1830963594436736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1732us total) trans 17179873211 rc 0/0 00000100:00100000:1.0:1746143769.211615:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3292:x1830963594436352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1686us total) trans 17179873212 rc 0/0 00000100:00100000:0.0:1746143769.211616:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13907 00000100:00100000:1.0:1746143769.211620:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13908 00000100:00100000:0.0:1746143769.211625:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13909 00000100:00100000:1.0:1746143769.211628:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13910 00000100:00100000:0.0:1746143769.211630:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594435968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.211632:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594436480:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143769.211671:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531180/2, rc 0, transno 17179873210 00000100:00100000:1.0:1746143769.211676:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594435840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143769.211684:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530380/2, rc 0, transno 17179873212 00000100:00100000:1.0:1746143769.211687:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436352:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143769.211687:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746143769.211689:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:0.0:1746143769.211691:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00000004:00080000:1.0:1746143769.211693:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f533100/2, rc 0, transno 17179873211 00002000:00010000:0.0:1746143769.211693:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00000100:00100000:1.0:1746143769.211695:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436736:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143769.211695:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746143769.211714:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3292:x1830963594436224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 286us (1860us total) trans 17179873213 rc 0/0 00000100:00100000:0.0:1746143769.211719:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13905 00000004:00080000:1.0:1746143769.211724:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530000/2, rc 0, transno 17179873213 00000100:00100000:1.0:1746143769.211727:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143769.211727:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13911 00000100:00100000:0.0:1746143769.211731:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594436096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.211934:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13912 00000100:00100000:3.0:1746143769.211942:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3294:x1830963594436608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143769.212024:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594436608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (2003us total) trans 17179873214 rc 0/0 00000100:00100000:3.0:1746143769.212029:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13912 00000100:00100000:2.0:1746143769.212196:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594435200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1218us (2574us total) trans 21474840545 rc 0/0 00000100:00100000:2.0:1746143769.212201:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13899 00000004:00080000:2.0:1746143769.212307:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530700/2, rc 0, transno 17179873214 00000100:00100000:2.0:1746143769.212311:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594436608:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143769.212325:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093806300/2, rc 0, transno 21474840543 00000100:00100000:2.0:1746143769.212331:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594434944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.212337:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459180/2, rc 0, transno 21474840544 00000100:00100000:2.0:1746143769.212339:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594435456:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.212345:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094c12680/2, rc 0, transno 21474840541 00000100:00100000:2.0:1746143769.212347:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594435072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.212355:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094761c00/2, rc 0, transno 21474840542 00000100:00100000:2.0:1746143769.212358:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094761c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594435584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.212369:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445ad80/2, rc 0, transno 21474840545 00000100:00100000:2.0:1746143769.212372:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594435200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.212378:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013691b480/2, rc 0, transno 21474840540 00000100:00100000:2.0:1746143769.212380:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013691b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594435712:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.212386:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093806a00/2, rc 0, transno 21474840538 00000100:00100000:2.0:1746143769.212389:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594434816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143769.212394:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094458e00/2, rc 0, transno 21474840539 00000100:00100000:2.0:1746143769.212397:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594435328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.212516:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143769.212524:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143769.212545:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143769.212592:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436864 00000100:00100000:3.0:1746143769.212596:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436864 00000100:00100000:3.0:1746143769.212614:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13913 00000100:00100000:3.0:1746143769.212618:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594436864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143769.212691:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3292:x1830963594436864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (146us total) trans 21474840546 rc 0/0 00000100:00100000:3.0:1746143769.212697:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13913 00000004:00080000:1.0:1746143769.212768:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a087a300/2, rc 0, transno 21474840546 00000100:00100000:1.0:1746143769.212772:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a087a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594436864:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143769.212899:0:4581:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143769.212902:0:4581:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.212903:0:4581:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.212905:0:4581:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.212908:0:4581:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746143769.213407:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594436096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1675us (3404us total) trans 17179873215 rc 0/0 00000100:00100000:0.0:1746143769.213412:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13911 00002000:00010000:0.0:1746143769.213491:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143769.213494:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.213496:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.213497:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00002000:00010000:0.0:1746143769.213499:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746143769.213518:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594435968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1889us (3563us total) trans 17179873216 rc 0/0 00000100:00100000:0.0:1746143769.213523:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13909 00000100:00100000:1.0:1746143769.213633:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3294:x1830963594436480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2000us (3654us total) trans 17179873217 rc 0/0 00000100:00100000:1.0:1746143769.213640:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13910 00000004:00080000:3.0:1746143769.213716:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f532300/2, rc 0, transno 17179873215 00000100:00100000:3.0:1746143769.213720:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594436096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143769.213726:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f530e00/2, rc 0, transno 17179873216 00000100:00100000:3.0:1746143769.213728:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594435968:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143769.213733:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f531880/2, rc 0, transno 17179873217 00000100:00100000:3.0:1746143769.213736:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594436480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143769.226586:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594434688:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143769.226624:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25ae00/0xe984082ccd730fbf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 9 pid: 14762 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746143769.226641:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.226828:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.226878:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390016 00000100:00100000:3.0:1746143769.226883:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390016 00010000:00010000:1.0:1746143769.226892:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c25aa00, rc 0) 00000100:00100000:3.0:1746143769.226911:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4012 00000100:00100000:3.0:1746143769.226916:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31554:x1830963594390016:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:1.0:1746143769.226926:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31551:x1830963594389248:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 44119us (44195us total) trans 8589943642 rc 0/0 00000100:00100000:1.0:1746143769.226932:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9296 00000100:00100000:3.0:1746143769.226967:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31554:x1830963594390016:12345-192.168.202.48@tcp:49:cat.0 Request processed in 52us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.226971:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4012 00000100:00100000:0.0:1746143769.231441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.231516:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390144 00000100:00100000:1.0:1746143769.231525:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390144 00000100:00100000:1.0:1746143769.231578:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9299 00000100:00100000:1.0:1746143769.231585:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31559:x1830963594390144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.231602:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.231619:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83c5 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.231671:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 242 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.231683:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 242 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.231697:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.231701:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143769.231704:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346800, rc 0) 00000100:00100000:1.0:1746143769.231740:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31559:x1830963594390144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 156us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.231746:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9299 00000100:00100000:0.0:1746143769.238954:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.238995:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.239072:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.239089:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.239101:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.239356:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390400 00000100:00100000:1.0:1746143769.239364:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390400 00000100:00100000:1.0:1746143769.239393:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390528 00000100:00100000:1.0:1746143769.239395:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390528 00000100:00100000:1.0:1746143769.239404:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390656 00000100:00100000:1.0:1746143769.239405:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390656 00000100:00100000:1.0:1746143769.239412:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390784 00000100:00100000:1.0:1746143769.239413:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390784 00000100:00100000:1.0:1746143769.239423:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13914 00000100:00100000:1.0:1746143769.239428:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594390400:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.239442:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.239455:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83cc expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.239471:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.239473:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.239480:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.239492:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.239500:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347e00, rc 0) 00000100:00100000:2.0:1746143769.239581:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390272 00000100:00100000:2.0:1746143769.239587:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390272 00000100:00100000:2.0:1746143769.239609:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4013 00000100:00100000:2.0:1746143769.239614:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31551:x1830963594390272:12345-192.168.202.48@tcp:49:multiop.0 00000100:00100000:3.0:1746143769.239715:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13915 00000100:00100000:3.0:1746143769.239723:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594390528:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.239730:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.239740:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83d3 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.239751:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.239752:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.239757:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.239771:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 24 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.239778:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7400, rc 0) 00000100:00100000:1.0:1746143769.239859:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594390400:12345-192.168.202.48@tcp:101:cat.0 Request processed in 425us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.239872:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13914 00000100:00100000:1.0:1746143769.239895:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13916 00000100:00100000:1.0:1746143769.239903:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594390656:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.239914:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.239923:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83da expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.239941:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.239942:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.239949:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.239962:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 25 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.239971:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347800, rc 0) 00000100:00100000:0.0:1746143769.240012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.240027:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31551:x1830963594390272:12345-192.168.202.48@tcp:49:multiop.0 Request processed in 411us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.240033:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4013 00000100:00100000:3.0:1746143769.240096:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594390528:12345-192.168.202.48@tcp:101:cat.0 Request processed in 373us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.240101:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13915 00000100:00100000:3.0:1746143769.240110:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594390912 00000100:00100000:3.0:1746143769.240113:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594390912 00000100:00100000:3.0:1746143769.240133:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13917 00000100:00100000:3.0:1746143769.240161:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594390784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.240167:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.240174:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83e1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.240183:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.240185:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.240189:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.240197:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.240203:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc6400, rc 0) 00000100:00100000:3.0:1746143769.240218:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594390784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 81us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.240223:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13917 00000100:00100000:3.0:1746143769.240233:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13918 00000100:00100000:3.0:1746143769.240237:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594390912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.240242:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.240248:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83e8 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.240257:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.240258:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.240261:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.240268:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 20 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.240273:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a91ee00, rc 0) 00000100:00100000:3.0:1746143769.240286:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594390912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 49us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.240290:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13918 00000100:00100000:1.0:1746143769.240570:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594390656:12345-192.168.202.48@tcp:101:cat.0 Request processed in 669us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.240639:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.240666:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594391040 00000100:00100000:0.0:1746143769.240670:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594391040 00000100:00100000:2.0:1746143769.240684:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.240687:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13916 00000100:00100000:2.0:1746143769.240698:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594391296 00000100:00100000:2.0:1746143769.240701:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594391296 00002000:00100000:2.0:1746143769.240725:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6ed80 x1830963594391296/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.240734:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ed80 with x1830963594391296 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.240738:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6ed80 00000100:00100000:2.0:1746143769.240747:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6558 00000100:00100000:2.0:1746143769.240752:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594391296:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143769.240964:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13919 00000100:00100000:0.0:1746143769.240969:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594391040:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143769.240975:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.240982:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83ef expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.240995:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.240996:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.241000:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.241008:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.241014:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075fc00, rc 0) 00000100:00100000:0.0:1746143769.241027:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594391040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.241031:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13919 00000100:00100000:2.0:1746143769.252493:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594391296:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11733us (11800us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.252503:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6558 00002000:00100000:2.0:1746143769.252512:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6ed80 x1830963594391296/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.252520:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6ed80 with x1830963594391296 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.252524:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6ed80 00000100:00100000:0.0:1746143769.259310:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.259347:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.259371:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.259384:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.259418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.259498:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594391680 00000100:00100000:3.0:1746143769.259499:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594391424 00000100:00100000:3.0:1746143769.259506:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594391424 00000100:00100000:2.0:1746143769.259506:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594391680 00002000:00100000:2.0:1746143769.259537:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093b04e00 x1830963594391680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143769.259541:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13920 00002000:00100000:2.0:1746143769.259546:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04e00 with x1830963594391680 ext(0->1048575) 00000100:00100000:3.0:1746143769.259547:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31554:x1830963594391424:12345-192.168.202.48@tcp:101:cat.0 00002000:00010000:2.0:1746143769.259550:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b04e00 00010000:00010000:3.0:1746143769.259558:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143769.259561:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594391936 00000100:00100000:2.0:1746143769.259563:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594391936 00010000:00010000:3.0:1746143769.259572:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83f6 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143769.259572:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093b06a00 x1830963594391936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.259578:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06a00 with x1830963594391936 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.259581:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b06a00 00000100:00100000:2.0:1746143769.259587:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594392192 00000100:00100000:2.0:1746143769.259588:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594392192 00002000:00100000:2.0:1746143769.259595:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093b07b80 x1830963594392192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143769.259598:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.259600:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746143769.259602:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07b80 with x1830963594392192 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.259604:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b07b80 00010000:00010000:3.0:1746143769.259606:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 13 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.259610:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594392448 00000100:00100000:2.0:1746143769.259611:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594392448 00002000:00100000:2.0:1746143769.259618:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093b07100 x1830963594392448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143769.259619:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 13 pid: 15784 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143769.259624:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07100 with x1830963594392448 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.259626:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b07100 00010000:00010000:3.0:1746143769.259627:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a91f800, rc 0) 00000100:00100000:2.0:1746143769.259633:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6559 00000100:00100000:2.0:1746143769.259637:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594391680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143769.259662:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31554:x1830963594391424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.259668:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13920 00000100:00100000:3.0:1746143769.259688:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6560 00000100:00100000:3.0:1746143769.259693:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594391936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.259743:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6561 00000100:00100000:2.0:1746143769.259747:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594392192:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143769.260028:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6562 00000100:00100000:3.0:1746143769.260033:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594392448:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.260967:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.260983:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594392576 00000100:00100000:0.0:1746143769.260986:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594392576 00000100:00100000:0.0:1746143769.261007:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13921 00000100:00100000:0.0:1746143769.261012:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31551:x1830963594392576:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143769.261018:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.261027:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a83fd expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.261048:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.261055:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.261062:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.261067:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.261068:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.261071:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1261568->1871871] (req 1261568->1871871) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.261093:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 11 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.261103:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 11 pid: 9527 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746143769.261112:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594436992:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143769.261199:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.261207:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 26 pid: 12618 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.261216:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594437120:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143769.261240:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 13 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.261248:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 13 pid: 8497 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.261255:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594437248:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143769.261272:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.267175:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.267242:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594392832 00000100:00100000:1.0:1746143769.267250:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594392832 00002000:00100000:1.0:1746143769.267287:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093b04380 x1830963594392832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.267296:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04380 with x1830963594392832 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.267300:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b04380 00000100:00100000:1.0:1746143769.267335:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6563 00000100:00100000:1.0:1746143769.267344:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594392832:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.275635:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594436992:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143769.275646:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594437120:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143769.275654:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093b05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594437248:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143769.275677:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1261568->1871871] (req 1261568->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 11 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.275691:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009075fe00, rc 0) 00000100:00100000:1.0:1746143769.275729:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31551:x1830963594392576:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 14715us (14761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.275736:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13921 00000100:00100000:2.0:1746143769.276532:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594391680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16892us (17181us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.276539:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6559 00002000:00100000:2.0:1746143769.276548:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880093b04e00 x1830963594391680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.276557:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04e00 with x1830963594391680 ext(0->1048575) 00002000:00010000:2.0:1746143769.276562:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b04e00 00000100:00100000:0.0:1746143769.283934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.284041:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.284116:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594392960 00000100:00100000:2.0:1746143769.284124:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594392960 00000100:00100000:1.0:1746143769.284174:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594393088 00000100:00100000:1.0:1746143769.284177:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594393088 00010000:00010000:2.0:1746143769.284186:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 11 pid: 9527 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.284192:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 14 pid: 8497 timeout: 948 lvb_type: 1 00000100:00100000:1.0:1746143769.284214:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7441 00000100:00100000:2.0:1746143769.284218:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7442 00000100:00100000:1.0:1746143769.284219:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594393088:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143769.284224:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594392960:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.284228:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.284231:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.284242:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 11 pid: 9527 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.284242:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 14 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.284252:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 14 pid: 8497 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.284607:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594392192:12345-192.168.202.48@tcp:3:cat.0 Request processed in 24857us (25220us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.284615:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6561 00002000:00100000:3.0:1746143769.284624:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093b07b80 x1830963594392192/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.284632:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07b80 with x1830963594392192 ext(1048576->2097151) 00010000:00010000:3.0:1746143769.284637:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 27 pid: 12618 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143769.284709:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 11 pid: 9527 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.284730:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095386600/0xe984082ccd730ee6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8355 expref: 14 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143769.285797:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61cc800/0xe984082ccd730fe2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83a9 expref: 11 pid: 9527 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.285814:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.285839:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594392960:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1616us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.285846:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7442 00010000:00010000:3.0:1746143769.285916:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 27 pid: 12618 timeout: 948 lvb_type: 1 00002000:00010000:3.0:1746143769.285923:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093b07b80 00010000:00010000:1.0:1746143769.285931:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.285952:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594393088:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1731us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.285959:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7441 00000100:00100000:3.0:1746143769.287870:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594392448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 27833us (28447us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.287878:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6562 00002000:00100000:3.0:1746143769.287885:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093b07100 x1830963594392448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.287894:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b07100 with x1830963594392448 ext(1048576->2097151) 00002000:00010000:3.0:1746143769.287899:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b07100 00000100:00100000:3.0:1746143769.288969:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594391936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 29272us (29593us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.288975:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6560 00002000:00100000:3.0:1746143769.288981:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093b06a00 x1830963594391936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.288987:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b06a00 with x1830963594391936 ext(1048576->2097151) 00002000:00010000:3.0:1746143769.288990:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093b06a00 00000100:00100000:0.0:1746143769.293174:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.293564:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594392832:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 26220us (26426us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.293572:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6563 00002000:00100000:1.0:1746143769.293581:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880093b04380 x1830963594392832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.293589:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093b04380 with x1830963594392832 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.293594:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093b04380 00000100:00100000:1.0:1746143769.293616:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594393216 00000100:00100000:1.0:1746143769.293621:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594393216 00010000:00010000:1.0:1746143769.293641:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 25 pid: 12618 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.293751:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.293794:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594393344 00000100:00100000:2.0:1746143769.293798:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594393344 00000100:00100000:2.0:1746143769.293833:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13922 00000100:00100000:2.0:1746143769.293838:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31559:x1830963594393344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.293850:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.293861:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8404 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.293879:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.293885:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1261568->1871871] (req 1261568->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.293889:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143769.293893:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.293902:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7443 00000100:00100000:1.0:1746143769.293908:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594393216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.293915:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.293918:0:6929:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [1261568->1871871] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.293931:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 27 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.293931:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 27 pid: 12618 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143769.293940:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6164c00, rc 0) 00010000:00010000:1.0:1746143769.293945:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 27 pid: 12618 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.293958:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347800/0xe984082ccd731013 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83da expref: 27 pid: 12618 timeout: 948 lvb_type: 1 00000100:00100000:2.0:1746143769.293969:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31559:x1830963594393344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 131us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.293974:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13922 00010000:00010000:1.0:1746143769.294063:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.294065:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.294070:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.294076:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.294093:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 9 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.294101:0:7150:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 9 pid: 6929 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.294111:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594437504:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143769.294182:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.295632:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.295680:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594393472 00000100:00100000:3.0:1746143769.295685:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594393472 00000100:00100000:1.0:1746143769.295740:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594437504:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143769.295743:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13923 00000100:00100000:3.0:1746143769.295749:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31557:x1830963594393472:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.295750:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143769.295756:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.295765:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a840b expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.295771:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594393216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1864us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.295778:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7443 00010000:00010000:3.0:1746143769.295779:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.295786:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 26 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.295792:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.295796:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.295797:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.295800:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.295814:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 9 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.295821:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 9 pid: 4581 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.295829:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594437632:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.295878:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 26 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.295886:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 26 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.295893:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594437760:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.295913:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.295919:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 12 pid: 8496 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.295925:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594437888:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.295938:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.295972:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.295991:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594393728 00000100:00100000:1.0:1746143769.295994:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594393728 00002000:00100000:1.0:1746143769.296012:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1261568->1265663) req@ffff88009ff6c000 x1830963594393728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.296021:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c000 with x1830963594393728 ext(1261568->1265663) 00010000:00010000:1.0:1746143769.296025:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.296034:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.296040:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6c000 00000100:00100000:1.0:1746143769.296052:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1853 00000100:00100000:1.0:1746143769.296058:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594393728:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.296209:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1964:x1830963594393728:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 150us (236us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.296214:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1853 00002000:00100000:1.0:1746143769.296220:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1261568->1265663) req@ffff88009ff6c000 x1830963594393728/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.296226:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c000 with x1830963594393728 ext(1261568->1265663) 00010000:00010000:1.0:1746143769.296231:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.296243:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.296249:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6c000 00000100:00100000:0.0:1746143769.297373:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594437632:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143769.297783:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594437760:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143769.297809:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.298214:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594437888:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143769.298241:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.298251:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a91fa00, rc 0) 00000100:00100000:2.0:1746143769.298288:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31557:x1830963594393472:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2539us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.298293:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594393856 00000100:00100000:2.0:1746143769.298294:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13923 00000100:00100000:1.0:1746143769.298297:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594393856 00010000:00010000:1.0:1746143769.298312:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 10 pid: 4581 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.298329:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7444 00000100:00100000:1.0:1746143769.298334:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594393856:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.298344:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.298357:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 10 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.298366:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 10 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.298381:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a717600/0xe984082ccd730f80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a838d expref: 10 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.298390:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.298420:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594393856:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.298426:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7444 00000100:00100000:0.0:1746143769.298821:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.298859:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594393984 00000100:00100000:2.0:1746143769.298863:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594393984 00000100:00100000:2.0:1746143769.298882:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13924 00000100:00100000:2.0:1746143769.298887:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594393984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.298895:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.298902:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd73104b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8412 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.298913:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.298919:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd73104b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8412 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.298927:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164a00/0xe984082ccd73104b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8412 expref: 10 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.298937:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6164a00, rc 0) 00000100:00100000:2.0:1746143769.298962:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594393984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 75us (142us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143769.298967:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13924 00000100:00100000:0.0:1746143769.299252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.299285:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.299302:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594394112 00000100:00100000:2.0:1746143769.299305:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594394112 00000100:00100000:2.0:1746143769.299320:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594394240 00000100:00100000:2.0:1746143769.299322:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594394240 00000100:00100000:2.0:1746143769.299334:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13925 00000100:00100000:2.0:1746143769.299338:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594394112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.299345:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.299353:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8419 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.299367:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.299368:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.299374:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.299383:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.299390:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a91ec00, rc 0) 00000100:00100000:1.0:1746143769.299415:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13926 00000100:00100000:1.0:1746143769.299422:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:1965:x1830963594394240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.299428:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.299435:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8420 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.299444:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.299445:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.299450:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.299458:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 10 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.299464:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346000, rc 0) 00000100:00100000:2.0:1746143769.299925:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594394112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 585us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.299930:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13925 00000100:00100000:1.0:1746143769.299971:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594394240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 551us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.299976:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13926 00000100:00100000:3.0:1746143769.300008:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.300039:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.300052:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594394368 00000100:00100000:1.0:1746143769.300055:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594394368 00010000:00010000:1.0:1746143769.300067:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 26 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:1.0:1746143769.300081:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594394496 00000100:00100000:1.0:1746143769.300083:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594394496 00010000:00010000:1.0:1746143769.300090:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00000100:00100000:1.0:1746143769.300119:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7445 00000100:00100000:1.0:1746143769.300124:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594394368:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.300131:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143769.300136:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7446 00010000:00010000:1.0:1746143769.300164:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 26 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.300167:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594394496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.300171:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 26 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.300174:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.300182:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbc7400/0xe984082ccd73100c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83d3 expref: 26 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.300182:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.300190:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.300195:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143769.300199:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba26a00/0xe984082ccd730ed1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a834e expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00000100:00100000:1.0:1746143769.300209:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594394368:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.300213:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7445 00010000:00010000:0.0:1746143769.300216:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.300217:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.300221:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.300227:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.300249:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 24 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.300258:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594438016:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143769.300290:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.301423:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594438016:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.301435:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.301468:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594394496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1301us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.301474:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7446 00000100:00100000:0.0:1746143769.301675:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.301761:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594394752 00000100:00100000:1.0:1746143769.301764:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594394752 00002000:00100000:1.0:1746143769.301787:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1765376->1769471) req@ffff8800949f1f80 x1830963594394752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.301796:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963594394752 ext(1765376->1769471) 00002000:00010000:1.0:1746143769.301800:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:1.0:1746143769.301824:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6564 00000100:00100000:1.0:1746143769.301830:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594394752:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.301953:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594394752:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (278us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.301959:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6564 00002000:00100000:1.0:1746143769.301963:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1765376->1769471) req@ffff8800949f1f80 x1830963594394752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.301970:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1f80 with x1830963594394752 ext(1765376->1769471) 00002000:00010000:1.0:1746143769.301973:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949f1f80 00000100:00100000:0.0:1746143769.302702:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.302818:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594395008 00000100:00100000:1.0:1746143769.302821:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594395008 00002000:00100000:1.0:1746143769.302840:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1867776->1871871) req@ffff8800949f1880 x1830963594395008/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.302847:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1880 with x1830963594395008 ext(1867776->1871871) 00010000:00010000:1.0:1746143769.302853:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.302865:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.302871:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949f1880 00000100:00100000:1.0:1746143769.302894:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1854 00000100:00100000:1.0:1746143769.302900:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594395008:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.302975:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594395008:12345-192.168.202.48@tcp:3:cat.0 Request processed in 76us (274us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.302981:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1854 00002000:00100000:1.0:1746143769.302986:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1867776->1871871) req@ffff8800949f1880 x1830963594395008/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.302993:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f1880 with x1830963594395008 ext(1867776->1871871) 00010000:00010000:1.0:1746143769.302997:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.303005:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.303010:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949f1880 00000100:00100000:0.0:1746143769.304877:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.304928:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594395264 00000100:00100000:3.0:1746143769.304932:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594395264 00002000:00100000:3.0:1746143769.304953:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1261568->1871871) req@ffff8800949f2300 x1830963594395264/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.304961:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2300 with x1830963594395264 ext(1261568->1871871) 00010000:00010000:3.0:1746143769.304967:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.304976:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 10 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143769.304982:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949f2300 00000100:00100000:3.0:1746143769.305009:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1855 00000100:00100000:3.0:1746143769.305015:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1965:x1830963594395264:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143769.305056:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.305206:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594395520 00000100:00100000:2.0:1746143769.305210:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594395520 00000100:00100000:2.0:1746143769.305306:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4014 00000100:00100000:2.0:1746143769.305312:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31551:x1830963594395520:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143769.305936:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.305950:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31551:x1830963594395520:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 637us (893us total) trans 8589943643 rc 0/0 00000100:00100000:2.0:1746143769.305957:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4014 00000100:00100000:1.0:1746143769.306342:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594395648 00000100:00100000:1.0:1746143769.306346:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594395648 00000100:00100000:1.0:1746143769.306367:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13927 00000100:00100000:1.0:1746143769.306372:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31557:x1830963594395648:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.306380:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.306392:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8427 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.306408:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.306412:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.306418:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143769.306421:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->1552383] (req 1048576->1552383) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.306448:0:6929:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.306471:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->1552383] (req 1048576->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.306479:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347000, rc 0) 00000100:00100000:1.0:1746143769.306504:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31557:x1830963594395648:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 131us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.306509:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13927 00000100:00100000:0.0:1746143769.308676:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.308972:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594395904 00000100:00100000:1.0:1746143769.308978:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594395904 00002000:00100000:1.0:1746143769.309006:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012ba28a80 x1830963594395904/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.309015:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28a80 with x1830963594395904 ext(2097152->3145727) 00002000:00010000:1.0:1746143769.309019:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba28a80 00000100:00100000:1.0:1746143769.309048:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6565 00000100:00100000:1.0:1746143769.309055:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594395904:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.310100:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.310170:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.310388:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594396288 00000100:00100000:3.0:1746143769.310392:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594396288 00002000:00100000:3.0:1746143769.310413:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012ba29c00 x1830963594396288/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.310421:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29c00 with x1830963594396288 ext(3145728->4194303) 00002000:00010000:3.0:1746143769.310424:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba29c00 00000100:00100000:3.0:1746143769.310436:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594396416 00000100:00100000:3.0:1746143769.310438:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594396416 00002000:00100000:3.0:1746143769.310447:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012ba29180 x1830963594396416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.310454:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29180 with x1830963594396416 ext(2097152->3145727) 00002000:00010000:3.0:1746143769.310456:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba29180 00000100:00100000:3.0:1746143769.310466:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6566 00000100:00100000:3.0:1746143769.310471:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594396288:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143769.311652:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6567 00000100:00100000:3.0:1746143769.311659:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594396416:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.316506:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.316584:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594396672 00000100:00100000:3.0:1746143769.316592:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594396672 00002000:00100000:3.0:1746143769.316626:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ca6c000 x1830963594396672/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.316639:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c000 with x1830963594396672 ext(3145728->4194303) 00002000:00010000:3.0:1746143769.316645:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c000 00000100:00100000:3.0:1746143769.316671:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6568 00000100:00100000:3.0:1746143769.316679:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594396672:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.322414:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594396288:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11934us (12308us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.322424:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6566 00002000:00100000:2.0:1746143769.322434:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012ba29c00 x1830963594396288/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.322443:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29c00 with x1830963594396288 ext(3145728->4194303) 00002000:00010000:2.0:1746143769.322447:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba29c00 00000100:00100000:3.0:1746143769.323752:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594395264:12345-192.168.202.48@tcp:4:cat.0 Request processed in 18730us (18871us total) trans 17179873218 rc 0/0 00000100:00100000:3.0:1746143769.323760:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1855 00002000:00100000:3.0:1746143769.323766:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1261568->1871871) req@ffff8800949f2300 x1830963594395264/t17179873218(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.323773:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949f2300 with x1830963594395264 ext(1261568->1871871) 00010000:00010000:3.0:1746143769.323780:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 16 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.323793:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 16 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143769.323798:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949f2300 00000100:00100000:1.0:1746143769.324749:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594395904:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15691us (16073us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.324757:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6565 00002000:00100000:1.0:1746143769.324763:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012ba28a80 x1830963594395904/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.324771:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba28a80 with x1830963594395904 ext(2097152->3145727) 00002000:00010000:1.0:1746143769.324774:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba28a80 00000100:00100000:3.0:1746143769.328091:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594396416:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16425us (17914us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.328102:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6567 00002000:00100000:3.0:1746143769.328111:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012ba29180 x1830963594396416/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143769.328118:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594396672:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11439us (11618us total) trans 0 rc 1048576/1048576 00002000:00100000:3.0:1746143769.328119:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29180 with x1830963594396416 ext(2097152->3145727) 00002000:00010000:3.0:1746143769.328124:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba29180 00000100:00100000:2.0:1746143769.328125:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6568 00002000:00100000:2.0:1746143769.328131:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ca6c000 x1830963594396672/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.328164:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6c000 with x1830963594396672 ext(3145728->4194303) 00002000:00010000:2.0:1746143769.328168:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6c000 00000100:00100000:0.0:1746143769.328266:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.328441:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594396800 00000100:00100000:2.0:1746143769.328448:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594396800 00010000:00010000:2.0:1746143769.328471:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 12 pid: 6929 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.328546:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7447 00000100:00100000:2.0:1746143769.328553:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594396800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.328563:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143769.328576:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143768 -> 1746143769 00002000:00010000:2.0:1746143769.328579:0:11106:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143768 -> 1746143769 00010000:00010000:2.0:1746143769.328583:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 12 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.328594:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 12 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.328613:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075fe00/0xe984082ccd731036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1261568->1871871) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83fd expref: 12 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.328635:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.328637:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.328643:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.328650:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.328676:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.328860:0:11106:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 25 pid: 6929 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.328870:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594438272:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.329053:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.330860:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594438272:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.330877:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.330905:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594396800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2352us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.330915:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7447 00000100:00100000:0.0:1746143769.332031:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.332098:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594396928 00000100:00100000:2.0:1746143769.332104:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594396928 00000100:00100000:2.0:1746143769.332176:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9300 00000100:00100000:2.0:1746143769.332184:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31561:x1830963594396928:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143769.332203:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.332217:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd731067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a842e expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.332644:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332654:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332663:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332674:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332679:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332689:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332799:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332807:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332813:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143769.332843:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:2.0:1746143769.332847:0:2976:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143769.332860:0:2976:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332868:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332873:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332878:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332883:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332888:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d4e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.332891:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332896:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332904:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143769.332906:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.332910:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332914:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4e00/0xe984082ccd73106e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332924:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332929:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332933:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332937:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c2d5800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.332938:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332942:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332948:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5c04400) 00010000:00010000:2.0:1746143769.332949:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.332951:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332955:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd731075 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.332976:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d4000/0xe984082ccd731067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.332984:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 7 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.332989:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.332992:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143769.332993:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7400, rc 0) 00000100:00100000:2.0:1746143769.333037:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31561:x1830963594396928:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 854us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.333043:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9300 00000100:00100000:0.0:1746143769.334222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.334496:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594397184 00000100:00100000:2.0:1746143769.334502:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594397184 00002000:00100000:2.0:1746143769.334531:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094c0d180 x1830963594397184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.334540:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d180 with x1830963594397184 ext(1048576->2097151) 00010000:00010000:2.0:1746143769.334547:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.334558:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.334565:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0d180 00000100:00100000:2.0:1746143769.334592:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1856 00000100:00100000:2.0:1746143769.334598:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594397184:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143769.338039:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.338068:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.338089:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.338108:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594397312 00000100:00100000:0.0:1746143769.338114:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594397312 00000100:00100000:0.0:1746143769.338178:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594397440 00000100:00100000:0.0:1746143769.338180:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594397440 00000100:00100000:1.0:1746143769.338181:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594397696 00000100:00100000:1.0:1746143769.338185:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594397696 00000100:00100000:0.0:1746143769.338195:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13928 00000100:00100000:0.0:1746143769.338202:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963594397312:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143769.338207:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13929 00000100:00100000:1.0:1746143769.338212:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1963:x1830963594397440:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143769.338216:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.338219:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.338228:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a630f800/0xe984082ccd731083 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a843c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.338228:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd73108a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8435 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.338243:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.338251:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a630f800/0xe984082ccd731083 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a843c expref: 15 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.338259:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a630f800/0xe984082ccd731083 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a843c expref: 15 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143769.338265:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594438400:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143769.338266:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13930 00010000:00010000:1.0:1746143769.338270:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630f800, rc 0) 00000100:00100000:2.0:1746143769.338274:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594397696:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.338281:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.338288:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4000/0xe984082ccd731091 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a844a expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.338299:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143769.338300:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1963:x1830963594397440:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 88us (232us total) trans 0 rc 301/301 00010000:00010000:2.0:1746143769.338305:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4000/0xe984082ccd731091 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a844a expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143769.338305:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13929 00010000:00010000:2.0:1746143769.338313:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4000/0xe984082ccd731091 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a844a expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.338323:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4000, rc 0) 00000100:00100000:2.0:1746143769.338481:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594397696:12345-192.168.202.48@tcp:101:cat.0 Request processed in 206us (389us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143769.338487:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13930 00000100:00100000:0.0:1746143769.338673:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.338704:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.338864:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594397568 00000100:00100000:2.0:1746143769.338868:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594397568 00000100:00100000:2.0:1746143769.338885:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13931 00000100:00100000:2.0:1746143769.338890:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594397568:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.338901:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.338907:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd731098 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8443 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.339002:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594438528:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143769.339029:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.340961:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594397184:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 6357us (6735us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.340970:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1856 00002000:00100000:2.0:1746143769.340981:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094c0d180 x1830963594397184/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.340990:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c0d180 with x1830963594397184 ext(1048576->2097151) 00010000:00010000:2.0:1746143769.340998:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.341010:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.341016:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c0d180 00002000:00010000:0.0:1746143769.341200:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime: 1746143768 -> 1746143769 00002000:00010000:0.0:1746143769.341203:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143768 -> 1746143769 00002000:00010000:0.0:1746143769.341205:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime: 1746143768 -> 1746143769 00000100:00100000:0.0:1746143769.341218:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594438400:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143769.341240:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd73108a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8435 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.341250:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095394400/0xe984082ccd73108a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8435 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143769.341264:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095394400, rc 0) 00000100:00100000:0.0:1746143769.341334:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1963:x1830963594397312:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 3131us (3300us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143769.341340:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13928 00000100:00100000:3.0:1746143769.341345:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594438528:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.341361:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd731098 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8443 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.341373:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2d4e00/0xe984082ccd731098 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8443 expref: 12 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.341383:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d4e00, rc 0) 00000100:00100000:3.0:1746143769.341402:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594397568:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2512us (2697us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.341407:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13931 00000100:00100000:0.0:1746143769.343076:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.343249:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594397952 00000100:00100000:2.0:1746143769.343255:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594397952 00000100:00100000:2.0:1746143769.343349:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9301 00000100:00100000:2.0:1746143769.343356:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31561:x1830963594397952:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143769.343370:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.343382:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6164600/0xe984082ccd73109f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8451 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.343460:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.343472:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 241 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.343478:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.343483:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143769.343504:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.343517:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 8 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.343526:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594438656:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143769.343958:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 241 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.343965:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 241 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.343972:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594438784:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143769.343991:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.345769:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.345830:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594398208 00000100:00100000:2.0:1746143769.345836:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594398208 00002000:00100000:2.0:1746143769.345864:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009bfe0000 x1830963594398208/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.345872:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963594398208 ext(4194304->4771839) 00002000:00010000:2.0:1746143769.345876:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0000 00000100:00100000:2.0:1746143769.345901:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6569 00000100:00100000:2.0:1746143769.345907:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594398208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143769.347522:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594438656:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143769.348741:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.348756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.349288:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594438784:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.349310:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:0.0:1746143769.349675:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.350811:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594398464 00000100:00100000:3.0:1746143769.350818:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594398464 00010000:00010000:3.0:1746143769.350850:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 242 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.350869:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594398336 00000100:00100000:3.0:1746143769.350871:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594398336 00010000:00010000:3.0:1746143769.350879:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 9 pid: 2976 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.350889:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594398592 00000100:00100000:3.0:1746143769.350891:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594398592 00010000:00010000:3.0:1746143769.350899:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.350918:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7448 00000100:00100000:3.0:1746143769.350924:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1965:x1830963594398464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.350933:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.350938:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 242 pid: 2976 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.350946:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 242 pid: 2976 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.350964:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009075f200/0xe984082ccd730ff7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83be expref: 242 pid: 2976 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.350975:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.350978:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.350984:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.350988:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.351021:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:1965:x1830963594398464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 98us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.351027:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7448 00000100:00100000:3.0:1746143769.351039:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7449 00000100:00100000:3.0:1746143769.351043:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594398336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.351049:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.351052:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 9 pid: 2976 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.351058:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 9 pid: 2976 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.351068:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7400/0xe984082ccd73107c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a842e expref: 9 pid: 2976 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.351079:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.351081:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.351087:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.351092:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.351105:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.351116:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594398336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 72us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.351120:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7449 00000100:00100000:3.0:1746143769.351128:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7450 00000100:00100000:3.0:1746143769.351131:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594398592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.351167:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.351190:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.351198:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.351210:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6164c00/0xe984082ccd73103d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8404 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.351218:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.351219:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.351224:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.351230:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.351251:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.351260:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c277b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594438912:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143769.351299:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143769.351316:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.351322:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:3.0:1746143769.351470:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143769.351588:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6164600/0xe984082ccd73109f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8451 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.351598:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8451 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.351605:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.351607:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143769.351609:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2d5800, rc 0) 00000100:00100000:3.0:1746143769.352411:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31561:x1830963594397952:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 9054us (9339us total) trans 8589943644 rc 0/0 00000100:00100000:3.0:1746143769.352417:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9301 00000100:00100000:2.0:1746143769.352870:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594398208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6962us (7104us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143769.352877:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6569 00002000:00100000:2.0:1746143769.352884:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009bfe0000 x1830963594398208/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.352893:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0000 with x1830963594398208 ext(4194304->4771839) 00002000:00010000:2.0:1746143769.352897:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bfe0000 00000100:00100000:3.0:1746143769.353843:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c277b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:23335:1830963594438912:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143769.353858:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.353910:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594398592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2777us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.353917:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7450 00000100:00100000:0.0:1746143769.357844:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.357880:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.357891:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.357899:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.357916:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.357931:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.357940:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594399488 00000100:00100000:0.0:1746143769.357944:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.357947:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594399488 00000100:00100000:0.0:1746143769.357964:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.357975:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594400000 00000100:00100000:0.0:1746143769.357978:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594400000 00002000:00100000:1.0:1746143769.357983:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009bfe2680 x1830963594399488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.357991:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830963594399488 ext(3145728->4194303) 00002000:00010000:1.0:1746143769.357995:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:0.0:1746143769.357995:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594400256 00000100:00100000:0.0:1746143769.357997:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594400256 00000100:00100000:1.0:1746143769.358004:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594398848 00000100:00100000:1.0:1746143769.358006:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594398848 00000100:00100000:0.0:1746143769.358008:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13932 00000100:00100000:0.0:1746143769.358013:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594400000:12345-192.168.202.48@tcp:101:cat.0 00002000:00100000:1.0:1746143769.358015:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f0afb80 x1830963594398848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.358021:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963594398848 ext(2097152->3145727) 00002000:00010000:1.0:1746143769.358023:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0afb80 00010000:00010000:0.0:1746143769.358024:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143769.358029:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594399104 00000100:00100000:1.0:1746143769.358032:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594399104 00010000:00010000:0.0:1746143769.358037:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093326200/0xe984082ccd7310b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8458 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143769.358039:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ac000 x1830963594399104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.358045:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac000 with x1830963594399104 ext(3145728->4194303) 00002000:00010000:1.0:1746143769.358046:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ac000 00000100:00100000:1.0:1746143769.358053:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594399360 00000100:00100000:1.0:1746143769.358055:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594399360 00002000:00100000:1.0:1746143769.358061:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0ac380 x1830963594399360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.358066:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac380 with x1830963594399360 ext(2097152->3145727) 00002000:00010000:1.0:1746143769.358068:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ac380 00000100:00100000:1.0:1746143769.358073:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594399744 00000100:00100000:1.0:1746143769.358075:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594399744 00000100:00100000:0.0:1746143769.358078:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a04cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594439040:192.168.202.48@tcp:106: 00002000:00100000:1.0:1746143769.358083:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1548288->1552383) req@ffff8800a04ce680 x1830963594399744/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.358088:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04ce680 with x1830963594399744 ext(1548288->1552383) 00002000:00010000:1.0:1746143769.358090:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04ce680 00000100:00100000:1.0:1746143769.358097:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6570 00000100:00100000:1.0:1746143769.358101:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594399488:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.358136:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.358179:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6571 00000100:00100000:0.0:1746143769.358184:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594398848:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.358232:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6572 00000100:00100000:1.0:1746143769.358297:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13933 00000100:00100000:1.0:1746143769.358302:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594400256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.358308:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.358314:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd7310bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a845f expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.358334:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594439168:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143769.358363:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.358375:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6573 00000100:00100000:1.0:1746143769.358379:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594399360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.358444:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594399104:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.358496:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6574 00000100:00100000:1.0:1746143769.358501:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594399744:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.358579:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594399744:12345-192.168.202.48@tcp:3:cat.0 Request processed in 78us (646us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.358584:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6574 00002000:00100000:1.0:1746143769.358589:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1548288->1552383) req@ffff8800a04ce680 x1830963594399744/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.358595:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04ce680 with x1830963594399744 ext(1548288->1552383) 00002000:00010000:1.0:1746143769.358597:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04ce680 00000100:00100000:3.0:1746143769.358876:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594400384 00000100:00100000:3.0:1746143769.358880:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594400384 00000100:00100000:3.0:1746143769.358903:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9302 00000100:00100000:3.0:1746143769.358907:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31561:x1830963594400384:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143769.358917:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.358919:0:2976:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143769.358934:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c2d5800/0xe984082ccd7310a6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8451 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.358953:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.358956:0:2976:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143769.358962:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091025c00/0xe984082ccd7310c2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8466 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.359025:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359034:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359040:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359049:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359054:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359059:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359063:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091025200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143769.359066:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359071:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359076:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.359078:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143769.359081:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359084:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091025200/0xe984082ccd7310c9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143769.359105:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091025c00/0xe984082ccd7310c2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8466 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.359111:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091025c00/0xe984082ccd7310c2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8466 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.359116:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091025c00, rc 0) 00000100:00100000:3.0:1746143769.359181:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31561:x1830963594400384:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 273us (1299us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.359187:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9302 00002000:00010000:3.0:1746143769.363451:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143768 -> 1746143769 00000100:00100000:3.0:1746143769.363461:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594439168:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143769.363461:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a04cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594439040:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.363485:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd7310bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a845f expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.363485:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093326200/0xe984082ccd7310b4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8458 expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.363497:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a63ffc00/0xe984082ccd7310bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a845f expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.363497:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093326200/0xe984082ccd7310b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8458 expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.363507:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63ffc00, rc 0) 00010000:00010000:1.0:1746143769.363561:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093326200, rc 0) 00000100:00100000:3.0:1746143769.363566:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594400256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5263us (5602us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.363573:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13933 00000100:00100000:1.0:1746143769.363575:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594400000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5562us (5629us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143769.363579:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13932 00000100:00100000:2.0:1746143769.363870:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.363888:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594400640 00000100:00100000:2.0:1746143769.363893:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594400640 00000100:00100000:2.0:1746143769.363932:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4015 00000100:00100000:2.0:1746143769.363938:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31557:x1830963594400640:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143769.364090:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31557:x1830963594400640:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 152us (221us total) trans 8589943645 rc 0/0 00000100:00100000:2.0:1746143769.364096:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4015 00000100:00100000:0.0:1746143769.364637:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.364874:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594400896 00000100:00100000:1.0:1746143769.364879:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594400896 00000100:00100000:1.0:1746143769.364912:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4016 00000100:00100000:1.0:1746143769.364917:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31561:x1830963594400896:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143769.365000:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31561:x1830963594400896:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 83us (363us total) trans 8589943646 rc 0/0 00000100:00100000:1.0:1746143769.365006:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4016 00000100:00100000:3.0:1746143769.368281:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.368305:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.368845:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594399360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10462us (10925us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.368854:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6573 00002000:00100000:1.0:1746143769.368863:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f0ac380 x1830963594399360/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.368872:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac380 with x1830963594399360 ext(2097152->3145727) 00002000:00010000:1.0:1746143769.368876:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f0ac380 00000100:00100000:2.0:1746143769.368961:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594401024 00000100:00100000:2.0:1746143769.368968:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594401024 00000100:00100000:2.0:1746143769.369008:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594401152 00000100:00100000:2.0:1746143769.369010:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594401152 00000100:00100000:2.0:1746143769.369024:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13934 00000100:00100000:2.0:1746143769.369030:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594401024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.369043:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.369056:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7b000/0xe984082ccd7310d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a846d expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.369063:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13935 00000100:00100000:3.0:1746143769.369071:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594401152:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.369078:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.369085:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a630fa00/0xe984082ccd7310d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8474 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.369098:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594439296:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.369107:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594439424:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.369181:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.369190:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.374184:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594439296:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143769.374215:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7b000/0xe984082ccd7310d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a846d expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.374233:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7b000/0xe984082ccd7310d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a846d expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.374248:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7b000, rc 0) 00000100:00100000:3.0:1746143769.374249:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594439424:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.374266:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a630fa00/0xe984082ccd7310d7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8474 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.374275:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a630fa00/0xe984082ccd7310d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8474 expref: 13 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.374287:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a630fa00, rc 0) 00000100:00100000:2.0:1746143769.374289:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594401024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5258us (6014us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143769.374296:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13934 00000100:00100000:3.0:1746143769.374578:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594401152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5506us (6270us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.374584:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13935 00000100:00100000:1.0:1746143769.375276:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594399488:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17171us (17435us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.375283:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6570 00002000:00100000:1.0:1746143769.375291:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009bfe2680 x1830963594399488/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.375306:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe2680 with x1830963594399488 ext(3145728->4194303) 00002000:00010000:1.0:1746143769.375310:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe2680 00000100:00100000:1.0:1746143769.378897:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594398848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20705us (20996us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.378906:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6571 00002000:00100000:1.0:1746143769.378915:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f0afb80 x1830963594398848/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.378922:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0afb80 with x1830963594398848 ext(2097152->3145727) 00002000:00010000:1.0:1746143769.378927:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0afb80 00000100:00100000:0.0:1746143769.380121:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.380122:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f0ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594399104:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21884us (22220us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.380128:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6572 00002000:00100000:1.0:1746143769.380135:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f0ac000 x1830963594399104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.380168:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f0ac000 with x1830963594399104 ext(3145728->4194303) 00002000:00010000:1.0:1746143769.380172:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f0ac000 00000100:00100000:2.0:1746143769.380257:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594401408 00000100:00100000:2.0:1746143769.380263:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594401408 00000100:00100000:2.0:1746143769.380325:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4017 00000100:00100000:2.0:1746143769.380333:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31554:x1830963594401408:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143769.380503:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31554:x1830963594401408:12345-192.168.202.48@tcp:35:cat.0 Request processed in 170us (383us total) trans 8589943647 rc 0/0 00000100:00100000:2.0:1746143769.380509:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4017 00000100:00100000:0.0:1746143769.387252:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.387323:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594401664 00000100:00100000:1.0:1746143769.387330:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594401664 00002000:00100000:1.0:1746143769.387370:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a04cdc00 x1830963594401664/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.387379:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdc00 with x1830963594401664 ext(4194304->4771839) 00002000:00010000:1.0:1746143769.387384:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cdc00 00000100:00100000:1.0:1746143769.387414:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6575 00000100:00100000:1.0:1746143769.387421:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594401664:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.391496:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1965:x1830963594401664:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4067us (4243us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746143769.391506:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6575 00002000:00100000:1.0:1746143769.391518:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800a04cdc00 x1830963594401664/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.391527:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdc00 with x1830963594401664 ext(4194304->4771839) 00002000:00010000:1.0:1746143769.391532:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cdc00 00000100:00100000:0.0:1746143769.396270:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.396707:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594401920 00000100:00100000:2.0:1746143769.396715:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594401920 00000100:00100000:2.0:1746143769.396759:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4018 00000100:00100000:2.0:1746143769.396766:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31559:x1830963594401920:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143769.396988:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31559:x1830963594401920:12345-192.168.202.48@tcp:35:cat.0 Request processed in 222us (727us total) trans 8589943648 rc 0/0 00000100:00100000:2.0:1746143769.396993:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4018 00000100:00100000:0.0:1746143769.424391:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.424861:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594402176 00000100:00100000:1.0:1746143769.424868:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594402176 00000100:00100000:1.0:1746143769.424939:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9303 00000100:00100000:1.0:1746143769.424946:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31567:x1830963594402176:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.424968:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.425007:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd7310de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a847b expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.425108:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425119:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425128:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425322:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425330:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425336:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425429:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425436:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425441:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143769.425448:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143769.425520:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425526:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425531:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425535:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63ff400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143769.425538:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425544:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425552:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143769.425554:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.425557:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425565:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd7310e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425586:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425590:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425594:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425598:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63fea00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143769.425599:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425604:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425609:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c400) 00010000:00010000:1.0:1746143769.425611:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.425613:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425616:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fea00/0xe984082ccd7310ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.425648:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd7310de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 13 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.425658:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.425667:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.425669:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143769.425671:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63fe000, rc 0) 00000100:00100000:1.0:1746143769.425728:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31567:x1830963594402176:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 782us (1345us total) trans 8589943649 rc 0/0 00000100:00100000:1.0:1746143769.425733:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9303 00000100:00100000:0.0:1746143769.488529:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.488630:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594402432 00000100:00100000:1.0:1746143769.488639:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594402432 00000100:00100000:1.0:1746143769.488728:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9304 00000100:00100000:1.0:1746143769.488735:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31569:x1830963594402432:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.488755:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.488769:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff200/0xe984082ccd731101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8482 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.488859:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488870:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488879:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488889:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488894:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488903:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488982:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488988:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.488994:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143769.489000:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143769.489062:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489068:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489074:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489078:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63fec00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143769.489081:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489087:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489095:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143769.489097:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.489100:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489108:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fec00/0xe984082ccd731108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489538:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489545:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489549:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489552:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a63ff800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143769.489554:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489558:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489565:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c000) 00010000:00010000:1.0:1746143769.489567:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143769.489569:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489573:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff800/0xe984082ccd73110f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.489608:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff200/0xe984082ccd731101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.489618:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.489627:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.489629:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143769.489631:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63fee00, rc 0) 00000100:00100000:1.0:1746143769.489696:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31569:x1830963594402432:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 961us (1173us total) trans 8589943650 rc 0/0 00000100:00100000:1.0:1746143769.489702:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9304 00000100:00100000:0.0:1746143769.510414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.510485:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594402560 00000100:00100000:3.0:1746143769.510493:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594402560 00000100:00100000:3.0:1746143769.510545:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13936 00000100:00100000:3.0:1746143769.510552:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31567:x1830963594402560:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143769.510567:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.510582:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8489 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.510611:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.510619:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 15 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.510626:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.510632:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.510634:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.510637:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2904064->3145727] (req 2904064->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.510662:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.510672:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 19 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.510682:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594439552:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.510773:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 15 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.510781:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 15 pid: 15784 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.510788:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594439680:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.510842:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.510850:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 13 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.510857:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594439808:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.510875:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.512185:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594439552:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.512192:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594439680:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.512198:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15784:1830963594439808:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.512219:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2904064->3145727] (req 2904064->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.512230:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808a800, rc 0) 00000100:00100000:3.0:1746143769.512264:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31567:x1830963594402560:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1712us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.512271:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13936 00000100:00100000:0.0:1746143769.516896:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.517297:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.517330:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.517349:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594402816 00000100:00100000:0.0:1746143769.517356:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594402816 00010000:00010000:0.0:1746143769.517388:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 14 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.517428:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594402688 00000100:00100000:0.0:1746143769.517430:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594402688 00010000:00010000:0.0:1746143769.517438:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 15 pid: 15784 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.517449:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594402944 00000100:00100000:0.0:1746143769.517451:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594402944 00010000:00010000:0.0:1746143769.517457:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 20 pid: 4582 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.517964:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7451 00000100:00100000:0.0:1746143769.517971:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594402816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.517983:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.518001:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 14 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518011:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 14 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518028:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f0e1200/0xe984082ccd730eed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8363 expref: 14 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518045:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.518075:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594402816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 106us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.518081:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7451 00000100:00100000:0.0:1746143769.518095:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7452 00000100:00100000:0.0:1746143769.518098:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594402688:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.518103:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.518109:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 15 pid: 15784 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518116:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 15 pid: 15784 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518125:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a91ec00/0xe984082ccd731052 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8419 expref: 15 pid: 15784 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518131:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.518167:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594402688:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 67us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.518171:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7452 00000100:00100000:0.0:1746143769.518199:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7453 00000100:00100000:0.0:1746143769.518203:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594402944:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.518208:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.518214:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 20 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518222:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 20 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518232:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a91ee00/0xe984082ccd731021 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e8 expref: 20 pid: 4582 timeout: 948 lvb_type: 1 00010000:00010000:0.0:1746143769.518239:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.518241:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143769.518247:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 13 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.518254:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 13 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.518274:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 13 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.518283:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594439936:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143769.518314:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.522525:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.522633:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594403200 00000100:00100000:1.0:1746143769.522640:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594403200 00002000:00100000:1.0:1746143769.522680:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2904064->2908159) req@ffff8800930dc000 x1830963594403200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.522690:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc000 with x1830963594403200 ext(2904064->2908159) 00002000:00010000:1.0:1746143769.522694:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dc000 00000100:00100000:2.0:1746143769.522711:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594439936:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143769.522726:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6576 00010000:00010000:2.0:1746143769.522729:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.522732:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594403200:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143769.522765:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594402944:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4560us (5434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.522773:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7453 00000100:00100000:1.0:1746143769.522858:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594403200:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 125us (339us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.522863:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6576 00002000:00100000:1.0:1746143769.522868:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (2904064->2908159) req@ffff8800930dc000 x1830963594403200/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.522875:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dc000 with x1830963594403200 ext(2904064->2908159) 00002000:00010000:1.0:1746143769.522877:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930dc000 00000100:00100000:0.0:1746143769.527620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.527708:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594403328 00000100:00100000:3.0:1746143769.527714:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594403328 00000100:00100000:3.0:1746143769.527762:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13937 00000100:00100000:3.0:1746143769.527769:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31567:x1830963594403328:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143769.527788:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.527802:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8490 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.527825:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.527833:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.527840:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 24 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.527846:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.527848:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.527850:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 12 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.527877:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 24 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.527886:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 24 pid: 8495 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.527896:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440064:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.528617:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.528630:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 12 pid: 6929 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.528639:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440192:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.529067:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 11 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.529075:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 11 pid: 8497 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.529082:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440320:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.529102:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.529403:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440064:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.531446:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440192:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.531456:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440320:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.531479:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->2629631] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 12 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.531492:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c000, rc 0) 00000100:00100000:3.0:1746143769.531521:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31567:x1830963594403328:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3753us (3908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.531528:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13937 00000100:00100000:0.0:1746143769.541403:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.541446:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594403968 00000100:00100000:1.0:1746143769.541453:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594403968 00000100:00100000:1.0:1746143769.541897:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9305 00000100:00100000:1.0:1746143769.541905:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31572:x1830963594403968:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:0.0:1746143769.541925:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143769.541926:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.541944:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd731132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8497 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.542004:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.542018:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594403456 00000100:00100000:0.0:1746143769.542021:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594403456 00010000:00010000:1.0:1746143769.542027:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143769.542038:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 25 pid: 8495 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.542039:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.542047:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143769.542053:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594403584 00000100:00100000:0.0:1746143769.542055:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594403584 00000004:00200000:1.0:1746143769.542056:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:0.0:1746143769.542063:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 12 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.542828:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ff400/0xe984082ccd731132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 248 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.542849:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 247 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.542856:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.542858:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143769.542860:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a63ffc00, rc 0) 00000100:00100000:1.0:1746143769.542895:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31572:x1830963594403968:12345-192.168.202.48@tcp:101:cat.0 Request processed in 992us (1500us total) trans 8589943651 rc 0/0 00000100:00100000:1.0:1746143769.542900:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9305 00000100:00100000:1.0:1746143769.542940:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.545456:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594403712 00000100:00100000:1.0:1746143769.545466:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594403712 00000100:00100000:3.0:1746143769.545489:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7454 00010000:00010000:1.0:1746143769.545495:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 12 pid: 6929 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.545503:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594403456:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143769.545516:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7455 00010000:00010000:3.0:1746143769.545520:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143769.545521:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594403584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.545527:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.545541:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 12 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:3.0:1746143769.545544:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 25 pid: 8495 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.545551:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 12 pid: 8497 timeout: 948 lvb_type: 1 00000100:00100000:2.0:1746143769.545590:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7456 00000100:00100000:2.0:1746143769.545599:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594403712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.545608:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.545806:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 25 pid: 8495 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.545825:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095386000/0xe984082ccd730edf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a836a expref: 12 pid: 8497 timeout: 948 lvb_type: 1 00010000:00010000:3.0:1746143769.545833:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009075fc00/0xe984082ccd731028 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83ef expref: 25 pid: 8495 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.545836:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143769.545941:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 12 pid: 6929 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143769.545951:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 12 pid: 6929 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143769.545964:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6346000/0xe984082ccd731059 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8420 expref: 12 pid: 6929 timeout: 948 lvb_type: 1 00010000:00010000:2.0:1746143769.545981:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.545983:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.545991:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.545999:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.546031:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 11 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.546044:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594440448:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143769.546303:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.546304:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594403584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 782us (4300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.546310:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7455 00000100:00100000:2.0:1746143769.546378:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.546917:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594403456:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1416us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.546924:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7454 00000100:00100000:2.0:1746143769.551276:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594440448:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.551292:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.551324:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1964:x1830963594403712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5727us (8383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.551333:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7456 00000100:00100000:0.0:1746143769.560455:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.560489:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.560579:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594404096 00000100:00100000:2.0:1746143769.560587:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594404096 00000100:00100000:2.0:1746143769.560627:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594404224 00000100:00100000:2.0:1746143769.560630:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594404224 00000100:00100000:2.0:1746143769.560651:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13938 00000100:00100000:2.0:1746143769.560660:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594404096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.560676:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.560692:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7b600/0xe984082ccd731147 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a849e expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.560741:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594440576:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.560907:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13939 00000100:00100000:3.0:1746143769.560916:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594404224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.560924:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.560935:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009808bc00/0xe984082ccd73114e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84a5 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.560965:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440704:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143769.561039:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800935e3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.561210:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.561507:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.561573:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594404480 00000100:00100000:3.0:1746143769.561576:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594404480 00002000:00100000:3.0:1746143769.561601:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (2625536->2629631) req@ffff88012ba29880 x1830963594404480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.561608:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29880 with x1830963594404480 ext(2625536->2629631) 00002000:00010000:3.0:1746143769.561612:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba29880 00002000:00010000:2.0:1746143769.562461:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143768 -> 1746143769 00002000:00010000:2.0:1746143769.562465:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143768 -> 1746143769 00002000:00010000:2.0:1746143769.562467:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143768 -> 1746143769 00000100:00100000:2.0:1746143769.562483:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594440576:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143769.562504:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7b600/0xe984082ccd731147 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a849e expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.562514:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7b600/0xe984082ccd731147 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a849e expref: 20 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.562528:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7b600, rc 0) 00000100:00100000:2.0:1746143769.562554:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594404096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1895us (2106us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143769.562559:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13938 00002000:00010000:2.0:1746143769.562598:0:15784:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143768 -> 1746143769 00002000:00010000:2.0:1746143769.562600:0:15784:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143768 -> 1746143769 00002000:00010000:2.0:1746143769.562601:0:15784:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143768 -> 1746143769 00000100:00100000:2.0:1746143769.562613:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440704:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143769.562632:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009808bc00/0xe984082ccd73114e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84a5 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.562641:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009808bc00/0xe984082ccd73114e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84a5 expref: 25 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.562649:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009808bc00, rc 0) 00000100:00100000:2.0:1746143769.562670:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594404224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1755us (2180us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143769.562675:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13939 00000100:00100000:1.0:1746143769.563402:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6577 00000100:00100000:1.0:1746143769.563411:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594404480:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.563531:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1963:x1830963594404480:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 122us (2024us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.563536:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6577 00002000:00100000:1.0:1746143769.563542:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2625536->2629631) req@ffff88012ba29880 x1830963594404480/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.563550:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba29880 with x1830963594404480 ext(2625536->2629631) 00002000:00010000:1.0:1746143769.563553:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba29880 00000100:00100000:0.0:1746143769.568550:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.568615:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594404736 00000100:00100000:2.0:1746143769.568622:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594404736 00000100:00100000:2.0:1746143769.568672:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4019 00000100:00100000:2.0:1746143769.568679:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31567:x1830963594404736:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143769.569288:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31567:x1830963594404736:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 609us (745us total) trans 8589943652 rc 0/0 00000100:00100000:2.0:1746143769.569299:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4019 00000100:00100000:0.0:1746143769.575947:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.575981:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.576022:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.576050:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405120 00000100:00100000:2.0:1746143769.576052:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594404864 00000100:00100000:3.0:1746143769.576057:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405120 00000100:00100000:2.0:1746143769.576057:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594404864 00002000:00100000:3.0:1746143769.576092:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1765375) req@ffff88009bfe1880 x1830963594405120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143769.576096:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13940 00002000:00100000:3.0:1746143769.576101:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830963594405120 ext(1048576->1765375) 00000100:00100000:2.0:1746143769.576102:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31569:x1830963594404864:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:1.0:1746143769.576102:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405376 00000100:00100000:1.0:1746143769.576105:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405376 00002000:00010000:3.0:1746143769.576106:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1880 00010000:00010000:2.0:1746143769.576113:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143769.576120:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6578 00002000:00100000:1.0:1746143769.576120:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1552384->2097151) req@ffff880090764a80 x1830963594405376/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143769.576125:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594405120:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:2.0:1746143769.576131:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84ac expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143769.576137:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764a80 with x1830963594405376 ext(1552384->2097151) 00002000:00010000:1.0:1746143769.576166:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090764a80 00000100:00100000:1.0:1746143769.576177:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6579 00000100:00100000:1.0:1746143769.576182:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594405376:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:2.0:1746143769.576183:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.576190:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143769.576192:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143769.576194:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3637248->4194303] (req 3637248->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 27 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.576217:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 10 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.576227:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 10 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.576237:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440832:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143769.576300:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.582871:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594440832:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143769.582897:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3637248->4194303] (req 3637248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.582897:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594405376:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 6714us (6873us total) trans 0 rc 544768/544768 00000100:00100000:1.0:1746143769.582905:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6579 00010000:00010000:2.0:1746143769.582911:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7a200, rc 0) 00002000:00100000:1.0:1746143769.582912:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x357:0x0] (1552384->2097151) req@ffff880090764a80 x1830963594405376/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 544768/544768 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.582920:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764a80 with x1830963594405376 ext(1552384->2097151) 00002000:00010000:1.0:1746143769.582924:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090764a80 00000100:00100000:2.0:1746143769.582925:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31569:x1830963594404864:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6823us (6986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.582930:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13940 00000100:00100000:0.0:1746143769.583007:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.583041:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405504 00000100:00100000:1.0:1746143769.583046:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405504 00002000:00100000:1.0:1746143769.583069:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2629631) req@ffff880090765c00 x1830963594405504/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.583076:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765c00 with x1830963594405504 ext(2097152->2629631) 00010000:00010000:1.0:1746143769.583081:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 11 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.583093:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 11 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.583098:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090765c00 00000100:00100000:1.0:1746143769.583122:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1857 00000100:00100000:1.0:1746143769.583128:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:1965:x1830963594405504:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143769.584733:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594405120:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8603us (8745us total) trans 0 rc 716800/716800 00000100:00100000:3.0:1746143769.584740:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6578 00002000:00100000:3.0:1746143769.584746:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1765375) req@ffff88009bfe1880 x1830963594405120/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 716800/716800 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.584754:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1880 with x1830963594405120 ext(1048576->1765375) 00002000:00010000:3.0:1746143769.584758:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe1880 00000100:00100000:0.0:1746143769.596167:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.596205:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.596229:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405632 00000100:00100000:2.0:1746143769.596236:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405632 00000100:00100000:2.0:1746143769.596275:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405760 00000100:00100000:2.0:1746143769.596277:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405760 00000100:00100000:2.0:1746143769.596297:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13941 00000100:00100000:2.0:1746143769.596304:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594405632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.596317:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.596331:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7a600/0xe984082ccd73115c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84b3 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.596614:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594405504:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 13484us (13605us total) trans 17179873219 rc 0/0 00000100:00100000:1.0:1746143769.596622:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1857 00002000:00100000:1.0:1746143769.596630:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2629631) req@ffff880090765c00 x1830963594405504/t17179873219(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.596639:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765c00 with x1830963594405504 ext(2097152->2629631) 00010000:00010000:1.0:1746143769.596646:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.596655:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.596661:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090765c00 00000100:00100000:0.0:1746143769.597369:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13942 00000100:00100000:0.0:1746143769.597376:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594405760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143769.597384:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.597391:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd731163 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84ba expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143769.597427:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594440960:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143769.597481:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.597618:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594441088:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143769.597661:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.602779:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.602851:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594405888 00000100:00100000:2.0:1746143769.602859:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594405888 00010000:00010000:2.0:1746143769.602890:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.602928:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7457 00000100:00100000:2.0:1746143769.602935:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1964:x1830963594405888:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.602948:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.602969:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.602979:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.602998:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.602999:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.603006:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.603013:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.603039:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 26 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.603050:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594441216:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.603129:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.603406:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594441088:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.603428:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7a600/0xe984082ccd73115c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84b3 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.603439:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7a600/0xe984082ccd73115c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84b3 expref: 20 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.603454:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7a600, rc 0) 00000100:00100000:3.0:1746143769.603486:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594405632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7183us (7349us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.603493:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13941 00010000:00010000:2.0:1746143769.604701:0:8495:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff880090764700 x1830963594440960) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.604719:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd73112b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8490 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.604748:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090764700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594440960:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143769.604768:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd731163 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ba expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.604777:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093327600/0xe984082ccd731163 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ba expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.604784:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093327600, rc 0) 00000100:00100000:2.0:1746143769.604807:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594405760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7432us (8601us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.604809:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0879f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594441216:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.604813:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13942 00010000:00010000:3.0:1746143769.604818:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.604853:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594405888:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1918us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.604865:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7457 00000100:00100000:0.0:1746143769.605793:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.606528:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406144 00000100:00100000:1.0:1746143769.606535:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406144 00000100:00100000:1.0:1746143769.606876:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9306 00000100:00100000:1.0:1746143769.606883:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31577:x1830963594406144:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.606902:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.606913:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb800/0xe984082ccd73116a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84c1 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.606991:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.607003:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.607011:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:1.0:1746143769.607021:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:0.0:1746143769.607303:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafb800/0xe984082ccd73116a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.607311:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143769.607331:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.607342:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:0.0:1746143769.607345:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746143769.607347:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fafa000, rc 0) 00000100:00100000:0.0:1746143769.607434:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31577:x1830963594406144:12345-192.168.202.48@tcp:101:cat.0 Request processed in 552us (1644us total) trans 8589943653 rc 0/0 00000100:00100000:0.0:1746143769.607441:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9306 00000100:00100000:1.0:1746143769.607507:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406400 00000100:00100000:1.0:1746143769.607510:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406400 00002000:00100000:1.0:1746143769.607533:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3637248->3641343) req@ffff8800a0878a80 x1830963594406400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.607541:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878a80 with x1830963594406400 ext(3637248->3641343) 00002000:00010000:1.0:1746143769.607545:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0878a80 00000100:00100000:1.0:1746143769.607568:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6580 00000100:00100000:1.0:1746143769.607574:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594406400:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.607615:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.607631:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406528 00000100:00100000:2.0:1746143769.607633:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406528 00000100:00100000:2.0:1746143769.607650:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13943 00000100:00100000:2.0:1746143769.607653:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:31572:x1830963594406528:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.607660:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.607668:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84c8 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.607684:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 13 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.607689:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594406400:12345-192.168.202.48@tcp:3:cat.0 Request processed in 116us (378us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746143769.607690:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143769.607693:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746143769.607695:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6580 00010000:00010000:2.0:1746143769.607696:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143769.607700:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3637248->3641343) req@ffff8800a0878a80 x1830963594406400/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.607705:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0878a80 with x1830963594406400 ext(3637248->3641343) 00002000:00010000:1.0:1746143769.607708:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0878a80 00010000:00010000:2.0:1746143769.607716:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 13 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.607726:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 13 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.607735:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594441344:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143769.608235:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.610265:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.610330:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.610380:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594441344:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143769.610402:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.610416:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7ac00, rc 0) 00000100:00100000:2.0:1746143769.610453:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31572:x1830963594406528:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2798us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.610460:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13943 00000100:00100000:3.0:1746143769.610516:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406656 00000100:00100000:3.0:1746143769.610522:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406656 00002000:00100000:3.0:1746143769.610547:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2904064->3145727) req@ffff880090764380 x1830963594406656/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.610556:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963594406656 ext(2904064->3145727) 00010000:00010000:3.0:1746143769.610561:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 14 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.610572:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 14 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143769.610579:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090764380 00000100:00100000:3.0:1746143769.610603:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1858 00000100:00100000:3.0:1746143769.610609:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594406656:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143769.610658:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.610799:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406784 00000100:00100000:2.0:1746143769.610802:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406784 00000100:00100000:2.0:1746143769.610819:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13944 00000100:00100000:2.0:1746143769.610823:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1965:x1830963594406784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.610830:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.610840:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7a400/0xe984082ccd731186 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84cf expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.610876:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594441472:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143769.610927:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.611215:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.611244:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.611305:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594406912 00000100:00100000:3.0:1746143769.611309:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594406912 00000100:00100000:3.0:1746143769.611326:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407040 00000100:00100000:3.0:1746143769.611327:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407040 00000100:00100000:3.0:1746143769.611337:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407168 00000100:00100000:3.0:1746143769.611338:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407168 00000100:00100000:3.0:1746143769.611350:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13945 00000100:00100000:3.0:1746143769.611354:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594406912:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.611359:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.611366:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a6c00/0xe984082ccd73118d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84d6 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.611387:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594441600:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.611414:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.611427:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13946 00000100:00100000:3.0:1746143769.611431:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594407040:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.611436:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.611443:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a7800/0xe984082ccd731194 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84dd expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.611459:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594441728:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.611472:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.611482:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13947 00000100:00100000:3.0:1746143769.611485:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594407168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.611489:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.611494:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a7c00/0xe984082ccd73119b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84e4 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.611514:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594441856:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.611528:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.614085:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594441472:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143769.614112:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7a400/0xe984082ccd731186 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84cf expref: 17 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.614124:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7a400/0xe984082ccd731186 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84cf expref: 17 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.614133:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7a400, rc 0) 00000100:00100000:2.0:1746143769.614192:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594406784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3367us (3861us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143769.614199:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13944 00000100:00100000:3.0:1746143769.614496:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594441856:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.614512:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a7c00/0xe984082ccd73119b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84e4 expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.614521:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a7c00/0xe984082ccd73119b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84e4 expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.614533:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a7c00, rc 0) 00000100:00100000:3.0:1746143769.614551:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1964:x1830963594407168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3065us (3307us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.614557:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13947 00000100:00100000:3.0:1746143769.614588:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594441728:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.614601:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a7800/0xe984082ccd731194 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84dd expref: 17 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.614610:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a7800/0xe984082ccd731194 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84dd expref: 17 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.614617:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a7800, rc 0) 00000100:00100000:3.0:1746143769.614629:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594407040:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3198us (3415us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.614634:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13946 00000100:00100000:3.0:1746143769.614656:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594441600:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.614666:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a6c00/0xe984082ccd73118d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84d6 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.614673:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a6c00/0xe984082ccd73118d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84d6 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.614679:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a6c00, rc 0) 00000100:00100000:3.0:1746143769.614690:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:1964:x1830963594406912:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3336us (4032us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.614694:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13945 00000100:00100000:0.0:1746143769.617192:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.617370:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407296 00000100:00100000:2.0:1746143769.617377:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407296 00000100:00100000:2.0:1746143769.617417:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13948 00000100:00100000:2.0:1746143769.617423:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:31569:x1830963594407296:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143769.617436:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.617447:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84eb expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.617466:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143769.617468:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143769.617471:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4284415] (req 4194304->4284415) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.617486:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->4284415] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 21 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.617494:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7b200, rc 0) 00000100:00100000:2.0:1746143769.617532:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31569:x1830963594407296:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.617537:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13948 00000100:00100000:3.0:1746143769.618235:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594406656:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 7624us (7973us total) trans 21474840547 rc 0/0 00000100:00100000:3.0:1746143769.618243:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1858 00002000:00100000:3.0:1746143769.618251:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (2904064->3145727) req@ffff880090764380 x1830963594406656/t21474840547(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.618259:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764380 with x1830963594406656 ext(2904064->3145727) 00010000:00010000:3.0:1746143769.618265:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 16 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.618275:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 16 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143769.618281:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090764380 00000100:00100000:0.0:1746143769.619716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.619811:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407552 00000100:00100000:3.0:1746143769.619817:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407552 00002000:00100000:3.0:1746143769.619844:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880090766a00 x1830963594407552/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.619851:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963594407552 ext(0->1048575) 00002000:00010000:3.0:1746143769.619855:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090766a00 00000100:00100000:3.0:1746143769.619911:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6581 00000100:00100000:3.0:1746143769.619917:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594407552:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.620215:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.620344:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407680 00000100:00100000:3.0:1746143769.620348:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407680 00010000:00010000:3.0:1746143769.620363:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 17 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.620379:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7458 00000100:00100000:3.0:1746143769.620385:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594407680:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.620392:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.620403:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 17 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.620412:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 17 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.620429:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009808a800/0xe984082ccd731124 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2904064->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8489 expref: 17 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.620441:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.620443:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.620448:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.620455:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.620462:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.620463:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.620466:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.620472:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.620497:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.620507:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594441984:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143769.620672:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 20 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.620680:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594442112:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143769.620700:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.625764:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.625953:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594441984:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143769.626017:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594407936 00000100:00100000:1.0:1746143769.626026:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594407936 00002000:00100000:1.0:1746143769.626056:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4280320->4284415) req@ffff880090767800 x1830963594407936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.626065:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767800 with x1830963594407936 ext(4280320->4284415) 00002000:00010000:1.0:1746143769.626069:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767800 00000100:00100000:1.0:1746143769.626083:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6582 00000100:00100000:1.0:1746143769.626089:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594407936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.627098:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594407936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 1007us (1338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.627104:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6582 00002000:00100000:1.0:1746143769.627110:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4280320->4284415) req@ffff880090767800 x1830963594407936/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.627116:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767800 with x1830963594407936 ext(4280320->4284415) 00002000:00010000:1.0:1746143769.627119:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767800 00000100:00100000:3.0:1746143769.628383:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594442112:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143769.628402:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.628439:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594407680:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8053us (8223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.628447:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7458 00000100:00100000:3.0:1746143769.629989:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594407552:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10067us (10272us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.629997:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6581 00002000:00100000:3.0:1746143769.630005:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff880090766a00 x1830963594407552/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.630013:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766a00 with x1830963594407552 ext(0->1048575) 00002000:00010000:3.0:1746143769.630017:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090766a00 00000100:00100000:0.0:1746143769.630594:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.630707:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408192 00000100:00100000:2.0:1746143769.630713:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408192 00000100:00100000:2.0:1746143769.630743:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4020 00000100:00100000:2.0:1746143769.630750:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31569:x1830963594408192:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143769.630917:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31569:x1830963594408192:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 167us (323us total) trans 8589943654 rc 0/0 00000100:00100000:2.0:1746143769.630923:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4020 00000100:00100000:0.0:1746143769.635756:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.635791:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.635806:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.635829:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408448 00000100:00100000:0.0:1746143769.635837:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408448 00002000:00100000:0.0:1746143769.635877:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880090767100 x1830963594408448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.635886:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767100 with x1830963594408448 ext(2097152->3145727) 00002000:00010000:0.0:1746143769.635890:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767100 00000100:00100000:0.0:1746143769.635904:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408704 00000100:00100000:0.0:1746143769.635907:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408704 00002000:00100000:0.0:1746143769.635918:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880090764700 x1830963594408704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.635924:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764700 with x1830963594408704 ext(2097152->3145727) 00002000:00010000:0.0:1746143769.635927:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090764700 00000100:00100000:0.0:1746143769.635935:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594408832 00000100:00100000:0.0:1746143769.635937:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594408832 00002000:00100000:0.0:1746143769.635945:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b79f480 x1830963594408832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.635951:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f480 with x1830963594408832 ext(3145728->4194303) 00002000:00010000:0.0:1746143769.635953:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79f480 00000100:00100000:0.0:1746143769.635963:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6583 00000100:00100000:0.0:1746143769.635968:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594408448:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.637226:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.637659:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409216 00000100:00100000:3.0:1746143769.637664:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409216 00002000:00100000:3.0:1746143769.637687:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3637247) req@ffff88012b79e680 x1830963594409216/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.637695:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79e680 with x1830963594409216 ext(3145728->3637247) 00002000:00010000:3.0:1746143769.637699:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79e680 00000100:00100000:3.0:1746143769.637713:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6584 00000100:00100000:3.0:1746143769.637718:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594408704:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.638076:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6585 00000100:00100000:1.0:1746143769.638084:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594408832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.639100:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6586 00000100:00100000:2.0:1746143769.639108:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594409216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.641461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.641645:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409344 00000100:00100000:0.0:1746143769.641651:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409344 00000100:00100000:0.0:1746143769.641683:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13949 00000100:00100000:0.0:1746143769.641688:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31577:x1830963594409344:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143769.641700:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.641714:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84f2 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.641736:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.641743:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143769.641744:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143769.641747:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.641770:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.641780:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 28 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:0.0:1746143769.641790:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594442240:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143769.642451:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.646408:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594442240:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143769.646431:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 13 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.646445:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a07ddc00, rc 0) 00000100:00100000:0.0:1746143769.648419:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31577:x1830963594409344:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6723us (6956us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.648429:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13949 00000100:00100000:2.0:1746143769.648558:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.648654:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409472 00000100:00100000:3.0:1746143769.648662:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409472 00002000:00100000:3.0:1746143769.648695:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1765376->2097151) req@ffff880094c10a80 x1830963594409472/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.648705:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963594409472 ext(1765376->2097151) 00010000:00010000:3.0:1746143769.648713:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 29 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.648731:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 29 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143769.648737:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c10a80 00000100:00100000:3.0:1746143769.648752:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1859 00000100:00100000:3.0:1746143769.648759:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594409472:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143769.650672:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594408448:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14698us (14922us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143769.650681:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6583 00002000:00100000:0.0:1746143769.650689:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880090767100 x1830963594408448/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.650698:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767100 with x1830963594408448 ext(2097152->3145727) 00002000:00010000:0.0:1746143769.650702:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090767100 00000100:00100000:1.0:1746143769.657940:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594408832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19849us (22124us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.657949:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6585 00002000:00100000:1.0:1746143769.657960:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012b79f480 x1830963594408832/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.657968:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79f480 with x1830963594408832 ext(3145728->4194303) 00002000:00010000:1.0:1746143769.657973:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79f480 00000100:00100000:3.0:1746143769.660099:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594409472:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11337us (11537us total) trans 17179873220 rc 0/0 00000100:00100000:3.0:1746143769.660108:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1859 00002000:00100000:3.0:1746143769.660115:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1765376->2097151) req@ffff880094c10a80 x1830963594409472/t17179873220(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.660123:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094c10a80 with x1830963594409472 ext(1765376->2097151) 00010000:00010000:3.0:1746143769.660131:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 31 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.660184:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 31 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:3.0:1746143769.660190:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094c10a80 00000100:00100000:2.0:1746143769.662542:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594409216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23430us (25314us total) trans 0 rc 491520/491520 00000100:00100000:2.0:1746143769.662551:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6586 00002000:00100000:2.0:1746143769.662559:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3145728->3637247) req@ffff88012b79e680 x1830963594409216/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 491520/491520 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.662567:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79e680 with x1830963594409216 ext(3145728->3637247) 00002000:00010000:2.0:1746143769.662572:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79e680 00000100:00100000:0.0:1746143769.662767:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.662873:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594408704:12345-192.168.202.48@tcp:3:cat.0 Request processed in 25153us (27079us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.662879:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6584 00002000:00100000:3.0:1746143769.662884:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880090764700 x1830963594408704/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.662891:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090764700 with x1830963594408704 ext(2097152->3145727) 00002000:00010000:3.0:1746143769.662894:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090764700 00000100:00100000:3.0:1746143769.662911:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409600 00000100:00100000:3.0:1746143769.662916:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409600 00010000:00010000:3.0:1746143769.662935:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 27 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.662953:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7459 00000100:00100000:3.0:1746143769.662958:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594409600:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.662967:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.662981:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 27 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.662991:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 27 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.663008:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a91fa00/0xe984082ccd731044 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a840b expref: 27 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.663472:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.663474:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.663481:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.663489:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.663520:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 12 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.663530:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594442368:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143769.663722:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.667321:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594442368:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143769.667341:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.667388:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594409600:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4428us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.667397:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7459 00000100:00100000:0.0:1746143769.670310:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.670331:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409856 00000100:00100000:0.0:1746143769.670332:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.670338:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409856 00000100:00100000:2.0:1746143769.670366:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410112 00000100:00100000:2.0:1746143769.670367:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410112 00000100:00100000:2.0:1746143769.670380:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13950 00000100:00100000:2.0:1746143769.670386:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1962:x1830963594409856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.670400:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.670413:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a84f9 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.670420:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13951 00000100:00100000:3.0:1746143769.670427:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594410112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.670431:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.670433:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.670435:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.670439:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 27 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.670445:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61ffa00/0xe984082ccd7311b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8500 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.670451:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 27 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143769.670460:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a7b600, rc 0) 00000100:00100000:3.0:1746143769.670477:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594442496:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143769.670774:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.671026:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594409856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 638us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.671032:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13950 00000100:00100000:3.0:1746143769.671055:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801368be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.671072:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594409984 00000100:00100000:3.0:1746143769.671075:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594409984 00002000:00100000:3.0:1746143769.671098:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012b79d180 x1830963594409984/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.671106:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79d180 with x1830963594409984 ext(1048576->2097151) 00002000:00010000:3.0:1746143769.671109:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79d180 00000100:00100000:3.0:1746143769.671121:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6587 00000100:00100000:3.0:1746143769.671125:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594409984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143769.674595:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594442496:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.674624:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61ffa00/0xe984082ccd7311b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8500 expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.674636:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61ffa00/0xe984082ccd7311b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8500 expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.674663:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ffa00, rc 0) 00000100:00100000:3.0:1746143769.674703:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594410112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4276us (4369us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.674710:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13951 00000100:00100000:3.0:1746143769.677763:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:1965:x1830963594409984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6629us (6981us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.677772:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6587 00002000:00100000:3.0:1746143769.677782:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88012b79d180 x1830963594409984/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.677790:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79d180 with x1830963594409984 ext(1048576->2097151) 00002000:00010000:3.0:1746143769.677795:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b79d180 00000100:00100000:0.0:1746143769.678210:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.678273:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410368 00000100:00100000:3.0:1746143769.678280:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410368 00002000:00100000:3.0:1746143769.678306:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4284416->4771839) req@ffff88012b79c000 x1830963594410368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.678313:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c000 with x1830963594410368 ext(4284416->4771839) 00002000:00010000:3.0:1746143769.678317:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c000 00000100:00100000:3.0:1746143769.678370:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6588 00000100:00100000:3.0:1746143769.678377:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594410368:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.683523:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.684004:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410496 00000100:00100000:3.0:1746143769.684011:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410496 00000100:00100000:3.0:1746143769.684045:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13952 00000100:00100000:3.0:1746143769.684052:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31577:x1830963594410496:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.684066:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.684079:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8507 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.684103:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.684109:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143769.684111:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143769.684114:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.684136:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 26 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.684180:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 26 pid: 6929 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.684189:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594442624:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.684257:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.684447:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594410368:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6070us (6237us total) trans 0 rc 487424/487424 00000100:00100000:2.0:1746143769.684455:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6588 00002000:00100000:2.0:1746143769.684462:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (4284416->4771839) req@ffff88012b79c000 x1830963594410368/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 487424/487424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.684476:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c000 with x1830963594410368 ext(4284416->4771839) 00002000:00010000:2.0:1746143769.684480:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79c000 00000100:00100000:3.0:1746143769.686073:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594442624:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.686091:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 14 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.686105:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ff600, rc 0) 00000100:00100000:3.0:1746143769.686274:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31577:x1830963594410496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2221us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.686281:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13952 00000100:00100000:0.0:1746143769.687641:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.687755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.687792:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.687843:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410752 00000100:00100000:3.0:1746143769.687849:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410880 00000100:00100000:1.0:1746143769.687850:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410752 00000100:00100000:3.0:1746143769.687853:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410880 00000100:00100000:2.0:1746143769.687874:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594410624 00000100:00100000:2.0:1746143769.687880:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594410624 00000100:00100000:3.0:1746143769.687891:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13953 00000100:00100000:3.0:1746143769.687896:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594410880:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143769.687896:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13954 00000100:00100000:1.0:1746143769.687903:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594410752:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.687910:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.687911:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.687922:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd7311cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8515 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.687922:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941d8800/0xe984082ccd7311c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a850e expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143769.687927:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1552383) req@ffff88012b79fb80 x1830963594410624/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.687937:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79fb80 with x1830963594410624 ext(1048576->1552383) 00010000:00010000:2.0:1746143769.687942:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 29 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.687953:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 29 pid: 6929 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.687958:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594442752:192.168.202.48@tcp:106: 00002000:00010000:2.0:1746143769.687959:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79fb80 00000100:00100000:1.0:1746143769.687961:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594442880:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.688005:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.688011:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.688026:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1860 00000100:00100000:2.0:1746143769.688033:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594410624:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:1.0:1746143769.691629:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594442880:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143769.691657:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941d8800/0xe984082ccd7311c5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a850e expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.691668:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941d8800/0xe984082ccd7311c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a850e expref: 30 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.691690:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d8800, rc 0) 00000100:00100000:1.0:1746143769.691735:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594410752:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3832us (4096us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143769.691743:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13954 00000100:00100000:3.0:1746143769.691946:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594442752:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.691962:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd7311cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8515 expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.691971:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd7311cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8515 expref: 22 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.691982:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ff000, rc 0) 00000100:00100000:3.0:1746143769.692017:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594410880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4120us (4224us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.692022:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13953 00000100:00100000:0.0:1746143769.693989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.694046:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594411136 00000100:00100000:1.0:1746143769.694052:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594411136 00000100:00100000:1.0:1746143769.694098:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9307 00000100:00100000:1.0:1746143769.694105:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31580:x1830963594411136:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143769.694123:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.694135:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd7311d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a851c expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.694254:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.694266:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.694272:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 247 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.694277:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.694300:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 247 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.694308:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 247 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.694319:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594443008:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143769.694389:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.694400:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 16 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.694407:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594443136:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143769.694423:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.695388:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.696893:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.696894:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594411264 00000100:00100000:3.0:1746143769.696899:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594411264 00000100:00100000:3.0:1746143769.696929:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13955 00000100:00100000:0.0:1746143769.696930:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594411392 00000100:00100000:0.0:1746143769.696933:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594411392 00000100:00100000:3.0:1746143769.696936:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594411264:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.696946:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143769.696952:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13956 00000100:00100000:0.0:1746143769.696956:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594411392:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.696957:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61ffc00/0xe984082ccd7311e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8523 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143769.696962:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143769.696969:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc200/0xe984082ccd7311e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a852a expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.696992:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594443264:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143769.696992:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594443392:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143769.697044:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.697045:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.697187:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594443008:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143769.697196:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594443136:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143769.697212:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143769.698113:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594410624:12345-192.168.202.48@tcp:4:cat.0 Request processed in 10078us (10356us total) trans 17179873221 rc 0/0 00000100:00100000:2.0:1746143769.698121:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1860 00002000:00100000:2.0:1746143769.698128:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->1552383) req@ffff88012b79fb80 x1830963594410624/t17179873221(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.698165:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79fb80 with x1830963594410624 ext(1048576->1552383) 00010000:00010000:2.0:1746143769.698171:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 31 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.698182:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 31 pid: 6929 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.698188:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79fb80 00000100:00100000:0.0:1746143769.698867:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.698905:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.698974:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594411648 00000100:00100000:3.0:1746143769.698978:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594411648 00010000:00010000:3.0:1746143769.698996:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 17 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.699014:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594411520 00000100:00100000:3.0:1746143769.699016:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594411520 00010000:00010000:3.0:1746143769.699025:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 248 pid: 14762 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.699048:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7460 00000100:00100000:3.0:1746143769.699054:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594411648:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.699063:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.699068:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 17 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.699075:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 17 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.699090:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fe000/0xe984082ccd7310f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a847b expref: 17 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.699100:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.699104:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.699110:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.699114:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.699132:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594411648:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.699136:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7460 00000100:00100000:1.0:1746143769.699174:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7461 00000100:00100000:1.0:1746143769.699181:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1964:x1830963594411520:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.699187:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.699192:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 248 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.699199:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 248 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.699213:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63fee00/0xe984082ccd731116 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8482 expref: 248 pid: 14762 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.699222:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143769.699225:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.699231:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.699239:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143769.699262:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.699279:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1964:x1830963594411520:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.699285:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7461 00010000:00010000:2.0:1746143769.699337:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.699344:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143769.699362:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143769.699460:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9800/0xe984082ccd7311d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 17 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.699488:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.699494:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.699496:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143769.699498:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d9400, rc 0) 00000100:00100000:2.0:1746143769.699524:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31580:x1830963594411136:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5419us (5540us total) trans 8589943655 rc 0/0 00000100:00100000:2.0:1746143769.699530:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9307 00000100:00100000:3.0:1746143769.699759:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594443264:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.699777:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61ffc00/0xe984082ccd7311e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8523 expref: 30 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.699786:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ffc00/0xe984082ccd7311e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8523 expref: 30 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.699793:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ffc00, rc 0) 00000100:00100000:3.0:1746143769.699812:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594411264:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2877us (4425us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.699821:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13955 00000100:00100000:1.0:1746143769.700202:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594443392:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143769.700218:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc200/0xe984082ccd7311e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a852a expref: 22 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.700227:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc200/0xe984082ccd7311e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a852a expref: 22 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.700234:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02bc200, rc 0) 00000100:00100000:1.0:1746143769.700268:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594411392:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3311us (3377us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143769.700273:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13956 00000100:00100000:0.0:1746143769.702521:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.702556:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.702575:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594411776 00000100:00100000:2.0:1746143769.702580:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594411776 00010000:00010000:2.0:1746143769.702603:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 29 pid: 6929 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.702620:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594411904 00000100:00100000:1.0:1746143769.702624:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594411904 00000100:00100000:2.0:1746143769.702628:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7462 00000100:00100000:2.0:1746143769.702633:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594411776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.702642:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143769.702645:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13957 00000100:00100000:1.0:1746143769.702651:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31580:x1830963594411904:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143769.702656:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 29 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.702661:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.702664:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 29 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.702670:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8531 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.702678:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347000/0xe984082ccd731060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1552383) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8427 expref: 29 pid: 6929 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.702686:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.702687:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.702689:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.702692:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143769.702693:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.702694:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.702697:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2596864->2695167] (req 2596864->2695167) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.702699:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.702716:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 28 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.702718:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.702725:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 28 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.702728:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594443648:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143769.702733:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594443520:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143769.702776:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.703659:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.704038:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594443648:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.704050:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.704113:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594411776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1477us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.704119:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7462 00000100:00100000:1.0:1746143769.705161:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594443520:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143769.705180:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2596864->2695167] (req 2596864->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 15 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.705193:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6dee00, rc 0) 00000100:00100000:1.0:1746143769.705287:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31580:x1830963594411904:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2565us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.705294:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13957 00000100:00100000:0.0:1746143769.705802:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.706210:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412032 00000100:00100000:2.0:1746143769.706215:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412032 00002000:00100000:2.0:1746143769.706242:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3637248->4194303) req@ffff88009e5cca80 x1830963594412032/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.706250:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cca80 with x1830963594412032 ext(3637248->4194303) 00010000:00010000:2.0:1746143769.706255:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 28 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.706265:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 28 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.706270:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e5cca80 00000100:00100000:2.0:1746143769.706482:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1861 00000100:00100000:2.0:1746143769.706489:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594412032:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143769.707868:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.707958:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412288 00000100:00100000:3.0:1746143769.707963:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412288 00002000:00100000:3.0:1746143769.707984:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009e5cce00 x1830963594412288/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.707991:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cce00 with x1830963594412288 ext(1048576->2097151) 00002000:00010000:3.0:1746143769.707994:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cce00 00000100:00100000:3.0:1746143769.708007:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6589 00000100:00100000:3.0:1746143769.708012:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594412288:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143769.715243:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594412288:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7222us (7367us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.715255:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6589 00002000:00100000:3.0:1746143769.715265:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009e5cce00 x1830963594412288/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.715274:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cce00 with x1830963594412288 ext(1048576->2097151) 00002000:00010000:3.0:1746143769.715279:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cce00 00000100:00100000:2.0:1746143769.718009:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594412032:12345-192.168.202.48@tcp:4:cat.0 Request processed in 11513us (12201us total) trans 17179873222 rc 0/0 00000100:00100000:2.0:1746143769.718018:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1861 00002000:00100000:2.0:1746143769.718027:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3637248->4194303) req@ffff88009e5cca80 x1830963594412032/t17179873222(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.718035:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cca80 with x1830963594412032 ext(3637248->4194303) 00010000:00010000:2.0:1746143769.718045:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 30 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.718058:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 30 pid: 15784 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.718066:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e5cca80 00000100:00100000:0.0:1746143769.721387:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.721434:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.721632:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412416 00000100:00100000:3.0:1746143769.721639:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412544 00000100:00100000:1.0:1746143769.721639:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412416 00000100:00100000:3.0:1746143769.721643:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412544 00000100:00100000:3.0:1746143769.721676:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13958 00000100:00100000:3.0:1746143769.721682:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594412544:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143769.721692:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13959 00010000:00010000:3.0:1746143769.721695:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143769.721697:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594412416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.721705:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.721709:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f89ca00/0xe984082ccd7311fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a853f expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.721714:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd2da00/0xe984082ccd731204 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8538 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.721752:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594443904:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143769.721752:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594443776:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.721955:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.721987:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.722015:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.722101:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412672 00000100:00100000:2.0:1746143769.722105:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412672 00010000:00010000:2.0:1746143769.722122:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 30 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.722179:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7463 00000100:00100000:2.0:1746143769.722186:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594412672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.722194:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.722209:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 30 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.722219:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 30 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.722236:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.722237:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.722243:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.722250:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.722276:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.722284:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594444032:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.722329:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7780 going to sleep for 11 seconds 00010000:00010000:3.0:1746143769.723298:0:8497:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.48@tcp) returned -22 from glimpse AST (req@ffff880130fd5500 x1830963594443904) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 30 pid: 15784 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.723307:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594443776:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.723315:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7a200/0xe984082ccd731155 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3637248->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84ac expref: 30 pid: 15784 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.723325:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2da00/0xe984082ccd731204 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8538 expref: 16 pid: 2839 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143769.723330:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594443904:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143769.723335:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2da00/0xe984082ccd731204 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8538 expref: 16 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.723345:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f89ca00/0xe984082ccd7311fd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a853f expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.723353:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f89ca00/0xe984082ccd7311fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a853f expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.723356:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2da00, rc 0) 00010000:00010000:3.0:1746143769.723360:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f89ca00, rc 0) 00000100:00100000:3.0:1746143769.723379:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594412544:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1698us (1945us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143769.723379:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594412416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1681us (1999us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.723386:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13958 00000100:00100000:1.0:1746143769.723466:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13959 00000100:00100000:0.0:1746143769.724036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.724120:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594444032:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.724130:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.724182:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594412672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1996us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.724189:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7463 00000100:00100000:3.0:1746143769.724241:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594412928 00000100:00100000:3.0:1746143769.724245:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594412928 00002000:00100000:3.0:1746143769.724269:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2596864->2600959) req@ffff8800935a1500 x1830963594412928/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.724277:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1500 with x1830963594412928 ext(2596864->2600959) 00002000:00010000:3.0:1746143769.724282:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a1500 00000100:00100000:3.0:1746143769.724294:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6590 00000100:00100000:3.0:1746143769.724299:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594412928:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143769.724399:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594412928:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 100us (363us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143769.724405:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6590 00002000:00100000:3.0:1746143769.724409:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2596864->2600959) req@ffff8800935a1500 x1830963594412928/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.724416:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a1500 with x1830963594412928 ext(2596864->2600959) 00002000:00010000:3.0:1746143769.724418:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a1500 00000100:00100000:0.0:1746143769.725508:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.725562:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594413056 00000100:00100000:1.0:1746143769.725569:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594413056 00000100:00100000:1.0:1746143769.725603:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13960 00000100:00100000:1.0:1746143769.725609:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31577:x1830963594413056:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.725618:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.725629:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8546 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.725645:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.725646:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.725651:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.725663:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.725670:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd2c000, rc 0) 00000100:00100000:1.0:1746143769.725765:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31577:x1830963594413056:12345-192.168.202.48@tcp:101:cat.0 Request processed in 156us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.725771:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13960 00000100:00100000:0.0:1746143769.726591:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.726628:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594413312 00000100:00100000:2.0:1746143769.726632:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594413312 00002000:00100000:2.0:1746143769.726653:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2691072->2695167) req@ffff8800935a0a80 x1830963594413312/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.726659:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0a80 with x1830963594413312 ext(2691072->2695167) 00002000:00010000:2.0:1746143769.726662:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a0a80 00000100:00100000:2.0:1746143769.726681:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6591 00000100:00100000:2.0:1746143769.726684:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594413312:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.726780:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594413312:12345-192.168.202.48@tcp:3:cat.0 Request processed in 94us (189us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143769.726785:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6591 00002000:00100000:2.0:1746143769.726790:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2691072->2695167) req@ffff8800935a0a80 x1830963594413312/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.726801:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a0a80 with x1830963594413312 ext(2691072->2695167) 00002000:00010000:2.0:1746143769.726804:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935a0a80 00000100:00100000:0.0:1746143769.734746:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.734785:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.734810:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.734845:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.734928:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594413696 00000100:00100000:3.0:1746143769.734936:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594413696 00002000:00100000:3.0:1746143769.734970:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800935a3480 x1830963594413696/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.734978:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3480 with x1830963594413696 ext(2097152->3145727) 00002000:00010000:3.0:1746143769.734982:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a3480 00000100:00100000:3.0:1746143769.734996:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594413824 00000100:00100000:3.0:1746143769.734998:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594413824 00000100:00100000:2.0:1746143769.735005:0:21518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594414208 00002000:00100000:3.0:1746143769.735007:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800930d1500 x1830963594413824/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143769.735009:0:21518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594414208 00002000:00100000:3.0:1746143769.735012:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963594413824 ext(3145728->4194303) 00002000:00010000:3.0:1746143769.735014:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:3.0:1746143769.735022:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594414080 00000100:00100000:3.0:1746143769.735023:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594414080 00002000:00100000:2.0:1746143769.735027:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (3244032->4194303) req@ffff8800930d3480 x1830963594414208/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.735031:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3244031) req@ffff8800930d0700 x1830963594414080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 504/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.735035:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3480 with x1830963594414208 ext(3244032->4194303) 00002000:00100000:3.0:1746143769.735037:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0700 with x1830963594414080 ext(2097152->3244031) 00002000:00010000:2.0:1746143769.735038:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d3480 00002000:00010000:3.0:1746143769.735039:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0700 00000100:00100000:2.0:1746143769.735545:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6592 00000100:00100000:2.0:1746143769.735553:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594413696:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.736168:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6593 00000100:00100000:3.0:1746143769.736173:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6594 00000100:00100000:3.0:1746143769.736178:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594414208:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.736178:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594413824:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143769.736181:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6595 00000100:00100000:0.0:1746143769.736188:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594414080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.746651:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594413696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11091us (11903us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.746666:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6592 00002000:00100000:2.0:1746143769.746676:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800935a3480 x1830963594413696/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.746685:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935a3480 with x1830963594413696 ext(2097152->3145727) 00002000:00010000:2.0:1746143769.746691:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935a3480 00000100:00100000:1.0:1746143769.756060:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594413824:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19876us (21265us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.756071:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6593 00002000:00100000:1.0:1746143769.756081:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff8800930d1500 x1830963594413824/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.756090:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1500 with x1830963594413824 ext(3145728->4194303) 00002000:00010000:1.0:1746143769.756095:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1500 00000100:00100000:3.0:1746143769.756671:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594414208:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20491us (21858us total) trans 0 rc 950272/950272 00000100:00100000:3.0:1746143769.756678:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6594 00002000:00100000:3.0:1746143769.756683:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3244032->4194303) req@ffff8800930d3480 x1830963594414208/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.756690:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d3480 with x1830963594414208 ext(3244032->4194303) 00002000:00010000:3.0:1746143769.756693:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d3480 00000100:00100000:2.0:1746143769.758576:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594414080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22383us (23724us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.758584:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6595 00002000:00100000:2.0:1746143769.758591:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3244031) req@ffff8800930d0700 x1830963594414080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 504/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.758599:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0700 with x1830963594414080 ext(2097152->3244031) 00002000:00010000:2.0:1746143769.758603:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930d0700 00000100:00100000:0.0:1746143769.763283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.763410:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594414592 00000100:00100000:2.0:1746143769.763418:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594414592 00000100:00100000:2.0:1746143769.763469:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9308 00000100:00100000:2.0:1746143769.763476:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31584:x1830963594414592:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143769.763494:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.763510:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090772600/0xe984082ccd731212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a854d expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.763599:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763609:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763618:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763629:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763634:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763639:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763725:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763732:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763742:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143769.763750:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143769.763816:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763822:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763827:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763831:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ba30e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.763834:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763840:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763848:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143769.763851:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.763854:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763858:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba30e00/0xe984082ccd731219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763894:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763898:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763907:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763911:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f79c800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.763913:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763917:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763923:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5c04400) 00010000:00010000:2.0:1746143769.763925:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.763927:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763932:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f79c800/0xe984082ccd731220 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.763962:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090772600/0xe984082ccd731212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 250 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.763971:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 249 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.763976:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.763978:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143769.763980:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800938ba400, rc 0) 00000100:00100000:2.0:1746143769.764027:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31584:x1830963594414592:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 550us (752us total) trans 8589943656 rc 0/0 00000100:00100000:2.0:1746143769.764033:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9308 00000100:00100000:0.0:1746143769.773647:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.775347:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594414720 00000100:00100000:1.0:1746143769.775357:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594414720 00000100:00100000:1.0:1746143769.775634:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13961 00000100:00100000:1.0:1746143769.775641:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594414720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.775655:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.775668:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57afe00/0xe984082ccd731235 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8554 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.775712:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594444160:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143769.775897:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.777390:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594444160:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143769.777413:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57afe00/0xe984082ccd731235 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8554 expref: 17 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.777424:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57afe00/0xe984082ccd731235 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8554 expref: 17 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.777449:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57afe00, rc 0) 00000100:00100000:1.0:1746143769.777477:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594414720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1836us (3837us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143769.777484:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13961 00000100:00100000:0.0:1746143769.781441:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.781627:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594414848 00000100:00100000:1.0:1746143769.781635:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594414848 00000100:00100000:1.0:1746143769.781676:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13962 00000100:00100000:1.0:1746143769.781682:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31577:x1830963594414848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.781696:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.781712:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a855b expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.781735:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.781746:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.781748:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143769.781750:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.781774:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 20 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.781784:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 20 pid: 4581 timeout: 948 lvb_type: 0 00000100:00100000:1.0:1746143769.781794:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594444288:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143769.781863:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7839c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143769.783526:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143769.786577:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594444288:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143769.786606:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4771839] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.786625:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57af200, rc 0) 00000100:00100000:1.0:1746143769.787496:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31577:x1830963594414848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5811us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.787504:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13962 00000100:00100000:0.0:1746143769.788375:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.788465:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594414976 00000100:00100000:2.0:1746143769.788470:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594414976 00002000:00100000:2.0:1746143769.788506:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4284415) req@ffff8800930d0e00 x1830963594414976/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.788514:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0e00 with x1830963594414976 ext(4194304->4284415) 00010000:00010000:2.0:1746143769.788522:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 21 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.788533:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 21 pid: 4581 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.788539:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0e00 00000100:00100000:2.0:1746143769.788604:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1862 00000100:00100000:2.0:1746143769.788611:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594414976:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143769.790921:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594414976:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2303us (2540us total) trans 21474840548 rc 0/0 00000100:00100000:2.0:1746143769.790930:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1862 00002000:00100000:2.0:1746143769.790937:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4284415) req@ffff8800930d0e00 x1830963594414976/t21474840548(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.790946:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d0e00 with x1830963594414976 ext(4194304->4284415) 00010000:00010000:2.0:1746143769.790954:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 23 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.790965:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 23 pid: 4581 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.790972:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800930d0e00 00000100:00100000:0.0:1746143769.794353:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.795549:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594415104 00000100:00100000:2.0:1746143769.795557:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594415104 00010000:00010000:2.0:1746143769.795590:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 23 pid: 4581 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.795628:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7464 00000100:00100000:2.0:1746143769.795634:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594415104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.795645:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.795663:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 23 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.795672:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 23 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.795689:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7b200/0xe984082ccd7311a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4284415) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84eb expref: 23 pid: 4581 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.795716:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.795717:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.795724:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.795731:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.795766:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.795776:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594444416:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.795857:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.798045:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594444416:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.798059:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.798085:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594415104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2451us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.798093:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7464 00000100:00100000:0.0:1746143769.799133:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.799277:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594415360 00000100:00100000:2.0:1746143769.799282:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594415360 00002000:00100000:2.0:1746143769.799308:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800930d1c00 x1830963594415360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.799317:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1c00 with x1830963594415360 ext(4194304->4771839) 00002000:00010000:2.0:1746143769.799320:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1c00 00000100:00100000:2.0:1746143769.799343:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6596 00000100:00100000:2.0:1746143769.799348:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594415360:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143769.804846:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594415360:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5489us (5706us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143769.804857:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6596 00002000:00100000:2.0:1746143769.804869:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff8800930d1c00 x1830963594415360/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.804882:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d1c00 with x1830963594415360 ext(4194304->4771839) 00002000:00010000:2.0:1746143769.804887:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d1c00 00000100:00100000:0.0:1746143769.828184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.828343:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594415616 00000100:00100000:2.0:1746143769.828351:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594415616 00000100:00100000:2.0:1746143769.828400:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9309 00000100:00100000:2.0:1746143769.828407:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31588:x1830963594415616:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.828428:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143769.828443:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090772200/0xe984082ccd731243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8562 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.828539:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828549:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828558:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828574:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828579:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828583:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828674:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebfe00/0xe984082ccd731258 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828687:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebfe00/0xe984082ccd731258 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828692:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebfe00/0xe984082ccd731258 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143769.828699:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143769.828769:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828775:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828779:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828784:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4c06000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.828788:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828792:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828802:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143769.828804:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.828807:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828811:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c06000/0xe984082ccd73124a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828840:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828848:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828853:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828857:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bebe000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143769.828859:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828863:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828869:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5c04000) 00010000:00010000:2.0:1746143769.828871:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143769.828872:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828876:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebe000/0xe984082ccd731251 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.828906:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090772200/0xe984082ccd731243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8562 expref: 252 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.828916:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebfe00/0xe984082ccd731258 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8562 expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.828921:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.828923:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143769.828925:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bebfe00, rc 0) 00000100:00100000:2.0:1746143769.828972:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31588:x1830963594415616:12345-192.168.202.48@tcp:101:cat.0 Request processed in 566us (842us total) trans 8589943657 rc 0/0 00000100:00100000:2.0:1746143769.828978:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9309 00000100:00100000:2.0:1746143769.833319:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.833380:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594415872 00000100:00100000:0.0:1746143769.833389:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594415872 00000100:00100000:0.0:1746143769.833430:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4021 00000100:00100000:0.0:1746143769.833437:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31588:x1830963594415872:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143769.833476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.833809:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31588:x1830963594415872:12345-192.168.202.48@tcp:35:cat.0 Request processed in 371us (500us total) trans 8589943658 rc 0/0 00000100:00100000:0.0:1746143769.833816:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4021 00000100:00100000:2.0:1746143769.833878:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594416000 00000100:00100000:2.0:1746143769.833885:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594416000 00000100:00100000:2.0:1746143769.833936:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 750 00000100:00100000:2.0:1746143769.833943:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1964:x1830963594416000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.833956:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.833980:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bebfe00/0xe984082ccd731258 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8562 expref: 252 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.834000:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.834005:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.834034:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1964:x1830963594416000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 92us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.834041:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 750 00000100:00100000:0.0:1746143769.839017:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.839182:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594416128 00000100:00100000:1.0:1746143769.839192:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594416128 00000100:00100000:1.0:1746143769.839628:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13963 00000100:00100000:1.0:1746143769.839639:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1962:x1830963594416128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.839657:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.839674:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8569 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.839694:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.839696:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.839705:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.839720:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 30 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.839730:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57afe00, rc 0) 00000100:00100000:1.0:1746143769.840039:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594416128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 400us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.840046:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13963 00000100:00100000:2.0:1746143769.840236:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.840689:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594416256 00000100:00100000:1.0:1746143769.840692:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594416256 00000100:00100000:1.0:1746143769.840713:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13964 00000100:00100000:1.0:1746143769.840717:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594416256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.840723:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.840730:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8570 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143769.840742:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.840743:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143769.840746:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.840756:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.840760:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a57afc00, rc 0) 00000100:00100000:1.0:1746143769.840774:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594416256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 57us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.840777:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13964 00000100:00100000:0.0:1746143769.840953:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.841010:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594416384 00000100:00100000:3.0:1746143769.841013:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594416384 00000100:00100000:3.0:1746143769.841039:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13965 00000100:00100000:3.0:1746143769.841044:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594416384:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.841049:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.841056:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd731274 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8577 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.841086:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594444544:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.841175:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.843176:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594444544:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.843200:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd731274 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8577 expref: 31 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.843211:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff800/0xe984082ccd731274 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8577 expref: 31 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.843224:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ff800, rc 0) 00000100:00100000:3.0:1746143769.843270:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594416384:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2223us (2315us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.843276:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13965 00000100:00100000:0.0:1746143769.850017:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.850058:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.850079:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.850179:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594416896 00000100:00100000:2.0:1746143769.850186:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594416896 00002000:00100000:2.0:1746143769.850228:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093501500 x1830963594416896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.850236:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501500 with x1830963594416896 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.850245:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093501500 00000100:00100000:2.0:1746143769.850270:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594417024 00000100:00100000:2.0:1746143769.850273:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594417024 00002000:00100000:2.0:1746143769.850284:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093503100 x1830963594417024/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.850292:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963594417024 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.850294:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503100 00000100:00100000:2.0:1746143769.850310:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6597 00000100:00100000:2.0:1746143769.850317:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1962:x1830963594416896:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143769.850362:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6598 00000100:00100000:1.0:1746143769.850371:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594417024:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143769.850405:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594416640 00000100:00100000:3.0:1746143769.850409:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594416640 00000100:00100000:3.0:1746143769.850434:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9310 00000100:00100000:3.0:1746143769.850440:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31590:x1830963594416640:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143769.850453:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.850473:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61fe400/0xe984082ccd73127b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a857e expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.850549:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850560:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850568:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850578:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850583:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850589:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850834:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850843:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850848:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143769.850855:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143769.850922:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850927:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850932:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850936:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a61ffc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143769.850939:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850943:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850952:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143769.850955:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143769.850958:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850964:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ffc00/0xe984082ccd731282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850976:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850980:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850984:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850987:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a61ff000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143769.850989:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850993:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.850998:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ba5a200) 00010000:00010000:3.0:1746143769.851000:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143769.851002:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.851006:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff000/0xe984082ccd731289 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.851034:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61fe400/0xe984082ccd73127b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 19 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.851043:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 18 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.851053:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.851055:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143769.851056:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ff800, rc 0) 00000100:00100000:3.0:1746143769.851097:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31590:x1830963594416640:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 656us (1086us total) trans 8589943659 rc 0/0 00000100:00100000:3.0:1746143769.851102:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9310 00000100:00100000:0.0:1746143769.854965:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.855067:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594417408 00000100:00100000:2.0:1746143769.855075:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594417408 00000100:00100000:2.0:1746143769.855122:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4022 00000100:00100000:2.0:1746143769.855128:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31590:x1830963594417408:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143769.855346:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31590:x1830963594417408:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 217us (386us total) trans 8589943660 rc 0/0 00000100:00100000:2.0:1746143769.855352:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4022 00000100:00100000:1.0:1746143769.857690:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594417024:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7315us (7604us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.857699:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6598 00002000:00100000:1.0:1746143769.857709:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093503100 x1830963594417024/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.857718:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093503100 with x1830963594417024 ext(1048576->2097151) 00002000:00010000:1.0:1746143769.857723:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093503100 00000100:00100000:2.0:1746143769.861526:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1962:x1830963594416896:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11201us (11459us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.861536:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6597 00002000:00100000:2.0:1746143769.861790:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880093501500 x1830963594416896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.861799:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093501500 with x1830963594416896 ext(1048576->2097151) 00002000:00010000:2.0:1746143769.861804:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093501500 00000100:00100000:0.0:1746143769.868917:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.869298:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594417536 00000100:00100000:3.0:1746143769.869306:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594417536 00000100:00100000:3.0:1746143769.869342:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13966 00000100:00100000:3.0:1746143769.869348:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31590:x1830963594417536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143769.869361:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.869374:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8585 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.869395:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.869402:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.869408:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.869413:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.869415:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.869417:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [544768->671743] (req 544768->671743) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.869442:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 18 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.869451:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 18 pid: 9527 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.869461:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594444672:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.869527:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 22 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.869534:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 22 pid: 12618 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.869540:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594444800:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.869559:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 12 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.869565:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 12 pid: 8496 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.869571:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594444928:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.869581:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1e24000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.870856:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594444672:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.870864:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594444800:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.871334:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594444928:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.871357:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [544768->671743] (req 544768->671743) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.871369:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a61ff000, rc 0) 00000100:00100000:3.0:1746143769.871704:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31590:x1830963594417536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2354us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.871711:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13966 00000100:00100000:0.0:1746143769.873736:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.873853:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.873918:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594417664 00000100:00100000:3.0:1746143769.873923:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594417664 00010000:00010000:3.0:1746143769.873947:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 23 pid: 12618 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.873966:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594417920 00000100:00100000:3.0:1746143769.873968:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594417920 00010000:00010000:3.0:1746143769.873974:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 18 pid: 9527 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.873987:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7465 00000100:00100000:3.0:1746143769.873991:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594417664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.874002:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.874018:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 23 pid: 12618 timeout: 948 lvb_type: 1 00010000:00010000:3.0:1746143769.874026:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 23 pid: 12618 timeout: 948 lvb_type: 1 00010000:00010000:3.0:1746143769.874046:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731005 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83cc expref: 23 pid: 12618 timeout: 948 lvb_type: 1 00000100:00100000:0.0:1746143769.874082:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7466 00000100:00100000:0.0:1746143769.874089:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594417920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143769.874095:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143769.874103:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 18 pid: 9527 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143769.874109:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 18 pid: 9527 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143769.874118:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a716600/0xe984082ccd730f64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8386 expref: 18 pid: 9527 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143769.874169:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143769.874196:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594417920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143769.874202:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7466 00010000:00010000:3.0:1746143769.874734:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143769.874756:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594417664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 764us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.874762:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7465 00000100:00100000:0.0:1746143769.878523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.878602:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594417792 00000100:00100000:3.0:1746143769.878608:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594417792 00010000:00010000:3.0:1746143769.878641:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.878727:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7467 00000100:00100000:3.0:1746143769.878735:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594417792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143769.878746:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143769.878762:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00010000:00010000:3.0:1746143769.878771:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00010000:00010000:3.0:1746143769.878787:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba26400/0xe984082ccd730eca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8347 expref: 13 pid: 8496 timeout: 948 lvb_type: 1 00010000:00010000:3.0:1746143769.878796:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.878797:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.878802:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.878807:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.878827:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.878834:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594445056:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143769.879693:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.883018:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.883191:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.883419:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594445056:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.883435:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.883469:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594417792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4735us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.883478:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7467 00000100:00100000:2.0:1746143769.883510:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594418304 00000100:00100000:2.0:1746143769.883515:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594418304 00002000:00100000:2.0:1746143769.883547:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (544768->548863) req@ffff880093502680 x1830963594418304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.883556:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502680 with x1830963594418304 ext(544768->548863) 00002000:00010000:2.0:1746143769.883560:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502680 00000100:00100000:2.0:1746143769.883586:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6599 00000100:00100000:2.0:1746143769.883592:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594418304:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143769.883666:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594418048 00000100:00100000:3.0:1746143769.883670:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594418048 00000100:00100000:3.0:1746143769.883700:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13967 00000100:00100000:3.0:1746143769.883704:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:31588:x1830963594418048:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.883713:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.883725:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a858c expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.883744:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 14 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.883750:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143769.883752:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143769.883755:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.883780:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 14 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.883789:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 14 pid: 2839 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.883798:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594445184:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.884041:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.884303:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594418304:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 710us (1112us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143769.884309:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6599 00002000:00100000:2.0:1746143769.884313:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (544768->548863) req@ffff880093502680 x1830963594418304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.884320:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502680 with x1830963594418304 ext(544768->548863) 00002000:00010000:2.0:1746143769.884322:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093502680 00000100:00100000:0.0:1746143769.887034:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.887066:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594445184:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143769.887084:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143769.887089:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 31 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.887101:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5ce00, rc 0) 00000100:00100000:3.0:1746143769.887132:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31588:x1830963594418048:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3426us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.887166:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13967 00000100:00100000:1.0:1746143769.887166:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594418432 00000100:00100000:1.0:1746143769.887171:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594418432 00002000:00100000:1.0:1746143769.887196:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2596864->2695167) req@ffff880093500700 x1830963594418432/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.887204:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500700 with x1830963594418432 ext(2596864->2695167) 00010000:00010000:1.0:1746143769.887209:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 15 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.887223:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 15 pid: 2839 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.887228:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093500700 00000100:00100000:1.0:1746143769.887238:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594418688 00000100:00100000:1.0:1746143769.887241:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594418688 00002000:00100000:1.0:1746143769.887252:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (667648->671743) req@ffff880094306d80 x1830963594418688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.887257:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830963594418688 ext(667648->671743) 00002000:00010000:1.0:1746143769.887259:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306d80 00000100:00100000:2.0:1746143769.887307:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1863 00000100:00100000:2.0:1746143769.887315:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594418432:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143769.887333:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6600 00000100:00100000:3.0:1746143769.887339:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594418688:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143769.887444:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594418688:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 104us (358us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143769.887449:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6600 00002000:00100000:3.0:1746143769.887454:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (667648->671743) req@ffff880094306d80 x1830963594418688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.887465:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830963594418688 ext(667648->671743) 00002000:00010000:3.0:1746143769.887468:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306d80 00000100:00100000:2.0:1746143769.889791:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594418432:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 2472us (2757us total) trans 17179873223 rc 0/0 00000100:00100000:2.0:1746143769.889800:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1863 00002000:00100000:2.0:1746143769.889808:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2596864->2695167) req@ffff880093500700 x1830963594418432/t17179873223(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.889815:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093500700 with x1830963594418432 ext(2596864->2695167) 00010000:00010000:2.0:1746143769.889822:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.889834:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.889840:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093500700 00000100:00100000:0.0:1746143769.896346:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.896593:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594418816 00000100:00100000:2.0:1746143769.896601:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594418816 00010000:00010000:2.0:1746143769.896630:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.896665:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7468 00000100:00100000:2.0:1746143769.896671:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594418816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.896681:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.896701:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.896712:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.896729:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dee00/0xe984082ccd7311f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2596864->2695167) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8531 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.896759:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.896762:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.896768:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.896781:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.896809:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 30 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.896821:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594445312:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.896896:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.897848:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.898534:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594418944 00000100:00100000:3.0:1746143769.898541:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594418944 00000100:00100000:2.0:1746143769.898798:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594445312:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.898813:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.898843:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594418816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2172us (2503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.898850:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7468 00000100:00100000:3.0:1746143769.898961:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13968 00000100:00100000:3.0:1746143769.898967:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:31584:x1830963594418944:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143769.898980:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.898992:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8593 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.899010:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.899016:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.899017:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143769.899020:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.899038:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.899046:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.899054:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594445440:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.899086:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.900687:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594445440:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.900705:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2744320->3145727] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.900715:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c000, rc 0) 00000100:00100000:3.0:1746143769.900801:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31584:x1830963594418944:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1833us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.900808:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13968 00000100:00100000:0.0:1746143769.907068:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.907124:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.907385:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419328 00000100:00100000:2.0:1746143769.907392:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419328 00002000:00100000:2.0:1746143769.907427:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094304000 x1830963594419328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.907435:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304000 with x1830963594419328 ext(3145728->4194303) 00010000:00010000:2.0:1746143769.907443:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.907456:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.907467:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304000 00000100:00100000:2.0:1746143769.907495:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419200 00000100:00100000:2.0:1746143769.907498:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419200 00002000:00100000:2.0:1746143769.907508:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094304700 x1830963594419200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.907514:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963594419200 ext(2097152->3145727) 00010000:00010000:2.0:1746143769.907518:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 33 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.907526:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 33 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.907531:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304700 00000100:00100000:2.0:1746143769.907542:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1864 00000100:00100000:2.0:1746143769.907547:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594419328:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.907655:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1865 00000100:00100000:1.0:1746143769.907662:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594419200:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143769.924608:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594419328:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17051us (17539us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143769.924619:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1864 00002000:00100000:2.0:1746143769.924629:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880094304000 x1830963594419328/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.924638:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304000 with x1830963594419328 ext(3145728->4194303) 00010000:00010000:2.0:1746143769.924647:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.924666:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.924673:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304000 00000100:00100000:1.0:1746143769.929032:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594419200:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 21363us (21900us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143769.929042:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1865 00002000:00100000:1.0:1746143769.929053:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff880094304700 x1830963594419200/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.929061:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304700 with x1830963594419200 ext(2097152->3145727) 00010000:00010000:1.0:1746143769.929070:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.929083:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.929094:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304700 00000100:00100000:1.0:1746143769.937341:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.938258:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.938305:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419712 00000100:00100000:2.0:1746143769.938313:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419712 00010000:00010000:2.0:1746143769.938343:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.938380:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7469 00000100:00100000:2.0:1746143769.938387:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594419712:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.938397:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.938415:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.938427:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.938442:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419584 00000100:00100000:3.0:1746143769.938445:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419584 00010000:00010000:2.0:1746143769.938445:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a858c expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.938460:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.938462:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143769.938467:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13969 00010000:00010000:2.0:1746143769.938468:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.938472:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:31588:x1830963594419584:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143769.938480:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.938482:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.938493:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a859a expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.938506:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.938516:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594445568:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143769.938558:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.938564:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143769.938565:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143769.938568:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.938576:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d7480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143769.938584:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.938604:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 33 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.938612:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594445696:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.938643:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.940133:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594445696:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.940184:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.940195:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0800, rc 0) 00000100:00100000:3.0:1746143769.940233:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:31588:x1830963594419584:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1760us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.940240:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13969 00000100:00100000:2.0:1746143769.940301:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594445568:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.940311:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.940328:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594419712:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1943us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.940334:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7469 00000100:00100000:0.0:1746143769.940685:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143769.941043:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594419968 00000100:00100000:1.0:1746143769.941048:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594419968 00002000:00100000:1.0:1746143769.941079:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2744320->2748415) req@ffff880094305f80 x1830963594419968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.941088:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830963594419968 ext(2744320->2748415) 00010000:00010000:1.0:1746143769.941094:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.941104:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.941110:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094305f80 00000100:00100000:1.0:1746143769.941205:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1866 00000100:00100000:1.0:1746143769.941212:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594419968:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143769.941334:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594419968:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 123us (650us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143769.941340:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1866 00002000:00100000:1.0:1746143769.941344:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2744320->2748415) req@ffff880094305f80 x1830963594419968/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143769.941350:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830963594419968 ext(2744320->2748415) 00010000:00010000:1.0:1746143769.941354:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.941363:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:1.0:1746143769.941368:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094305f80 00000100:00100000:0.0:1746143769.952460:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.952505:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.952527:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420608 00000100:00100000:0.0:1746143769.952530:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.952534:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420608 00000100:00100000:3.0:1746143769.952573:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9311 00000100:00100000:3.0:1746143769.952579:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31594:x1830963594420608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.952601:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.952614:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89ca00/0xe984082ccd7312ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85a8 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.952695:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420352 00000100:00100000:2.0:1746143769.952698:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420352 00010000:00010000:3.0:1746143769.952708:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952718:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00002000:00100000:2.0:1746143769.952723:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2744320->3145727) req@ffff880094304a80 x1830963594420352/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143769.952728:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00002000:00100000:2.0:1746143769.952731:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304a80 with x1830963594420352 ext(2744320->3145727) 00010000:00010000:2.0:1746143769.952738:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:3.0:1746143769.952739:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952743:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952748:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143769.952749:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 32 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:2.0:1746143769.952759:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304a80 00000100:00100000:2.0:1746143769.952784:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1867 00000100:00100000:2.0:1746143769.952789:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594420352:12345-192.168.202.48@tcp:4:multiop.0 00010000:00010000:3.0:1746143769.952832:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7312cf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952839:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7312cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952845:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7312cf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143769.952853:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143769.952917:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952922:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952927:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952932:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b08f000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143769.952935:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952941:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952949:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143769.952952:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143769.952955:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952959:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b08f000/0xe984082ccd7312c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952980:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952985:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952989:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952992:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5ce00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143769.952994:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.952999:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.953004:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ba5a000) 00010000:00010000:3.0:1746143769.953006:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143769.953008:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.953013:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd7312c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143769.953043:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89ca00/0xe984082ccd7312ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a8 expref: 22 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953052:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7312cf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a8 expref: 21 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953057:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143769.953059:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143769.953061:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c200, rc 0) 00000100:00100000:3.0:1746143769.953104:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31594:x1830963594420608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 525us (653us total) trans 8589943661 rc 0/0 00000100:00100000:3.0:1746143769.953110:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9311 00000100:00100000:3.0:1746143769.953129:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420224 00000100:00100000:3.0:1746143769.953132:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420224 00000100:00100000:3.0:1746143769.953181:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13970 00000100:00100000:3.0:1746143769.953186:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31584:x1830963594420224:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143769.953193:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.953202:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85a1 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953218:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953225:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953235:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.953241:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953245:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143769.953246:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143769.953249:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 7/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->3633151] (req 3145728->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953270:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.953277:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 16 pid: 2839 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.953285:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594445824:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.953349:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.953357:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 948 lvb_type: 1 00000100:00100000:3.0:1746143769.953365:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594445952:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.954547:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.954558:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.954568:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594446080:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143769.954596:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 23 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.954604:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 23 pid: 8495 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.954611:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594446208:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.954624:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.959551:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.959552:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594445824:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.959563:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594445952:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.959570:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594446080:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143769.959577:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594446208:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143769.959581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143769.959607:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [3145728->3633151] (req 3145728->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143769.959622:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2da600, rc 0) 00000100:00100000:2.0:1746143769.959666:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.959669:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31584:x1830963594420224:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6482us (7162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143769.959678:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13970 00000100:00100000:2.0:1746143769.959687:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421120 00000100:00100000:2.0:1746143769.959692:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421120 00010000:00010000:2.0:1746143769.959714:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.959732:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420992 00000100:00100000:2.0:1746143769.959734:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420992 00000100:00100000:1.0:1746143769.959774:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421248 00000100:00100000:1.0:1746143769.959778:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421248 00010000:00010000:1.0:1746143769.959790:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 948 lvb_type: 1 00000100:00100000:1.0:1746143769.959806:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7470 00000100:00100000:1.0:1746143769.959812:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594421120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.959822:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.959839:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.959848:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.959865:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd2c000/0xe984082ccd73120b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8546 expref: 17 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:1.0:1746143769.959892:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.959910:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594421120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.959919:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7470 00000100:00100000:1.0:1746143769.959933:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7471 00000100:00100000:1.0:1746143769.959937:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594421248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143769.959943:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143769.959950:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.959957:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.959967:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57afc00/0xe984082ccd73126d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8570 expref: 23 pid: 2839 timeout: 948 lvb_type: 1 00010000:00010000:1.0:1746143769.959974:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143769.959987:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594421248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143769.959992:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7471 00000100:00100000:2.0:1746143769.960040:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 751 00000100:00100000:2.0:1746143769.960045:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594420992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.960052:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.960068:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7312cf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a8 expref: 21 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.960081:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143769.960084:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.960097:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594420992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 52us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.960101:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 751 00000100:00100000:3.0:1746143769.962310:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.962330:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.962366:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.962367:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421376 00000100:00100000:2.0:1746143769.962375:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421376 00000100:00100000:3.0:1746143769.962382:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594420864 00000100:00100000:3.0:1746143769.962385:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594420864 00010000:00010000:2.0:1746143769.962398:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 22 pid: 8495 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.962409:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4023 00000100:00100000:2.0:1746143769.962413:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421504 00000100:00100000:3.0:1746143769.962415:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31594:x1830963594420864:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143769.962415:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421504 00010000:00010000:2.0:1746143769.962422:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.962434:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7472 00000100:00100000:2.0:1746143769.962439:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594421376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.962447:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.962462:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 22 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.962469:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 22 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.962483:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a7ac00/0xe984082ccd73117f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c8 expref: 22 pid: 8495 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.962494:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.962518:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594421376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.962523:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7472 00000100:00100000:2.0:1746143769.962532:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7473 00000100:00100000:2.0:1746143769.962535:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594421504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.962542:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.962546:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.962553:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.962561:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a57af200/0xe984082ccd73123c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4771839) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a855b expref: 16 pid: 2839 timeout: 948 lvb_type: 0 00000100:00100000:3.0:1746143769.962564:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31594:x1830963594420864:12345-192.168.202.48@tcp:35:cat.0 Request processed in 148us (196us total) trans 8589943662 rc 0/0 00010000:00010000:2.0:1746143769.962568:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143769.962570:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4023 00010000:00010000:2.0:1746143769.962570:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.962575:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 20 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.962581:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 20 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.962603:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 20 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.962611:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594446336:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.963440:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143769.965646:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143769.965679:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.965706:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421760 00000100:00100000:2.0:1746143769.965714:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421760 00000100:00100000:2.0:1746143769.965756:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594421632 00000100:00100000:2.0:1746143769.965758:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594421632 00000100:00100000:3.0:1746143769.966195:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13971 00000100:00100000:3.0:1746143769.966203:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594421760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143769.966217:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143769.966230:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d511e00/0xe984082ccd7312e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85b6 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143769.966271:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594446464:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143769.966324:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143769.966438:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13972 00000100:00100000:1.0:1746143769.966446:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594421632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143769.966455:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143769.966465:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009513be00/0xe984082ccd7312eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85af expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143769.966490:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594446592:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143769.966523:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143769.966639:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594446336:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143769.966651:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.966674:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594421504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4137us (4342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.966682:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7473 00000100:00100000:0.0:1746143769.968088:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594420352:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 15293us (15552us total) trans 17179873224 rc 0/0 00000100:00100000:0.0:1746143769.968097:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1867 00002000:00100000:0.0:1746143769.968105:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (2744320->3145727) req@ffff880094304a80 x1830963594420352/t17179873224(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/448 e 0 to 0 dl 1746143780 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143769.968115:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304a80 with x1830963594420352 ext(2744320->3145727) 00010000:00010000:0.0:1746143769.968122:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:0.0:1746143769.968136:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00002000:00010000:0.0:1746143769.969134:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304a80 00000100:00100000:3.0:1746143769.970666:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594446464:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143769.970700:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511e00/0xe984082ccd7312e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85b6 expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.970719:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511e00/0xe984082ccd7312e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85b6 expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143769.970730:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511e00, rc 0) 00000100:00100000:3.0:1746143769.970786:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594421760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4583us (5144us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143769.970793:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13971 00000100:00100000:1.0:1746143769.970889:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594446592:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143769.970906:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009513be00/0xe984082ccd7312eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85af expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.970916:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009513be00/0xe984082ccd7312eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85af expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143769.970923:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009513be00, rc 0) 00000100:00100000:1.0:1746143769.970956:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594421632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4512us (5276us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143769.970961:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13972 00000100:00100000:0.0:1746143769.971228:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.971263:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422016 00000100:00100000:2.0:1746143769.971269:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422016 00002000:00100000:2.0:1746143769.971297:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3629056->3633151) req@ffff880094304e00 x1830963594422016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.971306:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963594422016 ext(3629056->3633151) 00002000:00010000:2.0:1746143769.971310:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:2.0:1746143769.971323:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6601 00000100:00100000:2.0:1746143769.971328:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594422016:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143769.971454:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594422016:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 126us (227us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143769.971460:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6601 00002000:00100000:2.0:1746143769.971465:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3629056->3633151) req@ffff880094304e00 x1830963594422016/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.971472:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830963594422016 ext(3629056->3633151) 00002000:00010000:2.0:1746143769.971475:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746143769.972713:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.972816:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422144 00000100:00100000:2.0:1746143769.972821:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422144 00010000:00010000:2.0:1746143769.972840:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00000100:00100000:2.0:1746143769.973479:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7474 00000100:00100000:2.0:1746143769.973486:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594422144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143769.973497:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143769.973512:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.973522:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.973538:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7312ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2744320->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8593 expref: 34 pid: 8497 timeout: 948 lvb_type: 0 00010000:00010000:2.0:1746143769.973549:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.973551:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143769.973556:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.973563:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143769.973587:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 33 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143769.973596:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594446720:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143769.973663:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143769.978563:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143769.978603:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143769.978631:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594446720:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143769.978640:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143769.978648:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143769.978683:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594422144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 5196us (5971us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143769.978691:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7474 00000100:00100000:2.0:1746143769.978721:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422784 00000100:00100000:2.0:1746143769.978726:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422784 00002000:00100000:2.0:1746143769.978759:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012e17fb80 x1830963594422784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.978767:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17fb80 with x1830963594422784 ext(3145728->4194303) 00002000:00010000:2.0:1746143769.978771:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17fb80 00000100:00100000:2.0:1746143769.978783:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423040 00000100:00100000:2.0:1746143769.978785:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423040 00002000:00100000:2.0:1746143769.978797:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012e17df80 x1830963594423040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 504/0 e 0 to 0 dl 1746143780 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143769.978803:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17df80 with x1830963594423040 ext(0->1048575) 00002000:00010000:2.0:1746143769.978806:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17df80 00000100:00100000:2.0:1746143769.978823:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6602 00000100:00100000:2.0:1746143769.978828:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594422784:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143769.979869:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594422528 00000100:00100000:3.0:1746143769.979876:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594422528 00000100:00100000:3.0:1746143769.979906:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4024 00000100:00100000:3.0:1746143769.979911:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:31584:x1830963594422528:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143769.979997:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6603 00000100:00100000:2.0:1746143769.980005:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594423040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143769.980062:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31584:x1830963594422528:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 150us (1507us total) trans 8589943663 rc 0/0 00000100:00100000:3.0:1746143769.980069:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4024 00000100:00100000:3.0:1746143769.993851:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1962:x1830963594422784:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15013us (15237us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143769.993861:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6602 00002000:00100000:3.0:1746143769.993877:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012e17fb80 x1830963594422784/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:165/0 lens 488/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.993886:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17fb80 with x1830963594422784 ext(3145728->4194303) 00002000:00010000:3.0:1746143769.993891:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17fb80 00000100:00100000:3.0:1746143769.994617:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594423040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14613us (15975us total) trans 0 rc 921600/921600 00000100:00100000:3.0:1746143769.994627:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6603 00002000:00100000:3.0:1746143769.994632:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88012e17df80 x1830963594423040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:165/0 lens 504/440 e 0 to 0 dl 1746143780 ref 1 fl Complete:/200/0 rc 921600/921600 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143769.994639:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17df80 with x1830963594423040 ext(0->1048575) 00002000:00010000:3.0:1746143769.994642:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17df80 00000100:00100000:0.0:1746143770.000272:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.000348:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423168 00000100:00100000:1.0:1746143770.000355:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423168 00000100:00080000:2.0:1746143770.000412:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143770.000416:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13973 00000100:00100000:1.0:1746143770.000424:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594423168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143770.000439:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.000453:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009513a000/0xe984082ccd7312f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85bd expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.000497:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594446848:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143770.000577:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7836c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143770.002300:0:4581:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime: 1746143768 -> 1746143769 00002000:00010000:1.0:1746143770.002305:0:4581:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143768 -> 1746143769 00002000:00010000:1.0:1746143770.002307:0:4581:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime: 1746143768 -> 1746143769 00000100:00100000:1.0:1746143770.002327:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4581:1830963594446848:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143770.002351:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009513a000/0xe984082ccd7312f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85bd expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.002363:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009513a000/0xe984082ccd7312f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85bd expref: 22 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.002450:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009513a000, rc 0) 00000100:00100000:1.0:1746143770.002536:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594423168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2112us (2271us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143770.002544:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13973 00000100:00100000:0.0:1746143770.004906:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.004956:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423424 00000100:00100000:3.0:1746143770.004962:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423424 00002000:00100000:3.0:1746143770.004992:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012e17f480 x1830963594423424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143770.004998:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f480 with x1830963594423424 ext(4194304->4771839) 00002000:00010000:3.0:1746143770.005002:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17f480 00000100:00100000:3.0:1746143770.005024:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6604 00000100:00100000:3.0:1746143770.005028:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594423424:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143770.007583:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.007618:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.007730:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423552 00000100:00100000:1.0:1746143770.007736:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423552 00000100:00080000:2.0:1746143770.007755:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143770.007770:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423680 00000100:00100000:1.0:1746143770.007772:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423680 00000100:00080000:2.0:1746143770.007791:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143770.007830:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13974 00000100:00100000:3.0:1746143770.007837:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594423552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143770.007849:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.007863:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d510200/0xe984082ccd7312f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85c4 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143770.007906:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594446976:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143770.007920:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594423424:12345-192.168.202.48@tcp:3:cat.0 Request processed in 2890us (3018us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143770.007928:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6604 00002000:00100000:2.0:1746143770.007935:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012e17f480 x1830963594423424/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.007943:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f480 with x1830963594423424 ext(4194304->4771839) 00000100:00100000:3.0:1746143770.007945:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00002000:00010000:2.0:1746143770.007947:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17f480 00000100:00100000:1.0:1746143770.007995:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13975 00000100:00100000:1.0:1746143770.008000:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594423680:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143770.008006:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.008015:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85cb expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.008026:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.008028:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.008034:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 17 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.008048:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 17 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.008056:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6dfc00, rc 0) 00000100:00100000:1.0:1746143770.008071:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594423680:12345-192.168.202.48@tcp:101:cat.0 Request processed in 71us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.008076:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13975 00000100:00100000:3.0:1746143770.009824:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594446976:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143770.009849:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d510200/0xe984082ccd7312f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85c4 expref: 16 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.009860:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d510200/0xe984082ccd7312f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85c4 expref: 16 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.009880:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510200, rc 0) 00000100:00100000:3.0:1746143770.009913:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594423552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2077us (2335us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143770.009919:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13974 00000100:00100000:0.0:1746143770.010370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.010406:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423808 00000100:00100000:3.0:1746143770.010410:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423808 00000100:00100000:3.0:1746143770.010441:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13976 00000100:00100000:3.0:1746143770.010446:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594423808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143770.010454:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.010462:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d511c00/0xe984082ccd731307 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85d2 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143770.010491:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594447104:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143770.010631:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143770.011658:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594447104:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143770.011670:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d511c00/0xe984082ccd731307 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d2 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.011677:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d511c00/0xe984082ccd731307 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d2 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.011685:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511c00, rc 0) 00000100:00100000:3.0:1746143770.011705:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594423808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1260us (1337us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143770.011709:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13976 00000100:00100000:0.0:1746143770.011934:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.011961:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594423936 00000100:00100000:3.0:1746143770.011964:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594423936 00000100:00100000:3.0:1746143770.011985:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13977 00000100:00100000:3.0:1746143770.011988:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31594:x1830963594423936:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143770.011994:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.011999:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85d9 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.012010:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 20 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.012014:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143770.012016:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143770.012018:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.012029:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 20 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.012036:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 20 pid: 2839 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.012045:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594447232:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143770.012081:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.013298:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.013393:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594447232:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.013405:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.013412:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510000, rc 0) 00000100:00100000:2.0:1746143770.013424:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594424064 00000100:00100000:3.0:1746143770.013429:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31594:x1830963594423936:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1440us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.013429:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594424064 00000100:00100000:3.0:1746143770.013433:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13977 00000100:00100000:2.0:1746143770.013451:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13978 00000100:00100000:2.0:1746143770.013457:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594424064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143770.013464:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143770.013471:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d600/0xe984082ccd731315 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85e0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143770.013496:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594447360:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143770.013540:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.013832:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.013892:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594424192 00000100:00100000:2.0:1746143770.013895:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594424192 00002000:00100000:2.0:1746143770.013917:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3633151) req@ffff880093f00a80 x1830963594424192/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.013925:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00a80 with x1830963594424192 ext(3145728->3633151) 00010000:00010000:2.0:1746143770.013931:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.013941:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00002000:00010000:2.0:1746143770.013951:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f00a80 00000100:00100000:2.0:1746143770.013964:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1868 00000100:00100000:2.0:1746143770.013970:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594424192:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143770.015048:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594447360:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143770.015066:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d600/0xe984082ccd731315 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e0 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.015075:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e6d600/0xe984082ccd731315 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e0 expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.015097:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e6d600, rc 0) 00000100:00100000:2.0:1746143770.015120:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594424064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1662us (1822us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143770.015126:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13978 00000100:00100000:2.0:1746143770.019783:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594424192:12345-192.168.202.48@tcp:4:cat.0 Request processed in 5806us (5943us total) trans 21474840549 rc 0/0 00000100:00100000:2.0:1746143770.019794:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1868 00002000:00100000:2.0:1746143770.019804:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->3633151) req@ffff880093f00a80 x1830963594424192/t21474840549(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:166/0 lens 488/448 e 0 to 0 dl 1746143781 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.019813:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f00a80 with x1830963594424192 ext(3145728->3633151) 00010000:00010000:2.0:1746143770.019822:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.019840:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00002000:00010000:2.0:1746143770.019846:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f00a80 00000100:00100000:0.0:1746143770.021790:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.021824:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594424320 00000100:00100000:2.0:1746143770.021830:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594424320 00010000:00010000:2.0:1746143770.021849:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.022211:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7475 00000100:00100000:2.0:1746143770.022218:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594424320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143770.022230:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143770.022246:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.022256:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.022275:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd7312dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3633151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85a1 expref: 23 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.022295:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.022297:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.022303:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.022314:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.022340:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143770.022349:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594447488:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143770.022415:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143770.023504:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594447488:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143770.023516:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143770.023546:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594424320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1327us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.023553:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7475 00000100:00100000:0.0:1746143770.032712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.032787:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.033392:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594424576 00000100:00100000:2.0:1746143770.033400:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594424576 00000100:00100000:0.0:1746143770.033423:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143770.033437:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f3c8a80 x1830963594424576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.033446:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8a80 with x1830963594424576 ext(2097152->3145727) 00002000:00010000:2.0:1746143770.033450:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8a80 00000100:00100000:0.0:1746143770.033542:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594424960 00000100:00100000:2.0:1746143770.033543:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594425216 00000100:00100000:0.0:1746143770.033545:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594424960 00000100:00100000:2.0:1746143770.033547:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594425216 00000100:00100000:3.0:1746143770.033557:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6605 00002000:00100000:2.0:1746143770.033560:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f3c9880 x1830963594425216/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.033563:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f3cb800 x1830963594424960/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143770.033565:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594424576:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:2.0:1746143770.033566:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9880 with x1830963594425216 ext(3145728->4194303) 00002000:00010000:2.0:1746143770.033569:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c9880 00002000:00100000:0.0:1746143770.033570:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb800 with x1830963594424960 ext(2097152->3145727) 00002000:00010000:0.0:1746143770.033574:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cb800 00000100:00100000:0.0:1746143770.033585:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6606 00000100:00100000:0.0:1746143770.033590:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594425216:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143770.033595:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6607 00000100:00100000:2.0:1746143770.033600:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594424960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143770.036235:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.036314:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594425344 00000100:00100000:2.0:1746143770.036320:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594425344 00002000:00100000:2.0:1746143770.036347:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f3c8700 x1830963594425344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.036356:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8700 with x1830963594425344 ext(3145728->4194303) 00002000:00010000:2.0:1746143770.036360:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c8700 00000100:00100000:2.0:1746143770.036376:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6608 00000100:00100000:2.0:1746143770.036382:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594425344:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143770.042364:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594424960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8756us (9569us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143770.042374:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6607 00002000:00100000:2.0:1746143770.042385:0:21518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88008f3cb800 x1830963594424960/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.042393:0:21518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb800 with x1830963594424960 ext(2097152->3145727) 00002000:00010000:2.0:1746143770.042398:0:21518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3cb800 00000100:00100000:3.0:1746143770.047501:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594424576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 13928us (14787us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143770.047511:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6605 00002000:00100000:3.0:1746143770.047522:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f3c8a80 x1830963594424576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143770.047530:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8a80 with x1830963594424576 ext(2097152->3145727) 00002000:00010000:3.0:1746143770.047536:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c8a80 00000100:00100000:2.0:1746143770.052238:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594425216:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18639us (18807us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143770.052247:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6606 00002000:00100000:2.0:1746143770.052258:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88008f3c9880 x1830963594425216/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.052271:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c9880 with x1830963594425216 ext(3145728->4194303) 00002000:00010000:2.0:1746143770.052275:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3c9880 00000100:00100000:2.0:1746143770.055892:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594425344:12345-192.168.202.48@tcp:3:cat.0 Request processed in 19502us (19655us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143770.055902:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6608 00002000:00100000:2.0:1746143770.056081:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88008f3c8700 x1830963594425344/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.056090:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3c8700 with x1830963594425344 ext(3145728->4194303) 00002000:00010000:2.0:1746143770.056095:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3c8700 00000100:00100000:0.0:1746143770.062002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.062181:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594425600 00000100:00100000:2.0:1746143770.062189:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594425600 00002000:00100000:2.0:1746143770.062231:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88008f3cb100 x1830963594425600/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.062239:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb100 with x1830963594425600 ext(4194304->4771839) 00002000:00010000:2.0:1746143770.062244:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb100 00000100:00100000:2.0:1746143770.062478:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6609 00000100:00100000:2.0:1746143770.062486:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594425600:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143770.070064:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594425600:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7570us (8062us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143770.070074:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6609 00002000:00100000:2.0:1746143770.070083:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88008f3cb100 x1830963594425600/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/440 e 0 to 0 dl 1746143781 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143770.070092:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3cb100 with x1830963594425600 ext(4194304->4771839) 00002000:00010000:2.0:1746143770.070097:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3cb100 00000100:00100000:0.0:1746143770.086012:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.086097:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594425728 00000100:00100000:3.0:1746143770.086103:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594425728 00000100:00100000:3.0:1746143770.086370:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9312 00000100:00100000:3.0:1746143770.086379:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31599:x1830963594425728:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.086400:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.086416:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511000/0xe984082ccd73131c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85e7 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.086468:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086478:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086489:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086499:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086504:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086508:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086603:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086612:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.086618:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.086643:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.086660:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 20 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.086672:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594447616:192.168.202.48@tcp:104: 00000100:00080000:2.0:1746143770.086719:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143770.086848:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143770.088598:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594447616:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.088616:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143770.088697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.088730:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594425984 00000100:00100000:3.0:1746143770.088733:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594425984 00000100:00100000:3.0:1746143770.088791:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4025 00000100:00100000:3.0:1746143770.088798:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:7695:x1830963594425984:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00080000:2.0:1746143770.088808:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143770.089045:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:7695:x1830963594425984:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 246us (347us total) trans 8589943664 rc 0/0 00000100:00100000:3.0:1746143770.089051:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4025 00000100:00100000:0.0:1746143770.090045:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.090089:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594426112 00000100:00100000:2.0:1746143770.090092:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594426112 00010000:00010000:2.0:1746143770.090111:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 22 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.090137:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7476 00000100:00100000:2.0:1746143770.090180:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594426112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143770.090189:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143770.090194:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 22 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.090206:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 22 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.090222:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d9400/0xe984082ccd7311da lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a851c expref: 22 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.090237:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143770.090241:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.090249:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.090255:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.090278:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143770.090304:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143770.090331:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594426112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 151us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.090335:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7476 00010000:00010000:3.0:1746143770.090371:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143770.090398:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143770.090402:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143770.090416:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090427:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090435:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090881:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090887:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090891:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d511200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143770.090894:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090899:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090906:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:3.0:1746143770.090909:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143770.090911:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090914:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511200/0xe984082ccd731323 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090923:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090926:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090930:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090934:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d511c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143770.090935:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090939:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090943:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880129f5e400) 00010000:00010000:3.0:1746143770.090944:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143770.090946:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090949:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511c00/0xe984082ccd73132a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.090974:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511000/0xe984082ccd73131c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.090983:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.090988:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.090989:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143770.090991:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510200, rc 0) 00000100:00100000:3.0:1746143770.091026:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31599:x1830963594425728:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4649us (5020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.091031:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9312 00000100:00100000:0.0:1746143770.092831:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.093067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.093094:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.093132:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.093628:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594426368 00000100:00100000:1.0:1746143770.093629:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594426496 00000100:00100000:2.0:1746143770.093635:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594426368 00000100:00100000:1.0:1746143770.093635:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594426496 00000100:00100000:2.0:1746143770.093663:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594426624 00000100:00100000:2.0:1746143770.093665:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594426624 00000100:00100000:1.0:1746143770.093678:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13979 00000100:00100000:1.0:1746143770.093684:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594426368:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143770.093698:0:4581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.093710:0:4581:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85f5 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.093727:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.093729:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.093736:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.093746:0:4581:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 13 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.093755:0:4581:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a9cc00, rc 0) 00000100:00100000:1.0:1746143770.093786:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594426368:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 102us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.093852:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594426240 00000100:00100000:3.0:1746143770.093856:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594426240 00000100:00100000:2.0:1746143770.093933:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13980 00000100:00100000:2.0:1746143770.093939:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594426496:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143770.093945:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143770.093951:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85fc expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.093960:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.093961:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.094032:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 14 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.094041:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 14 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.094047:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b161c00, rc 0) 00000100:00100000:2.0:1746143770.094062:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594426496:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 125us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.094067:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13980 00000100:00100000:2.0:1746143770.094078:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13981 00000100:00100000:2.0:1746143770.094082:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594426624:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143770.094090:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143770.094096:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8603 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.094106:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.094107:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.094110:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 14 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.094118:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 14 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.094123:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b161e00, rc 0) 00000100:00100000:2.0:1746143770.094132:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594426624:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 51us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.094136:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13981 00000100:00080000:2.0:1746143770.094175:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746143770.094178:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143770.094247:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13979 00000100:00100000:0.0:1746143770.094493:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13982 00000100:00100000:0.0:1746143770.094500:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594426240:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143770.094506:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143770.094512:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73134d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a85ee expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.094541:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594447744:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143770.094545:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.094584:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.094640:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594426752 00000100:00100000:1.0:1746143770.094643:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594426752 00000100:00100000:1.0:1746143770.094665:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13983 00000100:00100000:1.0:1746143770.094670:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594426752:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143770.094678:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.094684:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a860a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.094693:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.094694:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.094699:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.094707:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.094713:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a9d000, rc 0) 00000100:00100000:1.0:1746143770.094731:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594426752:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.094735:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13983 00000100:00100000:2.0:1746143770.096601:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594447744:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143770.096624:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73134d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85ee expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.096634:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73134d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85ee expref: 14 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.096643:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02bd000, rc 0) 00000100:00100000:2.0:1746143770.096687:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594426240:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 2186us (3860us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143770.096693:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13982 00000100:00100000:0.0:1746143770.098284:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.098361:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594427008 00000100:00100000:3.0:1746143770.098365:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594427008 00000100:00100000:3.0:1746143770.098397:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9313 00000100:00100000:3.0:1746143770.098402:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31599:x1830963594427008:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.098414:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.098429:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511800/0xe984082ccd73135b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8611 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.098497:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.098505:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.098509:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.098659:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.098669:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 10 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.098679:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594447872:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143770.098759:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143770.102382:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.102584:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594447872:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.102605:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143770.102674:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594427136 00000100:00100000:2.0:1746143770.102680:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594427136 00010000:00010000:2.0:1746143770.102706:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 11 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.102739:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7477 00000100:00100000:2.0:1746143770.102745:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594427136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143770.102757:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143770.102762:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 11 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.102771:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 11 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.102788:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510200/0xe984082ccd731331 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85e7 expref: 11 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.102798:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143770.102802:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.102810:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.102815:0:7150:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.103066:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143770.103134:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.103173:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143770.103188:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143770.103302:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511800/0xe984082ccd73135b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8611 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.103317:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8611 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.103322:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.103325:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143770.103326:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510e00, rc 0) 00000100:00100000:2.0:1746143770.103371:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1963:x1830963594427136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 626us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.103377:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7477 00000100:00100000:3.0:1746143770.103603:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31599:x1830963594427008:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 5200us (5321us total) trans 8589943665 rc 0/0 00000100:00100000:3.0:1746143770.103608:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9313 00000100:00100000:0.0:1746143770.107197:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.107466:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594427392 00000100:00100000:3.0:1746143770.107473:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594427392 00000100:00100000:3.0:1746143770.107508:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9314 00000100:00100000:3.0:1746143770.107514:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31599:x1830963594427392:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.107532:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.107534:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143770.107555:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510e00/0xe984082ccd731362 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8611 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.107574:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.107577:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143770.107586:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510c00/0xe984082ccd731370 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8618 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.107660:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510600/0xe984082ccd731377 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.107669:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510600/0xe984082ccd731377 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.107677:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510600/0xe984082ccd731377 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143770.107685:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143770.107780:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510c00/0xe984082ccd731370 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8618 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.108903:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510600/0xe984082ccd731377 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8618 expref: 11 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.108911:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.108913:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143770.108915:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510600, rc 0) 00000100:00100000:3.0:1746143770.108963:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31599:x1830963594427392:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 1449us (1772us total) trans 8589943666 rc 0/0 00000100:00100000:3.0:1746143770.108969:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9314 00000100:00100000:0.0:1746143770.111513:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.111637:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594427520 00000100:00100000:3.0:1746143770.111645:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594427520 00000100:00100000:3.0:1746143770.111678:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9315 00000100:00100000:3.0:1746143770.111683:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:31599:x1830963594427520:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.111702:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.111715:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511e00/0xe984082ccd731385 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a861f expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.111766:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511e00/0xe984082ccd731385 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a861f expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.111781:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511e00/0xe984082ccd731385 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a861f expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.111795:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.111798:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143770.111800:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511e00, rc 0) 00000100:00100000:3.0:1746143770.111847:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31599:x1830963594427520:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 163us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.111852:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9315 00000100:00100000:0.0:1746143770.117064:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.117100:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.117128:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.117187:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.117199:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.117222:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.117320:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594427648 00000100:00100000:1.0:1746143770.117331:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594427648 00000100:00100000:1.0:1746143770.117364:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594427904 00000100:00100000:1.0:1746143770.117366:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594427904 00000100:00100000:1.0:1746143770.117376:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428160 00000100:00100000:1.0:1746143770.117378:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428160 00000100:00100000:1.0:1746143770.117387:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594427776 00000100:00100000:1.0:1746143770.117388:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594427776 00000100:00100000:1.0:1746143770.117396:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428032 00000100:00100000:1.0:1746143770.117397:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428032 00000100:00100000:3.0:1746143770.117405:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428288 00000100:00100000:3.0:1746143770.117410:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428288 00000100:00100000:1.0:1746143770.117410:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13984 00000100:00100000:1.0:1746143770.117416:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594427648:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:3.0:1746143770.117431:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13985 00000100:00100000:3.0:1746143770.117437:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963594427904:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143770.117449:0:6929:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.117454:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.117458:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13986 00010000:00010000:1.0:1746143770.117463:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.117465:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.117465:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594428160:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143770.117469:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143770.117470:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143770.117472:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.117477:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.117482:0:25369:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.117483:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 32 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.117489:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.117490:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.117493:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.117493:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.117495:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 15 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.117500:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.117505:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 15 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.117505:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.117507:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.117508:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 5/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.117509:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 32 pid: 2839 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143770.117516:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594448000:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.117517:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 32 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.117523:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 15 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143770.117526:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594448128:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143770.117531:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 15 pid: 8497 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746143770.117539:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594448256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143770.117552:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13987 00000100:00100000:2.0:1746143770.117559:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963594427776:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143770.117570:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13988 00010000:00010000:2.0:1746143770.117574:0:15784:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.117575:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594428032:12345-192.168.202.48@tcp:1:mirror_io.0 00000100:00100000:0.0:1746143770.117578:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 13989 00010000:00010000:3.0:1746143770.117579:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.117583:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.117584:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963594428288:12345-192.168.202.48@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143770.117586:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 16 pid: 8497 timeout: 949 lvb_type: 1 00010000:00010000:2.0:1746143770.117590:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.117591:0:8496:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143770.117594:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594448384:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143770.117596:0:15784:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 32 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.117598:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.117599:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 15 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.117600:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.117601:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.117603:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.117605:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.117607:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.117612:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 16 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.117615:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 16 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.117615:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 32 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.117616:0:8496:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 21 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.117617:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.117621:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.117622:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.117622:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 32 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.117622:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.117622:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.117623:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.117624:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.117625:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 6/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143770.117629:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594448512:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143770.117634:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594448640:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143770.117638:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 21 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.117638:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143770.117641:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143770.117645:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 16 pid: 4581 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.117646:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 21 pid: 4582 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746143770.117653:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594448896:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143770.117654:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594448768:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143770.117655:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 16 pid: 4581 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.117662:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 16 pid: 4581 timeout: 949 lvb_type: 1 00000100:00100000:2.0:1746143770.117668:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594449024:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143770.117681:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 16 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143770.117688:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 16 pid: 6929 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.117690:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 15 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.117695:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594449152:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143770.117698:0:15784:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.117698:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 15 pid: 15784 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.117706:0:15784:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 16 pid: 2839 timeout: 949 lvb_type: 0 00000100:00100000:1.0:1746143770.117706:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594449280:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143770.117712:0:15784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594449408:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143770.117715:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 32 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.117722:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 32 pid: 8497 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.117727:0:15784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310d70c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143770.117727:0:8496:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 15 pid: 8496 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143770.117729:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594449536:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143770.117739:0:8496:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 15 pid: 8496 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746143770.117742:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.117745:0:8496:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594449664:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143770.117760:0:8496:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c783d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143770.117785:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c7836c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143770.117971:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 15 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.117978:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 15 pid: 8495 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.117985:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594449792:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143770.118020:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143770.127255:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594448128:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143770.127524:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594448256:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143770.127778:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594448000:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143770.127801:0:6929:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.127896:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.127932:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.127941:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594448640:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143770.127946:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.127958:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428416 00000100:00100000:1.0:1746143770.127958:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428672 00000100:00100000:2.0:1746143770.127963:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428416 00000100:00100000:1.0:1746143770.127963:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428672 00010000:00010000:2.0:1746143770.127987:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 16 pid: 8497 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.127987:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 17 pid: 8497 timeout: 949 lvb_type: 1 00000100:00100000:3.0:1746143770.128029:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594448384:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143770.128036:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21542:1830963594448512:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.128056:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.128227:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428544 00000100:00100000:1.0:1746143770.128281:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7478 00000100:00100000:1.0:1746143770.128289:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:1963:x1830963594428672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.128299:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.128318:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 17 pid: 8497 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.128327:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 17 pid: 8497 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.128344:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b161c00/0xe984082ccd73133f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85fc expref: 17 pid: 8497 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.128365:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.128397:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1963:x1830963594428672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.128416:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428544 00002000:00100000:0.0:1746143770.128441:0:25543:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x351:0x0] (544768->671743) req@ffff8800a5d80380 x1830963594428544/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/0 e 0 to 0 dl 1746143781 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143770.128449:0:25543:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963594428544 ext(544768->671743) 00000100:00100000:2.0:1746143770.128454:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7479 00010000:00010000:0.0:1746143770.128454:0:25543:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.128460:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1964:x1830963594428416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.128466:0:25543:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.128467:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143770.128471:0:25543:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80380 00010000:00010000:2.0:1746143770.128478:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 16 pid: 8497 timeout: 949 lvb_type: 1 00010000:00010000:2.0:1746143770.128485:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 16 pid: 8497 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746143770.128487:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1869 00000100:00100000:0.0:1746143770.128491:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594428544:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:2.0:1746143770.128496:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b161e00/0xe984082ccd731346 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8603 expref: 16 pid: 8497 timeout: 949 lvb_type: 1 00010000:00010000:2.0:1746143770.128508:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143770.128522:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594428416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 63us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.128527:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7479 00000100:00100000:0.0:1746143770.128651:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.128702:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.128737:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594448896:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143770.128801:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.128813:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428800 00000100:00100000:0.0:1746143770.128816:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428800 00000100:00080000:2.0:1746143770.128829:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746143770.128832:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 33 pid: 2839 timeout: 949 lvb_type: 1 00000100:00100000:2.0:1746143770.128836:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594428928 00000100:00100000:2.0:1746143770.128838:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594428928 00000100:00100000:0.0:1746143770.128842:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429184 00000100:00100000:0.0:1746143770.128843:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429184 00010000:00010000:2.0:1746143770.128846:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 34 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.128850:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 17 pid: 4581 timeout: 949 lvb_type: 1 00000100:00100000:2.0:1746143770.128856:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7480 00000100:00100000:2.0:1746143770.128860:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594428800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143770.128860:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7481 00000100:00100000:0.0:1746143770.128864:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963594428928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143770.128867:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.128867:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143770.128874:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 34 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.128874:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 34 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:2.0:1746143770.128881:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 34 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.128881:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 34 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:2.0:1746143770.128891:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a57afe00/0xe984082ccd731266 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8569 expref: 34 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.128896:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a7b600/0xe984082ccd7311b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f9 expref: 34 pid: 2839 timeout: 949 lvb_type: 1 00010000:00010000:2.0:1746143770.128899:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.128902:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7482 00010000:00010000:0.0:1746143770.128905:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.128911:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594429184:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143770.128916:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594428800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.128916:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594428928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 51us (214us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143770.128919:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143770.128921:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7481 00010000:00010000:3.0:1746143770.128930:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 17 pid: 4581 timeout: 949 lvb_type: 1 00010000:00010000:3.0:1746143770.128940:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 17 pid: 4581 timeout: 949 lvb_type: 1 00010000:00010000:3.0:1746143770.128951:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6dfc00/0xe984082ccd731300 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85cb expref: 17 pid: 4581 timeout: 949 lvb_type: 1 00010000:00010000:3.0:1746143770.128964:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.128978:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594429184:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.128983:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7482 00000100:00100000:1.0:1746143770.129046:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7478 00000100:00100000:1.0:1746143770.129097:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594448768:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143770.129119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.129132:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429056 00000100:00100000:1.0:1746143770.129134:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429056 00010000:00010000:1.0:1746143770.129169:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00000100:00100000:1.0:1746143770.129184:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7483 00000100:00100000:1.0:1746143770.129188:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594429056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.129194:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.129201:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:1.0:1746143770.129209:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:1.0:1746143770.129219:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a61ff600/0xe984082ccd7311be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8507 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:1.0:1746143770.129227:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.129228:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.129232:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.129239:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.129267:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.129282:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1963:x1830963594429056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.129287:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7483 00000100:00100000:2.0:1746143770.129321:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7480 00000100:00100000:1.0:1746143770.129340:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.129342:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594449024:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143770.129348:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429312 00000100:00100000:1.0:1746143770.129350:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429312 00010000:00010000:1.0:1746143770.129362:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 22 pid: 4582 timeout: 949 lvb_type: 1 00000100:00100000:1.0:1746143770.129374:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7484 00000100:00100000:2.0:1746143770.129376:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.129378:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1963:x1830963594429312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.129384:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.129393:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 22 pid: 4582 timeout: 949 lvb_type: 1 00000100:00100000:2.0:1746143770.129396:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143770.129400:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 22 pid: 4582 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.129411:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbc6400/0xe984082ccd73101a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83e1 expref: 22 pid: 4582 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.129422:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143770.129436:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594429312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 58us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.129441:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7484 00000100:00100000:2.0:1746143770.129558:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.129681:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429440 00000100:00100000:1.0:1746143770.129684:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429440 00010000:00010000:1.0:1746143770.129694:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 16 pid: 4581 timeout: 949 lvb_type: 1 00000100:00100000:1.0:1746143770.129706:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429568 00000100:00100000:1.0:1746143770.129708:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429568 00010000:00010000:1.0:1746143770.129716:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 17 pid: 6929 timeout: 949 lvb_type: 1 00000100:00100000:1.0:1746143770.129725:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7485 00000100:00100000:1.0:1746143770.129729:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+17:1962:x1830963594429440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143770.129734:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143770.129741:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 17 pid: 4581 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.129749:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 17 pid: 4581 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.129758:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a9cc00/0xe984082ccd731338 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85f5 expref: 17 pid: 4581 timeout: 949 lvb_type: 1 00010000:00010000:1.0:1746143770.129770:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.129824:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7486 00000100:00100000:3.0:1746143770.129829:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1965:x1830963594429568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143770.129834:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143770.129844:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 16 pid: 6929 timeout: 949 lvb_type: 1 00010000:00010000:3.0:1746143770.129850:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 16 pid: 6929 timeout: 949 lvb_type: 1 00010000:00010000:3.0:1746143770.129858:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143770.129897:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a9d000/0xe984082ccd731354 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a860a expref: 16 pid: 6929 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746143770.129909:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594449152:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143770.129917:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429696 00000100:00100000:0.0:1746143770.129919:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429696 00010000:00010000:0.0:1746143770.129933:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 18 pid: 15784 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746143770.129945:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7487 00000100:00100000:0.0:1746143770.129950:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594429696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.129958:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.129965:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 18 pid: 15784 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.129980:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 18 pid: 15784 timeout: 949 lvb_type: 0 00000100:00100000:1.0:1746143770.129997:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1962:x1830963594429440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 266us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.130016:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594429568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 188us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.130021:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7486 00010000:00010000:3.0:1746143770.130041:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130047:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130062:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130073:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130080:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130086:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d510200 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143770.130089:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130096:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130105:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.130111:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d510200/0xe984082ccd731393 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.130219:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7485 00000100:00100000:1.0:1746143770.130259:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594449280:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143770.130325:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a91f800/0xe984082ccd73102f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83f6 expref: 18 pid: 15784 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.130333:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143770.130925:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594427904:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 13487us (13822us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.130929:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594429696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 978us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.130933:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13985 00000100:00100000:0.0:1746143770.130934:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7487 00000100:00100000:3.0:1746143770.133193:0:15784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15784:1830963594449408:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.133221:0:15784:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.135111:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594428544:12345-192.168.202.48@tcp:4:cat.0 Request processed in 6613us (7171us total) trans 21474840550 rc 0/0 00000100:00100000:1.0:1746143770.135121:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1869 00002000:00100000:1.0:1746143770.135132:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (544768->671743) req@ffff8800a5d80380 x1830963594428544/t21474840550(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:166/0 lens 488/448 e 0 to 0 dl 1746143781 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143770.135222:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830963594428544 ext(544768->671743) 00010000:00010000:1.0:1746143770.135231:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 17 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:1.0:1746143770.135242:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 17 pid: 8497 timeout: 949 lvb_type: 0 00002000:00010000:1.0:1746143770.135249:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d80380 00000100:00100000:0.0:1746143770.135983:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594449536:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143770.136007:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143770.136087:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.136101:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143770.136133:0:8496:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8496:1830963594449664:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143770.136185:0:8496:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143770.136283:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.136410:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594449792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.136429:0:25369:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143770.136576:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.136672:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429824 00000100:00100000:0.0:1746143770.136677:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429824 00010000:00010000:0.0:1746143770.136701:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 15 pid: 2839 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746143770.136719:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594429952 00000100:00100000:0.0:1746143770.136721:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594429952 00010000:00010000:0.0:1746143770.136730:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 31 pid: 8497 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746143770.136751:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430080 00000100:00100000:0.0:1746143770.136753:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430080 00010000:00010000:0.0:1746143770.136762:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 15 pid: 8496 timeout: 949 lvb_type: 1 00000100:00100000:0.0:1746143770.136774:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7488 00000100:00100000:0.0:1746143770.136779:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1962:x1830963594429824:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.136790:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.136805:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 15 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.136812:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 15 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.136827:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a07ddc00/0xe984082ccd7311a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84f2 expref: 15 pid: 2839 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.136838:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.136839:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.136843:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.136849:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.136864:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.136892:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1962:x1830963594429824:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 112us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.136897:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7488 00000100:00100000:0.0:1746143770.136908:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7489 00000100:00100000:0.0:1746143770.136913:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1963:x1830963594429952:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.136920:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.136929:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 31 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.136936:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 31 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.136946:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0800/0xe984082ccd7312b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a859a expref: 31 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.136953:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.136954:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.136957:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.136962:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.136972:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.136983:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1963:x1830963594429952:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 70us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.136987:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7489 00000100:00100000:0.0:1746143770.136994:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7490 00000100:00100000:0.0:1746143770.136998:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1962:x1830963594430080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.137003:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.137012:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 15 pid: 8496 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.137020:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 15 pid: 8496 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.137029:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba27800/0xe984082ccd730ed8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a835c expref: 15 pid: 8496 timeout: 949 lvb_type: 1 00010000:00010000:0.0:1746143770.137035:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.137036:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143770.137038:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137043:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137053:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143770.137114:0:8496:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137121:0:8496:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137137:0:8496:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137165:0:8496:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137172:0:8496:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137178:0:8496:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a9ca00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143770.137180:0:8496:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137186:0:8496:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137195:0:8496:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143770.137200:0:8496:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a9ca00/0xe984082ccd7313a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143770.137236:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594428032:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 19660us (20036us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.137242:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13988 00010000:00010000:3.0:1746143770.137309:0:15784:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137316:0:15784:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137330:0:15784:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137336:0:15784:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137342:0:15784:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137347:0:15784:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b161800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143770.137349:0:15784:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137354:0:15784:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137362:0:15784:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137366:0:15784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7313a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143770.137394:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594427776:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 19836us (20207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.137399:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13987 00000100:00100000:3.0:1746143770.137573:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430208 00000100:00100000:3.0:1746143770.137577:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430208 00010000:00010000:3.0:1746143770.137591:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 17 pid: 8495 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.137605:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7491 00000100:00100000:3.0:1746143770.137608:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963594430208:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143770.137614:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143770.137622:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 17 pid: 8495 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.137629:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 17 pid: 8495 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.137638:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d510000/0xe984082ccd73130e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a85d9 expref: 17 pid: 8495 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.137645:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.137647:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.137649:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137654:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137666:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.137683:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594430208:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 74us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.137687:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7491 00010000:00010000:3.0:1746143770.137701:0:25369:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137707:0:25369:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137718:0:25369:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137723:0:25369:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137728:0:25369:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137732:0:25369:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bd000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143770.137734:0:25369:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137739:0:25369:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137750:0:25369:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.137755:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bd000/0xe984082ccd73139a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143770.137780:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594428160:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 20317us (20651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.137786:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13986 00000100:00100000:0.0:1746143770.137906:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594430080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 906us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.137910:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7490 00010000:00010000:0.0:1746143770.137925:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137931:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137941:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137950:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137954:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137958:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bd800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143770.137960:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137964:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137972:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.137977:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02bd800/0xe984082ccd7313af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.138001:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a00c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594428288:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 20418us (20778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.138006:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13989 00000100:00100000:0.0:1746143770.143894:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.143970:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430336 00000100:00100000:2.0:1746143770.143982:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430336 00010000:00010000:2.0:1746143770.144009:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.144033:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7492 00000100:00100000:2.0:1746143770.144040:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594430336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143770.144052:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143770.144071:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.144082:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.144099:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a61ff000/0xe984082ccd73129e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 544768->671743) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8585 expref: 16 pid: 8497 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.144186:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.144188:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.144192:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.144201:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.144224:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143770.144231:0:6929:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.144241:0:6929:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.144259:0:6929:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143770.144265:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594430336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 226us (379us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143770.144265:0:6929:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143770.144271:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7492 00010000:00010000:0.0:1746143770.144272:0:6929:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.144277:0:6929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a9de00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143770.144280:0:6929:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.144287:0:6929:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.144296:0:6929:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143770.144301:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a9de00/0xe984082ccd73138c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.144366:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594427648:12345-192.168.202.48@tcp:1:mirror_io.0 Request processed in 26949us (27307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143770.144373:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 13984 00000100:00100000:2.0:1746143770.147287:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.147343:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430592 00000100:00100000:3.0:1746143770.147350:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430592 00000100:00100000:3.0:1746143770.147446:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9316 00000100:00100000:3.0:1746143770.147454:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:31599:x1830963594430592:12345-192.168.202.48@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143770.147490:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143770.147509:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d511e00/0xe984082ccd731385 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a861f expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147625:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.147629:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143770.147658:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.147668:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147674:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 20 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147681:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147686:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147693:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147700:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147706:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147712:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.147736:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.147746:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 20 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.147757:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594449920:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.148190:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.148202:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 251 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.148209:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450048:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.148614:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.148623:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 20 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.148630:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.148658:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.148665:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 251 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.148672:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450304:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.148693:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 251 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.148699:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 251 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.148706:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450432:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.148727:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 20 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.148733:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 20 pid: 2976 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.148740:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450560:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.148759:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.148765:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 20 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.148772:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450688:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143770.148785:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143770.151350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.151371:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.151465:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431232 00000100:00100000:3.0:1746143770.151472:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431232 00000100:00100000:2.0:1746143770.151574:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430720 00000100:00100000:2.0:1746143770.151577:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430720 00000100:00080000:2.0:1746143770.151585:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143770.151612:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 253 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.151699:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4026 00000100:00100000:3.0:1746143770.151707:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009498f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:23699:x1830963594431232:12345-192.168.202.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143770.151836:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7493 00000100:00100000:2.0:1746143770.151842:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1965:x1830963594430720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143770.151851:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143770.151856:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 254 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.151865:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 254 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.151873:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009498f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:23699:x1830963594431232:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 167us (528us total) trans 8589943667 rc 0/0 00000100:00100000:3.0:1746143770.151880:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4026 00010000:00010000:2.0:1746143770.151882:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143770.151885:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.151893:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143770.151910:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1965:x1830963594430720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.151915:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7493 00000100:00100000:3.0:1746143770.151934:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594449920:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143770.151943:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143770.151944:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800938ba400/0xe984082ccd731227 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a854d expref: 252 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.151954:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431104 00000100:00100000:2.0:1746143770.151957:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431104 00000100:00100000:3.0:1746143770.151958:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450048:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143770.151966:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450304:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143770.151967:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 252 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.151972:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450432:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143770.152287:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7494 00000100:00100000:3.0:1746143770.152293:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:1965:x1830963594431104:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143770.152300:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143770.152304:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 252 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.152311:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 252 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.152323:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd730ffe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83c5 expref: 252 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.152329:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.152332:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.152337:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.152352:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963594431104:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.152357:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7494 00000100:00100000:3.0:1746143770.152382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.152403:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594430848 00000100:00100000:0.0:1746143770.152408:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594430848 00000100:00100000:3.0:1746143770.152421:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143770.152422:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 21 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746143770.152437:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431360 00000100:00100000:3.0:1746143770.152438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.152439:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431360 00010000:00010000:0.0:1746143770.152447:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 22 pid: 2976 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746143770.152460:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7495 00000100:00100000:0.0:1746143770.152465:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594430848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.152472:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143770.152476:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 22 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.152484:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 22 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.152495:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a61ff800/0xe984082ccd731290 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a857e expref: 22 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.152503:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:0.0:1746143770.152507:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143770.152512:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.152523:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.152529:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1965:x1830963594430848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 64us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.152539:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431744 00000100:00100000:0.0:1746143770.152539:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7495 00000100:00100000:3.0:1746143770.152542:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431744 00000100:00100000:0.0:1746143770.152551:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7496 00010000:00010000:3.0:1746143770.152553:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 21 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:0.0:1746143770.152556:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594431360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.152561:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143770.152565:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7497 00010000:00010000:0.0:1746143770.152565:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 21 pid: 2976 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.152570:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594431744:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143770.152573:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 21 pid: 2976 timeout: 949 lvb_type: 0 00010000:00010000:0.0:1746143770.152582:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00000100:00100000:1.0:1746143770.152589:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431616 00010000:00010000:0.0:1746143770.152589:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143770.152592:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431616 00010000:00010000:0.0:1746143770.152594:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143770.152606:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594431360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 50us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143770.152611:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4027 00000100:00100000:0.0:1746143770.152612:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7496 00000100:00100000:1.0:1746143770.152617:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:15421:x1830963594431616:12345-192.168.202.48@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746143770.152634:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143770.152639:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 21 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.152646:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 21 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:1.0:1746143770.152695:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:15421:x1830963594431616:12345-192.168.202.48@tcp:35:ldlm_bl.0 Request processed in 78us (256us total) trans 8589943668 rc 0/0 00000100:00100000:1.0:1746143770.152701:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4027 00010000:00010000:3.0:1746143770.152730:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.152734:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.152739:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.152753:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594431744:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 183us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.152759:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7497 00000100:00100000:3.0:1746143770.152781:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450176:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.152789:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd730fe9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b7 expref: 20 pid: 2976 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.152802:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450560:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.152810:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c25aa00/0xe984082ccd730fc6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a83b0 expref: 19 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.152817:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594450688:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143770.152844:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143770.154901:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.154985:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594431872 00000100:00100000:3.0:1746143770.154990:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594431872 00010000:00010000:3.0:1746143770.155010:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 251 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:3.0:1746143770.155042:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7498 00000100:00100000:3.0:1746143770.155047:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+251:1965:x1830963594431872:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143770.155056:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143770.155060:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 251 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.155067:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 251 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.155080:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a63ffc00/0xe984082ccd731139 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8497 expref: 251 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:3.0:1746143770.155092:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.155096:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.155102:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143770.155127:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:1965:x1830963594431872:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.155133:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7498 00000100:00100000:0.0:1746143770.156235:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.156381:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432000 00000100:00100000:2.0:1746143770.156385:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432000 00010000:00010000:2.0:1746143770.156402:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 19 pid: 14762 timeout: 949 lvb_type: 0 00000100:00100000:2.0:1746143770.156431:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7499 00000100:00100000:2.0:1746143770.156436:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594432000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143770.156444:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143770.156448:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 19 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.156456:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 19 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.156468:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fafa000/0xe984082ccd731171 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a84c1 expref: 19 pid: 14762 timeout: 949 lvb_type: 0 00010000:00010000:2.0:1746143770.156488:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143770.156491:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.156501:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.156506:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143770.156523:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143770.156545:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594432000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.156551:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7499 00010000:00010000:3.0:1746143770.156998:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.157004:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000040:00080000:3.0:1746143770.157589:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2768, 88 off234128 00000004:00080000:3.0:1746143770.157596:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167456358ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157651:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2775, 88 off234920 00000004:00080000:3.0:1746143770.157657:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167517186ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143770.157682:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2776, 88 off235008 00000004:00080000:3.0:1746143770.157685:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167545524ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143770.157692:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2769, 88 off234216 00000004:00080000:3.0:1746143770.157695:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167555063ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157700:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2770, 88 off234304 00000004:00080000:3.0:1746143770.157702:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167562436ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157708:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2777, 88 off235096 00000004:00080000:3.0:1746143770.157711:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167571006ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143770.157716:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2778, 88 off235184 00000004:00080000:3.0:1746143770.157720:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167580084ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143770.157726:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2779, 88 off235272 00000004:00080000:3.0:1746143770.157729:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167588689ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143770.157735:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2771, 88 off234392 00000004:00080000:3.0:1746143770.157737:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167597878ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157743:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2780, 88 off235360 00000004:00080000:3.0:1746143770.157745:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167605131ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143770.157750:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2772, 88 off234480 00000004:00080000:3.0:1746143770.157752:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167612729ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157757:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2781, 88 off235448 00000004:00080000:3.0:1746143770.157760:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167620158ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143770.157764:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2773, 88 off234568 00000004:00080000:3.0:1746143770.157766:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167626803ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157772:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2774, 88 off234656 00000004:00080000:3.0:1746143770.157774:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167634889ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157780:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2775, 88 off234744 00000004:00080000:3.0:1746143770.157782:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167642409ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157787:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2776, 88 off234832 00000004:00080000:3.0:1746143770.157789:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 849167649673ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143770.157795:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2782, 88 off235536 00000004:00080000:3.0:1746143770.157797:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849167657246ns, next at 833304778357ns, rc = 0 00000004:00010000:3.0:1746143770.181281:0:14762:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ff6fb80 reply state ffff88009a795800 transno 8589943669 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:3.0:1746143770.181293:0:14762:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143770.181381:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:31599:x1830963594430592:12345-192.168.202.48@tcp:36:mirror_io.0 Request processed in 33925us (34097us total) trans 8589943669 rc 0/0 00000100:00100000:3.0:1746143770.181389:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9316 00000001:00080000:0.0:1746143770.181518:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943658 is committed 00000001:00080000:0.0:1746143770.181528:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943653 is committed 00000001:00080000:0.0:1746143770.181532:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943668 is committed 00000001:00080000:0.0:1746143770.181541:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943646 is committed 00000001:00080000:0.0:1746143770.181565:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943669 is committed 00000004:00080000:0.0:1746143770.181568:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2117 committed 00000004:00080000:0.0:1746143770.181574:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2111 committed 00000004:00080000:0.0:1746143770.181579:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2110 committed 00000004:00080000:0.0:1746143770.181581:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2109 committed 00000004:00080000:0.0:1746143770.181583:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2108 committed 00000004:00080000:0.0:1746143770.181585:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2116 committed 00000004:00080000:0.0:1746143770.181587:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2107 committed 00000004:00080000:0.0:1746143770.181588:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2115 committed 00000004:00080000:0.0:1746143770.181590:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2106 committed 00000004:00080000:0.0:1746143770.181592:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2114 committed 00000004:00080000:0.0:1746143770.181593:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2113 committed 00000004:00080000:0.0:1746143770.181595:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2112 committed 00000004:00080000:0.0:1746143770.181596:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2105 committed 00000004:00080000:0.0:1746143770.181598:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2104 committed 00000004:00080000:0.0:1746143770.181599:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2111 committed 00000004:00080000:0.0:1746143770.181600:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2110 committed 00000004:00080000:0.0:1746143770.181602:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2103 committed 00000001:00080000:0.0:1746143770.181605:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943667 is committed 00000100:00100000:0.0:1746143770.181729:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594450944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181766:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181792:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594451456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181806:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181820:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143770.181824:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594450816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181836:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181845:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594451328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181855:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181868:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181880:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181888:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181898:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181907:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143770.181910:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181920:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181928:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.181939:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143770.181954:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594450944 00000100:00100000:0.0:1746143770.181959:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594450944 00000100:00100000:0.0:1746143770.181979:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451456 00000100:00100000:0.0:1746143770.181981:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451456 00000100:00100000:0.0:1746143770.181989:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594450816 00000100:00100000:0.0:1746143770.181990:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594450816 00000100:00100000:0.0:1746143770.181997:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451328 00000100:00100000:0.0:1746143770.181999:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451328 00000100:00100000:0.0:1746143770.182006:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451200 00000100:00100000:0.0:1746143770.182007:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451200 00000100:00100000:0.0:1746143770.182013:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451712 00000100:00100000:0.0:1746143770.182014:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451712 00000100:00100000:0.0:1746143770.182020:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451072 00000100:00100000:0.0:1746143770.182021:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451072 00000100:00100000:0.0:1746143770.182027:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451584 00000100:00100000:0.0:1746143770.182028:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451584 00000100:00100000:0.0:1746143770.182036:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13990 00000100:00100000:0.0:1746143770.182041:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3295:x1830963594450944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.182222:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3295:x1830963594450944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (454us total) trans 21474840551 rc 0/0 00000100:00100000:0.0:1746143770.182228:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13990 00000100:00100000:0.0:1746143770.182237:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13991 00000100:00100000:0.0:1746143770.182242:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3295:x1830963594451456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.182307:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3295:x1830963594451456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (500us total) trans 21474840552 rc 0/0 00000100:00100000:0.0:1746143770.182312:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13991 00000100:00100000:0.0:1746143770.182319:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13992 00000100:00100000:0.0:1746143770.182323:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3295:x1830963594450816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.182388:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3295:x1830963594450816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (550us total) trans 21474840553 rc 0/0 00000100:00100000:0.0:1746143770.182393:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13992 00000100:00100000:0.0:1746143770.182401:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13993 00000100:00100000:0.0:1746143770.182405:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3295:x1830963594451328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.182462:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3295:x1830963594451328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (605us total) trans 21474840554 rc 0/0 00000100:00100000:0.0:1746143770.182467:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13993 00000100:00100000:0.0:1746143770.182474:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13994 00000100:00100000:0.0:1746143770.182478:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3293:x1830963594451200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143770.182538:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3293:x1830963594451200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (657us total) trans 21474840555 rc 0/0 00000100:00100000:0.0:1746143770.182543:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13994 00000100:00100000:0.0:1746143770.182550:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13995 00000100:00100000:0.0:1746143770.182554:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3293:x1830963594451712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143770.183006:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143770.183031:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.183048:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143770.183059:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.183067:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143770.183071:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143770.183081:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.183087:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143770.183098:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.183110:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452096 00000100:00100000:1.0:1746143770.183113:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452096 00000100:00100000:1.0:1746143770.183127:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452608 00000100:00100000:1.0:1746143770.183128:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452608 00000100:00100000:1.0:1746143770.183133:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452224 00000100:00100000:1.0:1746143770.183135:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452224 00000100:00100000:1.0:1746143770.183172:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452736 00000100:00100000:1.0:1746143770.183174:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452736 00000100:00100000:1.0:1746143770.183182:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13996 00000100:00100000:1.0:1746143770.183187:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3293:x1830963594451072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143770.183273:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3293:x1830963594451072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1351us total) trans 21474840557 rc 0/0 00000100:00100000:1.0:1746143770.183278:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13996 00000100:00100000:1.0:1746143770.183286:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13997 00000100:00100000:1.0:1746143770.183291:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3293:x1830963594451584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143770.183352:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3293:x1830963594451584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1411us total) trans 21474840558 rc 0/0 00000100:00100000:1.0:1746143770.183357:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13997 00000100:00100000:1.0:1746143770.183365:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13998 00000100:00100000:1.0:1746143770.183369:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594452096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143770.183459:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594452096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (427us total) trans 17179873225 rc 0/0 00000100:00100000:1.0:1746143770.183464:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13998 00000100:00100000:1.0:1746143770.183473:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13999 00000100:00100000:1.0:1746143770.183477:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594452608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143770.183537:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594452608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (476us total) trans 17179873226 rc 0/0 00000100:00100000:1.0:1746143770.183542:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13999 00000100:00100000:1.0:1746143770.183549:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14000 00000100:00100000:1.0:1746143770.183553:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594452224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143770.183606:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143770.183609:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143770.183611:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143770.183614:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143770.183616:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143770.183630:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594452224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (548us total) trans 17179873227 rc 0/0 00000100:00100000:1.0:1746143770.183635:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14000 00000100:00100000:1.0:1746143770.183643:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14001 00000100:00100000:1.0:1746143770.183647:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3292:x1830963594452736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143770.183705:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3292:x1830963594452736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (605us total) trans 17179873228 rc 0/0 00000100:00100000:1.0:1746143770.183709:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14001 00000004:00080000:1.0:1746143770.183740:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83800/2, rc 0, transno 17179873227 00000100:00100000:1.0:1746143770.183744:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452224:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143770.183750:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80a80/2, rc 0, transno 17179873228 00000100:00100000:1.0:1746143770.183753:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143770.183758:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83b80/2, rc 0, transno 17179873225 00000100:00100000:1.0:1746143770.183760:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452096:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143770.183765:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81880/2, rc 0, transno 17179873226 00000100:00100000:1.0:1746143770.183768:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594452608:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143770.183839:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.183850:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.183856:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.183861:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbc6400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:3.0:1746143770.183865:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.183871:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.183882:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.183884:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143770.183888:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.183892:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc6400/0xe984082ccd7313b6 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00000100:00100000:3.0:1746143770.183908:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594451840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.183928:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143770.183945:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594452352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.183956:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143770.183965:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143770.183969:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594451968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.183979:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143770.183985:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594452480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.183997:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143770.184010:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451840 00000100:00100000:3.0:1746143770.184013:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451840 00000100:00100000:3.0:1746143770.184023:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452352 00000100:00100000:3.0:1746143770.184024:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452352 00000100:00100000:3.0:1746143770.184029:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451968 00000100:00100000:3.0:1746143770.184031:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451968 00000100:00100000:3.0:1746143770.184035:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452480 00000100:00100000:3.0:1746143770.184037:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452480 00000100:00100000:3.0:1746143770.184043:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14002 00000100:00100000:3.0:1746143770.184047:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594451840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.184128:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594451840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (199us total) trans 17179873229 rc 0/0 00000100:00100000:3.0:1746143770.184133:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14002 00000100:00100000:3.0:1746143770.184172:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14003 00000100:00100000:3.0:1746143770.184177:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594452352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.184241:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594452352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (284us total) trans 17179873230 rc 0/0 00000100:00100000:3.0:1746143770.184246:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14003 00000100:00100000:3.0:1746143770.184254:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14004 00000100:00100000:3.0:1746143770.184258:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594451968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.184322:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594451968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (341us total) trans 17179873231 rc 0/0 00000100:00100000:3.0:1746143770.184327:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14004 00000100:00100000:3.0:1746143770.184334:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14005 00000100:00100000:3.0:1746143770.184338:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3294:x1830963594452480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143770.184397:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+53:3294:x1830963594452480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (398us total) trans 17179873232 rc 0/0 00000100:00100000:3.0:1746143770.184402:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14005 00000004:00080000:3.0:1746143770.184430:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d82300/2, rc 0, transno 17179873231 00000100:00100000:3.0:1746143770.184433:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594451968:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143770.184439:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81180/2, rc 0, transno 17179873232 00000100:00100000:3.0:1746143770.184441:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594452480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143770.184447:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81f80/2, rc 0, transno 17179873229 00000100:00100000:3.0:1746143770.184449:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594451840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143770.184454:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80700/2, rc 0, transno 17179873230 00000100:00100000:3.0:1746143770.184457:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594452352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143770.184722:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efadc00/2, rc 0, transno 21474840557 00000100:00100000:2.0:1746143770.184731:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143770.184739:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efaca80/2, rc 0, transno 21474840558 00000100:00100000:2.0:1746143770.184742:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143770.184748:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efae680/2, rc 0, transno 21474840555 00000100:00100000:2.0:1746143770.184751:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143770.184765:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efac700/2, rc 0, transno 21474840553 00000100:00100000:2.0:1746143770.184768:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594450816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143770.184775:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efafb80/2, rc 0, transno 21474840554 00000100:00100000:2.0:1746143770.184777:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594451328:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143770.184784:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efadf80/2, rc 0, transno 21474840551 00000100:00100000:2.0:1746143770.184786:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594450944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143770.184793:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efad880/2, rc 0, transno 21474840552 00000100:00100000:2.0:1746143770.184795:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594451456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143770.186180:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594452864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143770.186214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143770.186275:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452864 00000100:00100000:1.0:1746143770.186279:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452864 00000100:00100000:1.0:1746143770.186301:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14006 00000100:00100000:1.0:1746143770.186306:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3294:x1830963594452864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143770.186447:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3294:x1830963594452864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (232us total) trans 21474840559 rc 0/0 00000100:00100000:1.0:1746143770.186452:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14006 00000100:00100000:0.0:1746143770.186638:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3293:x1830963594451712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4082us (4737us total) trans 21474840556 rc 0/0 00000100:00100000:0.0:1746143770.186644:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13995 00000004:00080000:3.0:1746143770.186841:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130fd7480/2, rc 0, transno 21474840559 00000100:00100000:3.0:1746143770.186845:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594452864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143770.186911:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efad180/2, rc 0, transno 21474840556 00000100:00100000:2.0:1746143770.186915:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594451712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143770.187226:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.187279:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432128 00000100:00100000:3.0:1746143770.187282:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432128 00000100:00100000:3.0:1746143770.187356:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9317 00000100:00100000:3.0:1746143770.187362:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31599:x1830963594432128:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.187375:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.187387:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8626 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.187427:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.187442:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.187455:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.187458:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143770.187460:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b0c00, rc 0) 00000100:00100000:3.0:1746143770.187688:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31599:x1830963594432128:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 325us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.187693:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9317 00000100:00100000:0.0:1746143770.201351:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143770.202236:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432256 00000100:00100000:3.0:1746143770.202243:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432256 00000100:00100000:3.0:1746143770.202281:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9318 00000100:00100000:3.0:1746143770.202288:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31599:x1830963594432256:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.202302:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.202315:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1200/0xe984082ccd7313c4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a862d expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.202379:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.202390:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.202399:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143770.202420:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:3.0:1746143770.202423:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746143770.202436:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143770.202454:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1200/0xe984082ccd7313c4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.202472:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.202479:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143770.202481:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143770.202484:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b0600, rc 0) 00000100:00100000:3.0:1746143770.202532:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31599:x1830963594432256:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 244us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.202538:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9318 00000100:00100000:0.0:1746143770.206730:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.206770:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.206795:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.206796:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432512 00000100:00100000:2.0:1746143770.206805:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432512 00000100:00100000:0.0:1746143770.206808:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143770.206821:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143770.206855:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432768 00000100:00100000:2.0:1746143770.206857:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432768 00000100:00100000:2.0:1746143770.206868:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433024 00000100:00100000:2.0:1746143770.206869:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433024 00000100:00100000:2.0:1746143770.206877:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432384 00000100:00100000:2.0:1746143770.206878:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432384 00000100:00100000:2.0:1746143770.206887:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432640 00000100:00100000:2.0:1746143770.206888:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432640 00000100:00100000:3.0:1746143770.206894:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14007 00000100:00100000:3.0:1746143770.206902:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594432512:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.206916:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.206930:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a863b expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143770.206949:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a19, atime: 0x68140a19, ctime: 0x68140a19, blocks: 0x821 00000100:00100000:2.0:1746143770.206957:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14008 00000100:00100000:2.0:1746143770.206962:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594432768:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143770.206963:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.206965:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.206968:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.206972:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.206977:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8649 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143770.206984:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143770.206988:0:2839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a18, atime: 0x68140a18, ctime: 0x68140a18, blocks: 0x81f 00010000:00010000:3.0:1746143770.206993:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b1600, rc 0) 00010000:00010000:2.0:1746143770.206994:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.206995:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.206999:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 13 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.207005:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 13 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.207011:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e32c00, rc 0) 00000100:00100000:2.0:1746143770.207027:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594432768:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 65us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.207033:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594432512:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 134us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.207036:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14008 00000100:00100000:3.0:1746143770.207038:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14007 00000100:00100000:2.0:1746143770.207048:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14009 00000100:00100000:3.0:1746143770.207050:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14010 00000100:00100000:2.0:1746143770.207052:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594433024:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:3.0:1746143770.207054:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594432384:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143770.207056:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.207058:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143770.207063:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8634 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143770.207063:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8657 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143770.207063:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00010000:3.0:1746143770.207072:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a19, atime: 0x68140a19, ctime: 0x68140a19, blocks: 0x80f 00002000:00010000:2.0:1746143770.207072:0:2839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a19, atime: 0x68140a19, ctime: 0x68140a19, blocks: 0x102b 00010000:00010000:3.0:1746143770.207078:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.207078:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.207079:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143770.207079:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.207082:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.207082:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 14 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.207090:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143770.207090:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 14 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.207096:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b1000, rc 0) 00010000:00010000:2.0:1746143770.207096:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e33200, rc 0) 00000100:00100000:3.0:1746143770.207109:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594432384:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 54us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143770.207109:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594433024:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.207113:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14010 00000100:00100000:3.0:1746143770.207120:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594432896 00000100:00100000:3.0:1746143770.207122:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594432896 00000100:00100000:1.0:1746143770.207131:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14011 00000100:00100000:1.0:1746143770.207170:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594432640:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143770.207176:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143770.207184:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8642 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143770.207194:0:12618:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a19, atime: 0x68140a19, ctime: 0x68140a19, blocks: 0x81f 00010000:00010000:1.0:1746143770.207200:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.207202:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143770.207206:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.207214:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 15 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143770.207220:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716e00, rc 0) 00000100:00100000:3.0:1746143770.207227:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14012 00000100:00100000:3.0:1746143770.207231:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594432896:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143770.207233:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1964:x1830963594432640:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 97us (413us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143770.207236:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143770.207237:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14011 00010000:00010000:3.0:1746143770.207243:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8650 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143770.207252:0:4582:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a19, atime: 0x68140a19, ctime: 0x68140a19, blocks: 0x14a9 00010000:00010000:3.0:1746143770.207258:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.207259:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143770.207263:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.207270:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143770.207276:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b1a00, rc 0) 00000100:00100000:3.0:1746143770.207290:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1964:x1830963594432896:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 58us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143770.207295:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14012 00000100:00100000:2.0:1746143770.207310:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14009 00010000:00010000:1.0:1746143770.787506:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143771.215600:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.216557:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.216999:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433280 00000100:00100000:2.0:1746143771.217007:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433280 00000100:00100000:2.0:1746143771.217314:0:25543:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433536 00000100:00100000:2.0:1746143771.217317:0:25543:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433536 00000100:00100000:0.0:1746143771.217348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.217571:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594433792 00000100:00100000:1.0:1746143771.217575:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594433792 00000100:00100000:1.0:1746143771.217601:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6610 00000100:00100000:1.0:1746143771.217608:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1963:x1830963594433280:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143771.217635:0:3269:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.217651:0:3269:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.217653:0:3269:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.217657:0:3269:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.217669:0:3269:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.218527:0:25543:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6611 00000100:00100000:2.0:1746143771.218534:0:25543:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1962:x1830963594433536:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143771.218554:0:25543:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.218562:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.218563:0:25543:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.218565:0:25543:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.218575:0:25543:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.219724:0:21518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6612 00000100:00100000:2.0:1746143771.219732:0:21518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1962:x1830963594433792:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143771.219752:0:21518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.219761:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.219762:0:21518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.219765:0:21518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.219772:0:21518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.222474:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.222491:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.222517:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.222541:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.222569:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594434048 00000100:00100000:0.0:1746143771.222576:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594434048 00000100:00100000:0.0:1746143771.222609:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594434304 00000100:00100000:0.0:1746143771.222611:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594434304 00000100:00100000:0.0:1746143771.222621:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594434560 00000100:00100000:0.0:1746143771.222623:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594434560 00000100:00100000:0.0:1746143771.222633:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594434816 00000100:00100000:0.0:1746143771.222634:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594434816 00000100:00100000:0.0:1746143771.222646:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6613 00000100:00100000:0.0:1746143771.222652:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:1962:x1830963594434048:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143771.222679:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.222690:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.222692:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.222696:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.222709:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.222907:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6614 00000100:00100000:1.0:1746143771.222913:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:1962:x1830963594434304:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:1.0:1746143771.222926:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.222932:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.222933:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.222935:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.222942:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.223730:0:26144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6615 00000100:00100000:0.0:1746143771.223736:0:26144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:1963:x1830963594434560:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143771.223752:0:26144:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.223758:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.223759:0:26144:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.223762:0:26144:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.223769:0:26144:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.224789:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6616 00000100:00100000:0.0:1746143771.224797:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+20:1962:x1830963594434816:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143771.224816:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.224825:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.224827:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.224830:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.224838:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.227717:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.228082:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435072 00000100:00100000:0.0:1746143771.228089:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435072 00000100:00100000:3.0:1746143771.229360:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6617 00000100:00100000:3.0:1746143771.229370:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+20:1962:x1830963594435072:12345-192.168.202.48@tcp:3:mirror_io.0 00010000:00010000:3.0:1746143771.229400:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.229411:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.229413:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.229417:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.229427:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.236958:0:25543:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.236973:0:25543:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.236981:0:25543:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.236987:0:25543:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e32400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143771.236991:0:25543:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.236997:0:25543:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.237013:0:25543:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.237018:0:25543:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e32400/0xe984082ccd731403 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25543 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.237115:0:25543:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+20:1962:x1830963594433536:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 18578us (20555us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.237123:0:25543:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6611 00010000:00010000:2.0:1746143771.243473:0:21518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.243487:0:21518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.243494:0:21518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.243502:0:21518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e32600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143771.243505:0:21518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.243512:0:21518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.243525:0:21518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.243531:0:21518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e32600/0xe984082ccd73140a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.243616:0:21518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:1962:x1830963594433792:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 23881us (26264us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.243625:0:21518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6612 00010000:00010000:1.0:1746143771.247015:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.247031:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.247038:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.247045:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bca00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143771.247049:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.247056:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.247071:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.247076:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bca00/0xe984082ccd731411 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.247195:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+20:1962:x1830963594434048:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 24538us (24722us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.247204:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6613 00010000:00010000:1.0:1746143771.251021:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.251037:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.251045:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.251051:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091716600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143771.251056:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.251064:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.251080:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.251086:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731418 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.251193:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+18:1962:x1830963594434304:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 28276us (28696us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.251201:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6614 00010000:00010000:1.0:1746143771.254643:0:3269:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.254658:0:3269:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.254665:0:3269:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.254670:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091716800 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143771.254673:0:3269:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.254680:0:3269:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.254699:0:3269:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.254705:0:3269:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd7313fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.254775:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1963:x1830963594433280:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 37164us (39179us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.254783:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6610 00010000:00010000:2.0:1746143771.259486:0:26144:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.259499:0:26144:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.259507:0:26144:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.259513:0:26144:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bda00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143771.259517:0:26144:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.259523:0:26144:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.259539:0:26144:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.259545:0:26144:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02bda00/0xe984082ccd73141f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26144 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.259634:0:26144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+16:1963:x1830963594434560:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 35894us (37111us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.259642:0:26144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6615 00010000:00010000:1.0:1746143771.263475:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.263486:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.263491:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.263494:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02bde00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143771.263497:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.263501:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.263513:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.263519:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bde00/0xe984082ccd731426 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.263590:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1962:x1830963594434816:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 38791us (41044us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.263598:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6616 00010000:00010000:3.0:1746143771.264730:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.264742:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.264749:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.264754:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800930b0400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143771.264757:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.264763:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.264773:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.264779:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930b0400/0xe984082ccd73142d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.265070:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1962:x1830963594435072:12345-192.168.202.48@tcp:3:mirror_io.0 Request processed in 35699us (37355us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.265078:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6617 00000100:00100000:0.0:1746143771.268964:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.269058:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435200 00000100:00100000:3.0:1746143771.269066:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435200 00000100:00100000:3.0:1746143771.269122:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 752 00000100:00100000:3.0:1746143771.269129:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31599:x1830963594435200:12345-192.168.202.48@tcp:103:mirror_io.0 00010000:00010000:3.0:1746143771.269171:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.269193:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d510600/0xe984082ccd731377 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8618 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.269210:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.269214:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.269417:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31599:x1830963594435200:12345-192.168.202.48@tcp:103:mirror_io.0 Request processed in 287us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.269423:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 752 00000100:00100000:0.0:1746143771.270706:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.270793:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435456 00000100:00100000:3.0:1746143771.270798:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435456 00000100:00100000:1.0:1746143771.270989:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4028 00000100:00100000:1.0:1746143771.270998:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31599:x1830963594435456:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143771.271646:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31599:x1830963594435456:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 649us (941us total) trans 8589943670 rc 0/0 00000100:00100000:1.0:1746143771.271653:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4028 00000100:00100000:0.0:1746143771.272975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.273049:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435712 00000100:00100000:1.0:1746143771.273053:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435712 00000100:00100000:1.0:1746143771.273091:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4029 00000100:00100000:1.0:1746143771.273097:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:31599:x1830963594435712:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143771.273261:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:31599:x1830963594435712:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 164us (289us total) trans 8589943671 rc 0/0 00000100:00100000:1.0:1746143771.273267:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4029 00000100:00100000:0.0:1746143771.285239:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.285350:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594435968 00000100:00100000:2.0:1746143771.285358:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594435968 00000100:00100000:2.0:1746143771.285413:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9319 00000100:00100000:2.0:1746143771.285420:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31606:x1830963594435968:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.285439:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.285454:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd731434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a865e expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.285552:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285565:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285574:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285585:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285590:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285594:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285687:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285694:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285699:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143771.285706:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.285776:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285782:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285788:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285793:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a793c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.285796:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285802:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285811:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.285814:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.285817:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285821:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793c00/0xe984082ccd73143b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285851:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285856:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285860:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285864:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a793e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.285866:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285871:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285877:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cdf00) 00010000:00010000:2.0:1746143771.285879:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.285880:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285884:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793e00/0xe984082ccd731442 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.285916:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793a00/0xe984082ccd731434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 243 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.285927:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 242 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.285932:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.285934:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143771.285936:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793400, rc 0) 00000100:00100000:2.0:1746143771.285982:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31606:x1830963594435968:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 563us (752us total) trans 8589943672 rc 0/0 00000100:00100000:2.0:1746143771.285988:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9319 00000100:00100000:0.0:1746143771.288019:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.288072:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436224 00000100:00100000:2.0:1746143771.288079:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436224 00000100:00100000:2.0:1746143771.288127:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9320 00000100:00100000:2.0:1746143771.288166:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:31612:x1830963594436224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.288183:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.288360:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd731457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8665 expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.288445:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288455:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288464:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288474:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288483:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288488:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288569:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288576:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288581:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143771.288589:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.288652:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288658:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288663:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288667:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a793000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.288670:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288675:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288683:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.288693:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.288699:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288707:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793000/0xe984082ccd73145e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288717:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288721:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288729:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288733:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a792e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.288736:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288740:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288746:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800939cd900) 00010000:00010000:2.0:1746143771.288748:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.288750:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288755:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792e00/0xe984082ccd731465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143771.288790:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793200/0xe984082ccd731457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.288808:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 8 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.288985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143771.289042:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.289044:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143771.289047:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792c00, rc 0) 00000100:00100000:3.0:1746143771.289071:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436480 00000100:00100000:3.0:1746143771.289076:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436480 00000100:00100000:2.0:1746143771.289095:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31612:x1830963594436224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 929us (1080us total) trans 8589943673 rc 0/0 00000100:00100000:2.0:1746143771.289101:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9320 00000100:00100000:3.0:1746143771.289113:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9321 00000100:00100000:3.0:1746143771.289119:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31611:x1830963594436480:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.289127:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.289336:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1e00/0xe984082ccd73147a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a866c expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.289378:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.289388:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.289394:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143771.289400:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143771.289453:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1e00/0xe984082ccd73147a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.289481:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 244 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.289487:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.289489:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143771.289490:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b0e00, rc 0) 00000100:00100000:3.0:1746143771.289518:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31611:x1830963594436480:12345-192.168.202.48@tcp:101:cat.0 Request processed in 400us (534us total) trans 8589943674 rc 0/0 00000100:00100000:3.0:1746143771.289523:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9321 00000100:00100000:2.0:1746143771.293956:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.293956:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.293988:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.294014:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.294021:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594438272 00000100:00100000:2.0:1746143771.294028:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436608 00000100:00100000:3.0:1746143771.294031:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594438272 00000100:00100000:2.0:1746143771.294031:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436608 00000100:00100000:2.0:1746143771.294061:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436736 00000100:00100000:2.0:1746143771.294062:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436736 00000100:00100000:2.0:1746143771.294072:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436864 00000100:00100000:3.0:1746143771.294073:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9322 00000100:00100000:2.0:1746143771.294074:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436864 00000100:00100000:3.0:1746143771.294082:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:31610:x1830963594438272:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:2.0:1746143771.294082:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14013 00000100:00100000:2.0:1746143771.294085:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594436608:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.294095:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.294099:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.294107:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8673 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.294112:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1e00/0xe984082ccd731496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86c7 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.294125:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294127:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294163:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.294178:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143771.294182:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14014 00010000:00010000:2.0:1746143771.294187:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792600, rc 0) 00000100:00100000:1.0:1746143771.294189:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+31:1965:x1830963594436736:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.294196:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.294204:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a867a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.294218:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.294220:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143771.294221:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594436608:12345-192.168.202.48@tcp:101:cat.0 Request processed in 134us (272us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143771.294224:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143771.294227:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14013 00010000:00010000:3.0:1746143771.294231:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.294232:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 32 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.294238:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02bca00, rc 0) 00000100:00100000:2.0:1746143771.294239:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14015 00000100:00100000:2.0:1746143771.294244:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594436864:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.294245:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.294249:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.294251:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 243 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.294254:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594436736:12345-192.168.202.48@tcp:101:cat.0 Request processed in 66us (266us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143771.294255:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8681 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.294257:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.294259:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14014 00010000:00010000:3.0:1746143771.294262:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.294263:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294265:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294268:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 32 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.294276:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 32 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.294282:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793800, rc 0) 00000100:00100000:1.0:1746143771.294282:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143771.294290:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 9 pid: 2976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.294294:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594436992 00000100:00100000:1.0:1746143771.294296:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594436992 00000100:00100000:2.0:1746143771.294297:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594436864:12345-192.168.202.48@tcp:101:cat.0 Request processed in 53us (283us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143771.294302:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 9 pid: 2976 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.294302:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14015 00000100:00100000:1.0:1746143771.294311:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14016 00000100:00100000:3.0:1746143771.294314:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594452992:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143771.294315:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594436992:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.294319:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.294325:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8688 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.294332:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.294333:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143771.294337:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143771.294337:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 23 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.294344:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 23 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.294349:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02bc800, rc 0) 00000100:00100000:2.0:1746143771.294352:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594437120 00000100:00100000:2.0:1746143771.294355:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594437120 00000100:00100000:1.0:1746143771.294362:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594436992:12345-192.168.202.48@tcp:101:cat.0 Request processed in 47us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.294366:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14016 00000100:00100000:2.0:1746143771.294370:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14017 00000100:00100000:2.0:1746143771.294374:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594437120:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.294381:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.294386:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a868f expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.294395:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 243 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.294396:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294398:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143771.294400:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143771.294402:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 24 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294404:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 243 pid: 2976 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.294407:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594437248 00000100:00100000:1.0:1746143771.294409:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594437248 00010000:00010000:2.0:1746143771.294410:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 24 pid: 2839 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143771.294412:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453120:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.294416:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792400, rc 0) 00000100:00100000:1.0:1746143771.294420:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14018 00000100:00100000:1.0:1746143771.294423:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1965:x1830963594437248:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.294427:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143771.294432:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594437120:12345-192.168.202.48@tcp:101:cat.0 Request processed in 58us (95us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143771.294435:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8696 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.294437:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14017 00010000:00010000:1.0:1746143771.294443:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.294444:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.294447:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 33 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294453:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.294453:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 33 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.294458:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79d800, rc 0) 00000100:00100000:2.0:1746143771.294461:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143771.294462:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 9 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.294470:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453248:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143771.294470:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594437248:12345-192.168.202.48@tcp:101:cat.0 Request processed in 46us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.294472:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594437376 00000100:00100000:2.0:1746143771.294474:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594437376 00000100:00100000:1.0:1746143771.294474:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14018 00000100:00100000:2.0:1746143771.294488:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14019 00000100:00100000:2.0:1746143771.294492:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594437376:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143771.294494:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143771.294498:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.294503:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a869d expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.294513:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294514:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143771.294516:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143771.294524:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143771.294531:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143771.294532:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 16 pid: 8497 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143771.294535:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594437504 00000100:00100000:3.0:1746143771.294538:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594437504 00010000:00010000:2.0:1746143771.294539:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792200, rc 0) 00000100:00100000:2.0:1746143771.294552:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594437376:12345-192.168.202.48@tcp:101:cat.0 Request processed in 60us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.294554:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.294557:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14019 00000100:00100000:3.0:1746143771.294562:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594437632 00000100:00100000:3.0:1746143771.294564:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594437632 00000100:00100000:2.0:1746143771.294564:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594437760 00000100:00100000:2.0:1746143771.294567:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594437760 00000100:00100000:1.0:1746143771.294567:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14020 00000100:00100000:1.0:1746143771.294573:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594437504:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143771.294578:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14021 00010000:00010000:1.0:1746143771.294578:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143771.294582:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14022 00000100:00100000:3.0:1746143771.294583:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1964:x1830963594437632:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.294583:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86a4 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.294586:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594437760:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.294589:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.294591:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.294592:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.294593:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294595:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86b2 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.294596:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 16 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294597:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86ab expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.294603:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.294603:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 17 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.294605:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.294606:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.294608:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.294608:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.294609:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f79de00, rc 0) 00010000:00010000:3.0:1746143771.294613:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 17 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.294616:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294622:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 17 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.294622:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792000, rc 0) 00000100:00100000:1.0:1746143771.294622:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594437504:12345-192.168.202.48@tcp:101:cat.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.294626:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14020 00010000:00010000:3.0:1746143771.294629:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d93a00, rc 0) 00000100:00100000:2.0:1746143771.294635:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594437760:12345-192.168.202.48@tcp:101:cat.0 Request processed in 48us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.294639:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14022 00000100:00100000:3.0:1746143771.294642:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594437632:12345-192.168.202.48@tcp:101:cat.0 Request processed in 59us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.294650:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14021 00000100:00100000:1.0:1746143771.294675:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.294691:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594437888 00000100:00100000:3.0:1746143771.294695:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594437888 00000100:00100000:3.0:1746143771.294712:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14023 00000100:00100000:1.0:1746143771.294715:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.294717:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594437888:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.294725:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.294734:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86b9 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.294746:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.294748:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.294752:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294762:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 18 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294768:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3000, rc 0) 00000100:00100000:3.0:1746143771.294801:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594437888:12345-192.168.202.48@tcp:101:cat.0 Request processed in 83us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.294806:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14023 00000100:00100000:3.0:1746143771.294815:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594438016 00000100:00100000:3.0:1746143771.294817:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594438016 00000100:00100000:3.0:1746143771.294841:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14024 00000100:00100000:3.0:1746143771.294846:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594438016:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.294852:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.294857:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86c0 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.294866:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.294867:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.294870:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294878:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.294884:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2000, rc 0) 00000100:00100000:3.0:1746143771.294910:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594438016:12345-192.168.202.48@tcp:101:cat.0 Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.294915:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14024 00000100:00100000:0.0:1746143771.296307:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.296329:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.296351:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.296779:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594438400 00000100:00100000:1.0:1746143771.296785:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594438400 00010000:00010000:1.0:1746143771.296809:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 10 pid: 2976 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.296845:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594438656 00000100:00100000:1.0:1746143771.296848:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594438656 00010000:00010000:1.0:1746143771.296859:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 10 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.296872:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594438528 00000100:00100000:1.0:1746143771.296873:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594438528 00010000:00010000:1.0:1746143771.296883:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 244 pid: 2976 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.296896:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7500 00000100:00100000:1.0:1746143771.296901:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594438400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.296912:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.296916:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 10 pid: 2976 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.296924:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 10 pid: 2976 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.296941:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143771.296945:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.296952:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.296957:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.296984:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:1963:x1830963594438400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 81us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.296990:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7500 00010000:00010000:3.0:1746143771.297003:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a792c00/0xe984082ccd73146c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8665 expref: 9 pid: 2976 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.297004:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7501 00000100:00100000:1.0:1746143771.297009:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+10:1963:x1830963594438656:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.297016:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.297019:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 10 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.297021:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594452992:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143771.297026:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 10 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.297031:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453120:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143771.297036:0:7150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143771.297039:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.297040:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0600/0xe984082ccd7313cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a862d expref: 10 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.297044:0:7150:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00000100:00100000:3.0:1746143771.297048:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453248:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143771.297048:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.297061:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1963:x1830963594438656:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (731us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143771.297066:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:3.0:1746143771.297095:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7502 00000100:00100000:3.0:1746143771.297102:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1963:x1830963594438528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.297109:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.297114:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 244 pid: 2976 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.297121:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 244 pid: 2976 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.297123:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7501 00010000:00010000:3.0:1746143771.297161:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a793400/0xe984082ccd731449 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a865e expref: 244 pid: 2976 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.297170:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.297172:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.297178:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.297183:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.297195:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.297211:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1963:x1830963594438528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 109us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.297216:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7502 00010000:00010000:3.0:1746143771.297231:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.297236:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:3.0:1746143771.297254:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143771.297592:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1e00/0xe984082ccd731496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.297603:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.297609:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.297611:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143771.297613:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b1c00, rc 0) 00000100:00100000:3.0:1746143771.297641:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31610:x1830963594438272:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3561us (3687us total) trans 8589943675 rc 0/0 00000100:00100000:3.0:1746143771.297647:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9322 00000100:00100000:0.0:1746143771.300948:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.300989:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594438784 00000100:00100000:3.0:1746143771.300996:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594438784 00000100:00100000:3.0:1746143771.301039:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9323 00000100:00100000:3.0:1746143771.301045:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31612:x1830963594438784:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.301060:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.301073:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7314f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86ce expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.301115:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7314f8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ce expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.301126:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7314f8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ce expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.301175:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.301178:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143771.301181:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2c00, rc 0) 00000100:00100000:3.0:1746143771.301224:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31612:x1830963594438784:12345-192.168.202.48@tcp:101:cat.0 Request processed in 178us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.301230:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9323 00000100:00100000:0.0:1746143771.322581:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.322625:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.322657:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.322893:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594439040 00000100:00100000:3.0:1746143771.322905:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594439040 00000100:00100000:0.0:1746143771.322908:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.322937:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594439296 00000100:00100000:0.0:1746143771.322941:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594439296 00002000:00100000:3.0:1746143771.322943:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a04cf480 x1830963594439040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.322952:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf480 with x1830963594439040 ext(0->1048575) 00002000:00010000:3.0:1746143771.322957:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cf480 00002000:00100000:0.0:1746143771.322958:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a04cce00 x1830963594439296/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.322966:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cce00 with x1830963594439296 ext(1048576->2097151) 00002000:00010000:0.0:1746143771.322969:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cce00 00000100:00100000:3.0:1746143771.322971:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594439680 00000100:00100000:3.0:1746143771.322973:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594439680 00000100:00100000:0.0:1746143771.322984:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594439808 00002000:00100000:3.0:1746143771.322986:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a04cd500 x1830963594439680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143771.322987:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594439808 00002000:00100000:3.0:1746143771.322992:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd500 with x1830963594439680 ext(1048576->2097151) 00002000:00010000:3.0:1746143771.322995:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cd500 00002000:00100000:0.0:1746143771.322998:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a04cdf80 x1830963594439808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.323005:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdf80 with x1830963594439808 ext(1048576->2097151) 00002000:00010000:0.0:1746143771.323008:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cdf80 00000100:00100000:3.0:1746143771.324400:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6618 00000100:00100000:3.0:1746143771.324411:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594439040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.325208:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6619 00000100:00100000:1.0:1746143771.325217:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6620 00000100:00100000:0.0:1746143771.325217:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594439296:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143771.325227:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594439680:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.326623:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6621 00000100:00100000:0.0:1746143771.326633:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594439808:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.336779:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.336814:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.336841:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.337763:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.337985:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594440064 00000100:00100000:1.0:1746143771.337997:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594440064 00002000:00100000:1.0:1746143771.338042:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a04cd880 x1830963594440064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.338058:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd880 with x1830963594440064 ext(0->1048575) 00002000:00010000:1.0:1746143771.338063:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cd880 00000100:00100000:1.0:1746143771.338095:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594440320 00000100:00100000:1.0:1746143771.338099:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594440320 00002000:00100000:1.0:1746143771.338118:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a04cf100 x1830963594440320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.338125:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf100 with x1830963594440320 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.338128:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cf100 00000100:00100000:1.0:1746143771.338170:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594440576 00000100:00100000:1.0:1746143771.338175:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594440576 00002000:00100000:1.0:1746143771.338195:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800930df480 x1830963594440576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.338202:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df480 with x1830963594440576 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.338205:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930df480 00000100:00100000:1.0:1746143771.338220:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594440832 00000100:00100000:1.0:1746143771.338224:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594440832 00002000:00100000:1.0:1746143771.338239:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800930df800 x1830963594440832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.338245:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df800 with x1830963594440832 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.338248:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df800 00000100:00100000:1.0:1746143771.338265:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6622 00000100:00100000:1.0:1746143771.338274:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594440064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143771.339585:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6623 00000100:00100000:1.0:1746143771.339596:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594440320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143771.340912:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6624 00000100:00100000:1.0:1746143771.340921:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594440576:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.343096:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6625 00000100:00100000:0.0:1746143771.343110:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594440832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143771.346620:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594439680:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21389us (23956us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.346630:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6620 00002000:00100000:2.0:1746143771.346639:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a04cd500 x1830963594439680/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.346649:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd500 with x1830963594439680 ext(1048576->2097151) 00002000:00010000:2.0:1746143771.346653:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cd500 00000100:00100000:2.0:1746143771.356048:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594439296:12345-192.168.202.48@tcp:3:cat.0 Request processed in 30824us (33414us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.356060:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6619 00002000:00100000:2.0:1746143771.356070:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a04cce00 x1830963594439296/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.356079:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cce00 with x1830963594439296 ext(1048576->2097151) 00002000:00010000:2.0:1746143771.356085:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cce00 00000100:00100000:0.0:1746143771.360358:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.360506:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441088 00000100:00100000:1.0:1746143771.360514:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441088 00000100:00100000:3.0:1746143771.361867:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9324 00000100:00100000:3.0:1746143771.361879:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31610:x1830963594441088:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143771.361902:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.361906:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143771.361931:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2c00/0xe984082ccd7314f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ce expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.361967:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.361971:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143771.361981:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2200/0xe984082ccd7314ff lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86d5 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.362028:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.362038:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.362049:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 242 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.362055:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.362080:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 242 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.362090:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 242 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.362100:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453376:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.362220:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.362231:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 8 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.362238:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453504:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.362255:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.365750:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594439040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 41333us (43168us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.365760:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6618 00002000:00100000:3.0:1746143771.365770:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a04cf480 x1830963594439040/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.365778:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf480 with x1830963594439040 ext(0->1048575) 00002000:00010000:3.0:1746143771.365783:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cf480 00000100:00100000:1.0:1746143771.366902:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594439808:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40267us (43989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.366911:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6621 00002000:00100000:1.0:1746143771.366918:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a04cdf80 x1830963594439808/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.366926:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cdf80 with x1830963594439808 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.366930:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cdf80 00000100:00100000:0.0:1746143771.368076:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.368113:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.368194:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441216 00000100:00100000:1.0:1746143771.368201:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441216 00010000:00010000:1.0:1746143771.368231:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 9 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.368252:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441344 00000100:00100000:1.0:1746143771.368255:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441344 00010000:00010000:1.0:1746143771.368264:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 243 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.368799:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453376:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.368808:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594453504:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.368827:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143771.369007:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7503 00000100:00100000:1.0:1746143771.369020:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1964:x1830963594441216:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.369032:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.369038:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 9 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.369053:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 9 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.369071:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0c00/0xe984082ccd7313bd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8626 expref: 9 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.369095:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143771.369099:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.369106:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.369111:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.369164:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1964:x1830963594441216:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 150us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.369170:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7503 00000100:00100000:1.0:1746143771.369182:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7504 00000100:00100000:1.0:1746143771.369187:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1964:x1830963594441344:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.369192:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.369195:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 243 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.369203:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 243 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.369213:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0e00/0xe984082ccd731481 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a866c expref: 243 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.369220:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143771.369222:0:23335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.369228:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.369233:0:23335:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.369245:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.369256:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:1964:x1830963594441344:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.369260:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7504 00010000:00010000:1.0:1746143771.369769:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.369776:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000040:00080000:1.0:1746143771.370756:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2777, 88 off234920 00000004:00080000:1.0:1746143771.370765:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380624553ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370816:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2783, 88 off235624 00000004:00080000:1.0:1746143771.370821:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380681113ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143771.370843:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2784, 88 off235712 00000004:00080000:1.0:1746143771.370846:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380706731ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143771.370853:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2778, 88 off235008 00000004:00080000:1.0:1746143771.370856:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380715961ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370862:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2779, 88 off235096 00000004:00080000:1.0:1746143771.370865:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380725004ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370871:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2785, 88 off235800 00000004:00080000:1.0:1746143771.370874:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380734792ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143771.370880:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2786, 88 off235888 00000004:00080000:1.0:1746143771.370882:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380742596ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143771.370888:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2787, 88 off235976 00000004:00080000:1.0:1746143771.370890:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380750323ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143771.370895:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2780, 88 off235184 00000004:00080000:1.0:1746143771.370897:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380757884ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370903:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2788, 88 off236064 00000004:00080000:1.0:1746143771.370905:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380765342ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143771.370910:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2781, 88 off235272 00000004:00080000:1.0:1746143771.370912:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380772552ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370917:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2789, 88 off236152 00000004:00080000:1.0:1746143771.370919:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380779844ns, next at 833304778357ns, rc = 0 00000040:00080000:1.0:1746143771.370925:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2782, 88 off235360 00000004:00080000:1.0:1746143771.370927:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380787568ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370932:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2783, 88 off235448 00000004:00080000:1.0:1746143771.370934:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380794792ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370940:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2784, 88 off235536 00000004:00080000:1.0:1746143771.370943:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380803141ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370948:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2785, 88 off235624 00000004:00080000:1.0:1746143771.370951:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 850380811053ns, next at 788202887869ns, rc = 0 00000040:00080000:1.0:1746143771.370956:0:14762:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2790, 88 off236240 00000004:00080000:1.0:1746143771.370959:0:14762:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 850380819354ns, next at 833304778357ns, rc = 0 00000100:00100000:1.0:1746143771.378940:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594440064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 40661us (42164us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.378953:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6622 00002000:00100000:1.0:1746143771.378963:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff8800a04cd880 x1830963594440064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.378972:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cd880 with x1830963594440064 ext(0->1048575) 00002000:00010000:1.0:1746143771.378977:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a04cd880 00000100:00100000:3.0:1746143771.384382:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.385167:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441472 00000100:00100000:0.0:1746143771.385174:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441472 00000100:00100000:0.0:1746143771.385207:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9325 00000100:00100000:0.0:1746143771.385214:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31611:x1830963594441472:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.385231:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.385245:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86dc expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.385289:0:14763:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143771.385297:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 243 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.385309:0:14763:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14762 initiator: MDT0 00010000:00010000:0.0:1746143771.385317:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 243 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.385326:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:0.0:1746143771.385328:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143771.385331:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 243 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.385336:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347000, rc 0) 00000100:00100000:0.0:1746143771.385906:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31611:x1830963594441472:12345-192.168.202.48@tcp:101:cat.0 Request processed in 692us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.385912:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9325 00000100:00100000:3.0:1746143771.385992:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a04cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594440320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 46398us (49177us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.385998:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6623 00002000:00100000:3.0:1746143771.386006:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff8800a04cf100 x1830963594440320/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.386020:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a04cf100 with x1830963594440320 ext(1048576->2097151) 00002000:00010000:3.0:1746143771.386024:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a04cf100 00000100:00100000:1.0:1746143771.388917:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594440576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 47992us (52070us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.388927:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6624 00002000:00100000:1.0:1746143771.388938:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800930df480 x1830963594440576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.388947:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df480 with x1830963594440576 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.388952:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930df480 00000100:00100000:0.0:1746143771.391560:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594440832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 48450us (53794us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143771.391569:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6625 00002000:00100000:0.0:1746143771.391577:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800930df800 x1830963594440832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.391585:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930df800 with x1830963594440832 ext(1048576->2097151) 00002000:00010000:0.0:1746143771.391590:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930df800 00000100:00100000:3.0:1746143771.394640:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.394751:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441600 00000100:00100000:0.0:1746143771.394758:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441600 00000100:00100000:0.0:1746143771.394815:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9326 00000100:00100000:0.0:1746143771.394821:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31612:x1830963594441600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.394836:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.394850:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86e3 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.394894:0:14763:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86e3 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.394903:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86e3 expref: 13 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.394912:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:0.0:1746143771.394915:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143771.394918:0:14763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 242 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.394923:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7c00, rc 0) 00000100:00100000:0.0:1746143771.394967:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31612:x1830963594441600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.394973:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9326 00000001:00080000:1.0:1746143771.403892:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943676 is committed 00000004:00080000:1.0:1746143771.403902:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2125 committed 00000004:00080000:1.0:1746143771.403909:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2120 committed 00000004:00080000:1.0:1746143771.403914:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2119 committed 00000004:00080000:1.0:1746143771.403915:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2118 committed 00000004:00080000:1.0:1746143771.403917:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2117 committed 00000004:00080000:1.0:1746143771.403918:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2124 committed 00000004:00080000:1.0:1746143771.403920:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2116 committed 00000004:00080000:1.0:1746143771.403921:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2123 committed 00000004:00080000:1.0:1746143771.403922:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2115 committed 00000004:00080000:1.0:1746143771.403923:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2122 committed 00000004:00080000:1.0:1746143771.403925:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2121 committed 00000004:00080000:1.0:1746143771.403926:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2120 committed 00000004:00080000:1.0:1746143771.403927:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2114 committed 00000004:00080000:1.0:1746143771.403929:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2113 committed 00000004:00080000:1.0:1746143771.403931:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2119 committed 00000004:00080000:1.0:1746143771.403933:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2118 committed 00000004:00080000:1.0:1746143771.403934:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2112 committed 00000001:00080000:1.0:1746143771.403939:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943671 is committed 00000001:00080000:1.0:1746143771.403947:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943672 is committed 00000001:00080000:1.0:1746143771.403952:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943674 is committed 00010000:00010000:3.0:1746143771.403976:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86d5 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.403987:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.403990:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143771.403994:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 240 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.404003:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 240 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.404009:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 240 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.404013:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594453760:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143771.404016:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86e3 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.404022:0:14762:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86e3 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.404028:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86e3 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.404051:0:14762:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86e3 expref: 10 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.404061:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594454656:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143771.404064:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143771.404126:0:14762:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 240 pid: 14763 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.404157:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594454912:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143771.404181:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.404194:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594454016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.404199:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594453632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143771.404214:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143771.404220:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594453888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143771.404230:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594454528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.404239:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143771.404260:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594454400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.404271:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143771.404280:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143771.404291:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143771.404298:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143771.404309:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143771.404334:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746143771.404338:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594454272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.404350:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143771.404407:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594453760 00000100:00100000:3.0:1746143771.404414:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594453760 00000100:00100000:3.0:1746143771.404447:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454016 00000100:00100000:3.0:1746143771.404449:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454016 00000100:00100000:3.0:1746143771.404459:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594453888 00000100:00100000:3.0:1746143771.404461:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594453888 00000100:00100000:2.0:1746143771.404466:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143771.404480:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143771.404481:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454400 00000100:00100000:3.0:1746143771.404483:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454400 00000100:00100000:2.0:1746143771.404488:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143771.404493:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455168 00000100:00100000:3.0:1746143771.404494:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455168 00000100:00100000:2.0:1746143771.404499:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143771.404504:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455680 00000100:00100000:3.0:1746143771.404505:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455680 00000100:00100000:3.0:1746143771.404512:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454272 00000100:00100000:3.0:1746143771.404514:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454272 00000100:00100000:2.0:1746143771.404515:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455040 00000100:00100000:2.0:1746143771.404517:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455040 00000100:00100000:3.0:1746143771.404519:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455552 00000100:00100000:3.0:1746143771.404521:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455552 00000100:00100000:3.0:1746143771.404528:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14025 00000100:00100000:3.0:1746143771.404533:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3292:x1830963594453760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.404691:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14026 00002000:00010000:3.0:1746143771.404693:0:15784:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143771.404696:0:15784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143769 -> 1746143769 00000100:00100000:2.0:1746143771.404697:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594454016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143771.404698:0:15784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.404699:0:15784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.404701:0:15784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143771.404712:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14027 00000100:00100000:1.0:1746143771.404720:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594453888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143771.404726:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3292:x1830963594453760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (661us total) trans 17179873233 rc 0/0 00000100:00100000:3.0:1746143771.404732:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14025 00000100:00100000:3.0:1746143771.404747:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14028 00000100:00100000:3.0:1746143771.404752:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3293:x1830963594454400:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746143771.404762:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143771.404764:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143771.404771:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14029 00000100:00100000:3.0:1746143771.404775:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3293:x1830963594455168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143771.404775:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746143771.404777:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:2.0:1746143771.404779:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:2.0:1746143771.404780:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:2.0:1746143771.404782:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1746143771.404800:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746143771.404801:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3294:x1830963594454016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (587us total) trans 17179873234 rc 0/0 00002000:00010000:1.0:1746143771.404803:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143769 -> 1746143769 00002000:00010000:1.0:1746143771.404805:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143769 -> 1746143769 00000100:00100000:2.0:1746143771.404807:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14026 00002000:00010000:1.0:1746143771.404807:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143769 -> 1746143769 00002000:00010000:1.0:1746143771.404809:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:2.0:1746143771.404816:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14030 00000100:00100000:2.0:1746143771.404820:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+71:3293:x1830963594455680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.404835:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594453888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (594us total) trans 17179873235 rc 0/0 00000100:00100000:1.0:1746143771.404841:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14027 00000100:00100000:1.0:1746143771.404851:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14031 00000100:00100000:1.0:1746143771.404856:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3293:x1830963594454272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143771.404860:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14032 00000100:00100000:3.0:1746143771.404865:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+72:3293:x1830963594455552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143771.404901:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:3293:x1830963594455680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (591us total) trans 21474840561 rc 0/0 00000100:00100000:2.0:1746143771.404905:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14030 00000100:00100000:2.0:1746143771.404914:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14033 00000100:00100000:2.0:1746143771.404917:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:3293:x1830963594455040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.404927:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3293:x1830963594454272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (575us total) trans 17179873236 rc 0/0 00000100:00100000:1.0:1746143771.404933:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14031 00000100:00100000:3.0:1746143771.404941:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+73:3293:x1830963594455552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (441us total) trans 21474840562 rc 0/0 00000100:00100000:3.0:1746143771.404946:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14032 00000100:00100000:3.0:1746143771.404960:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143771.404965:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814a80/2, rc 0, transno 17179873236 00000100:00100000:1.0:1746143771.404969:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594454272:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143771.404972:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746143771.404973:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594455296:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143771.404975:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143771.404976:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143768 -> 1746143768 00002000:00010000:2.0:1746143771.404978:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143768 -> 1746143768 00000004:00080000:1.0:1746143771.404978:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a0700/2, rc 0, transno 21474840562 00002000:00010000:2.0:1746143771.404979:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746143771.404983:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143771.404988:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143771.404992:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0817800/2, rc 0, transno 17179873235 00000100:00100000:1.0:1746143771.404994:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594453888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.404997:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:3293:x1830963594455040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (515us total) trans 21474840563 rc 0/0 00000100:00100000:2.0:1746143771.405001:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14033 00000004:00080000:1.0:1746143771.405001:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a1f80/2, rc 0, transno 21474840561 00000100:00100000:3.0:1746143771.405002:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594455808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.405004:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143771.405009:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454528 00000004:00080000:1.0:1746143771.405011:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a3800/2, rc 0, transno 21474840563 00000100:00100000:2.0:1746143771.405012:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454528 00000100:00100000:1.0:1746143771.405014:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143771.405016:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143771.405043:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14034 00000100:00100000:0.0:1746143771.405051:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3294:x1830963594454528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143771.405127:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3294:x1830963594454528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (165us total) trans 17179873237 rc 0/0 00000100:00100000:0.0:1746143771.405160:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14034 00000004:00080000:3.0:1746143771.405913:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0817100/2, rc 0, transno 17179873234 00000100:00100000:3.0:1746143771.405918:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594454016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143771.405926:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0814700/2, rc 0, transno 17179873237 00000100:00100000:3.0:1746143771.405929:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594454528:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143771.405955:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:3.0:1746143771.405957:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.405959:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.405961:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.405962:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:3.0:1746143771.405985:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:3293:x1830963594455168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1209us (1692us total) trans 21474840560 rc 0/0 00000100:00100000:3.0:1746143771.405990:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14029 00000100:00100000:2.0:1746143771.405991:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455296 00000100:00100000:2.0:1746143771.405995:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455296 00000100:00100000:3.0:1746143771.406000:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455808 00000100:00100000:3.0:1746143771.406003:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455808 00000100:00100000:2.0:1746143771.406016:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14035 00000100:00100000:3.0:1746143771.406021:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14036 00000100:00100000:2.0:1746143771.406021:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:3294:x1830963594455296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143771.406025:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3294:x1830963594455808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143771.406118:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3294:x1830963594455296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1129us total) trans 21474840564 rc 0/0 00000100:00100000:2.0:1746143771.406123:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14035 00000100:00100000:3.0:1746143771.406152:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3293:x1830963594454400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1377us (1856us total) trans 17179873238 rc 0/0 00000100:00100000:3.0:1746143771.406158:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14028 00000100:00100000:2.0:1746143771.406168:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143771.406187:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594454144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.406203:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143771.406212:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594454784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143771.406226:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143771.406230:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3294:x1830963594455808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (1213us total) trans 21474840565 rc 0/0 00000100:00100000:3.0:1746143771.406235:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14036 00000100:00100000:2.0:1746143771.406235:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a63a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594455424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143771.406243:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594453632 00000100:00100000:3.0:1746143771.406245:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594453632 00000100:00100000:2.0:1746143771.406245:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143771.406257:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454144 00000100:00100000:3.0:1746143771.406258:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454144 00000100:00100000:2.0:1746143771.406263:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454784 00000100:00100000:3.0:1746143771.406266:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455424 00000100:00100000:2.0:1746143771.406266:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454784 00000100:00100000:3.0:1746143771.406268:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455424 00000100:00100000:3.0:1746143771.406274:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14037 00000100:00100000:3.0:1746143771.406278:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3295:x1830963594453632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143771.406282:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14038 00000100:00100000:2.0:1746143771.406286:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3295:x1830963594454144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143771.406294:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14039 00000100:00100000:0.0:1746143771.406299:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3295:x1830963594455424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143771.406341:0:9527:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143771.406344:0:9527:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.406345:0:9527:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.406347:0:9527:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143769 -> 1746143769 00002000:00010000:3.0:1746143771.406348:0:9527:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143771.406364:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3295:x1830963594454144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (159us total) trans 17179873240 rc 0/0 00000100:00100000:0.0:1746143771.406364:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3295:x1830963594455424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (116us total) trans 21474840566 rc 0/0 00000100:00100000:3.0:1746143771.406369:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3295:x1830963594453632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (200us total) trans 17179873239 rc 0/0 00000100:00100000:0.0:1746143771.406369:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14039 00000100:00100000:2.0:1746143771.406489:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14038 00000100:00100000:2.0:1746143771.406500:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14040 00000100:00100000:2.0:1746143771.406504:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3295:x1830963594454784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143771.406564:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143771.406566:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143769 -> 1746143769 00002000:00010000:2.0:1746143771.406568:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143769 -> 1746143769 00002000:00010000:2.0:1746143771.406569:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143769 -> 1746143769 00002000:00010000:2.0:1746143771.406571:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:2.0:1746143771.406586:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3295:x1830963594454784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (360us total) trans 21474840567 rc 0/0 00000100:00100000:2.0:1746143771.406590:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14040 00000004:00080000:2.0:1746143771.406609:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3c9180/2, rc 0, transno 17179873239 00000100:00100000:2.0:1746143771.406612:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594453632:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143771.406617:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0816d80/2, rc 0, transno 17179873240 00000100:00100000:2.0:1746143771.406620:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594454144:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143771.406626:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a1180/2, rc 0, transno 21474840567 00000100:00100000:2.0:1746143771.406629:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594454784:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143771.406633:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a3100/2, rc 0, transno 21474840566 00000100:00100000:2.0:1746143771.406636:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594455424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143771.407380:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14037 00000100:00100000:0.0:1746143771.407549:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000004:00080000:1.0:1746143771.407576:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0815880/2, rc 0, transno 17179873238 00000100:00100000:1.0:1746143771.407581:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594454400:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143771.407590:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a3b80/2, rc 0, transno 21474840560 00000100:00100000:1.0:1746143771.407592:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594455168:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143771.407602:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0878380/2, rc 0, transno 21474840565 00000100:00100000:3.0:1746143771.407606:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594455808:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143771.407612:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a63a0a80/2, rc 0, transno 21474840564 00000100:00100000:3.0:1746143771.407615:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a63a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594455296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143771.407620:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143771.407620:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.407625:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594455936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.407635:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441728 00000100:00100000:1.0:1746143771.407639:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441728 00000100:00100000:3.0:1746143771.407642:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143771.407646:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3ca300/2, rc 0, transno 17179873233 00000100:00100000:0.0:1746143771.407650:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594453760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143771.407660:0:16141:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441856 00000100:00100000:1.0:1746143771.407662:0:16141:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441856 00000100:00100000:0.0:1746143771.407669:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594454656:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143771.407674:0:16141:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4030 00000100:00100000:0.0:1746143771.407677:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594454912:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143771.407680:0:16141:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31611:x1830963594441728:12345-192.168.202.48@tcp:49:cat.0 00000100:00100000:2.0:1746143771.407702:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4031 00010000:00010000:0.0:1746143771.407703:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a2200/0xe984082ccd7314ff lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86d5 expref: 11 pid: 14762 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1746143771.407709:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+11:31612:x1830963594441856:12345-192.168.202.48@tcp:49:cat.0 00010000:00010000:0.0:1746143771.407717:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86d5 expref: 10 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.407734:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3a00, rc 0) 00000100:00100000:1.0:1746143771.407749:0:16141:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31611:x1830963594441728:12345-192.168.202.48@tcp:49:cat.0 Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.407751:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31612:x1830963594441856:12345-192.168.202.48@tcp:49:cat.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.407753:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31610:x1830963594441088:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 45878us (47403us total) trans 8589943676 rc 0/0 00000100:00100000:1.0:1746143771.407754:0:16141:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4030 00000100:00100000:2.0:1746143771.407758:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4031 00000100:00100000:0.0:1746143771.407759:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9324 00000100:00100000:1.0:1746143771.407821:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455936 00000100:00100000:1.0:1746143771.407823:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455936 00000100:00100000:1.0:1746143771.407845:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14041 00000100:00100000:1.0:1746143771.407849:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3294:x1830963594455936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143771.407963:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3294:x1830963594455936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (319us total) trans 21474840568 rc 0/0 00000100:00100000:1.0:1746143771.407969:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14041 00000004:00080000:3.0:1746143771.408040:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b79f800/2, rc 0, transno 21474840568 00000100:00100000:3.0:1746143771.408044:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594455936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143771.415678:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.415774:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594441984 00000100:00100000:1.0:1746143771.415781:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594441984 00000100:00100000:1.0:1746143771.415829:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14042 00000100:00100000:1.0:1746143771.415835:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31610:x1830963594441984:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143771.415850:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.415864:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86ea expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.415888:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.415896:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.415903:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.415908:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.415910:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.415912:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 6/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [614400->1048575] (req 614400->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.415934:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.415943:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 23 pid: 8495 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.415954:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594456064:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143771.416583:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.416752:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594442240 00000100:00100000:2.0:1746143771.416757:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594442240 00002000:00100000:2.0:1746143771.416781:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009bfe0700 x1830963594442240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.416790:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0700 with x1830963594442240 ext(1048576->2097151) 00002000:00010000:2.0:1746143771.416793:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0700 00000100:00100000:2.0:1746143771.416805:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6626 00000100:00100000:2.0:1746143771.416809:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594442240:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:1.0:1746143771.418039:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 19 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.418050:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 19 pid: 8497 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.418061:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594456192:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143771.418086:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 13 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.418093:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 13 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.418100:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594456320:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143771.418114:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.421011:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.421084:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594442368 00000100:00100000:3.0:1746143771.421090:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594442368 00000100:00100000:0.0:1746143771.421112:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.421122:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14043 00000100:00100000:3.0:1746143771.421128:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:31606:x1830963594442368:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143771.421171:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.421184:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86f1 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.421207:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.421215:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 18 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.421220:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 34 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.421225:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.421235:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.421238:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [2035712->2097151] (req 2035712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.421258:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 34 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.421266:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 34 pid: 8495 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.421275:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594456448:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143771.421281:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594442624 00000100:00100000:1.0:1746143771.421285:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594442624 00002000:00100000:1.0:1746143771.421309:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009bfe3b80 x1830963594442624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.421318:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830963594442624 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.421322:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3b80 00010000:00010000:3.0:1746143771.421328:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 18 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.421334:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 18 pid: 8496 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.421335:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6627 00000100:00100000:1.0:1746143771.421340:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594442624:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143771.421341:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594456576:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.421358:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 13 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.421364:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 13 pid: 12618 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.421370:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594456704:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.421381:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.425498:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.425780:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594456064:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143771.425790:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594456192:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143771.425965:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.426549:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.426604:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594456320:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143771.426637:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [614400->1048575] (req 614400->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.426656:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b299e00, rc 0) 00000100:00100000:1.0:1746143771.426693:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31610:x1830963594441984:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 10858us (11022us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.426700:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14042 00000100:00100000:2.0:1746143771.427113:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594442752 00000100:00100000:2.0:1746143771.427119:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594442752 00010000:00010000:2.0:1746143771.427173:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 24 pid: 8495 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.427192:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594442880 00000100:00100000:2.0:1746143771.427194:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594442880 00010000:00010000:2.0:1746143771.427203:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 19 pid: 8497 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.427219:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594443008 00000100:00100000:2.0:1746143771.427221:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594443008 00010000:00010000:2.0:1746143771.427229:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 14 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.427240:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7505 00000100:00100000:2.0:1746143771.427244:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594442752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.427256:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.427274:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 24 pid: 8495 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.427284:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 24 pid: 8495 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.427300:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792600/0xe984082ccd73148f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8673 expref: 24 pid: 8495 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.427311:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.427352:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7506 00000100:00100000:1.0:1746143771.427359:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594442880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.427366:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143771.427369:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594442752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 87us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.427376:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7505 00010000:00010000:1.0:1746143771.427376:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 19 pid: 8497 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.427385:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 19 pid: 8497 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.427396:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792200/0xe984082ccd7314c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a869d expref: 19 pid: 8497 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.427406:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7507 00010000:00010000:1.0:1746143771.427408:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.427411:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594443008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.427416:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.427424:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 14 pid: 4582 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.427432:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 14 pid: 4582 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.427441:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930b1000/0xe984082ccd7313e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8634 expref: 14 pid: 4582 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.427448:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.427450:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.427455:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.427461:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.427466:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594456448:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.427474:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594456576:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.427480:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594456704:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.427483:0:23335:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.427492:0:23335:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594456832:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143771.427500:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [2035712->2097151] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 36 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.427508:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b161600, rc 0) 00000100:00100000:0.0:1746143771.427799:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.428059:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594442880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 700us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.428066:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7506 00000100:00100000:1.0:1746143771.428077:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594443264 00000100:00100000:1.0:1746143771.428080:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594443264 00010000:00010000:1.0:1746143771.428090:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 19 pid: 8496 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.428104:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7508 00000100:00100000:1.0:1746143771.428108:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594443264:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.428114:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.428124:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 19 pid: 8496 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.428158:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 19 pid: 8496 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.428170:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d93a00/0xe984082ccd7314dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ab expref: 19 pid: 8496 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.428178:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.428191:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594443264:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 82us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.428196:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7508 00000100:00100000:0.0:1746143771.428274:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.428293:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.428559:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:31606:x1830963594442368:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 7429us (7554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.428566:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14043 00000100:00100000:2.0:1746143771.428566:0:23335:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.428579:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594443136 00000100:00100000:2.0:1746143771.428582:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594443136 00000100:00100000:3.0:1746143771.428583:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594443392 00000100:00100000:3.0:1746143771.428585:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594443392 00010000:00010000:2.0:1746143771.428593:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 36 pid: 8495 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.428595:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 14 pid: 12618 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.428605:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7509 00000100:00100000:2.0:1746143771.428611:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594443136:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143771.428612:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7510 00000100:00100000:3.0:1746143771.428616:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594443392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.428616:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.428622:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.428623:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 36 pid: 8495 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.428630:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 36 pid: 8495 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.428637:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 14 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.428641:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a793800/0xe984082ccd7314ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8681 expref: 36 pid: 8495 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.428645:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 14 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.428989:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.429015:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594443136:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 403us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.429020:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7509 00010000:00010000:3.0:1746143771.429233:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd7313ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8642 expref: 14 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.429251:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.429253:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.429257:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.429264:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.429264:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594442240:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12454us (12681us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.429270:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6626 00002000:00100000:2.0:1746143771.429278:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009bfe0700 x1830963594442240/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143771.429284:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143771.429286:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe0700 with x1830963594442240 ext(1048576->2097151) 00002000:00010000:2.0:1746143771.429289:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe0700 00000100:00100000:3.0:1746143771.429292:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594456960:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143771.429318:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.429406:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594442624:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8064us (8291us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.429412:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6627 00002000:00100000:1.0:1746143771.429417:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009bfe3b80 x1830963594442624/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.429426:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe3b80 with x1830963594442624 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.429429:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bfe3b80 00000100:00100000:2.0:1746143771.430617:0:23335:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:23335:1830963594456832:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143771.430629:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.430646:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594443008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3235us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.430652:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7507 00000100:00100000:0.0:1746143771.431495:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.431542:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594443648 00000100:00100000:1.0:1746143771.431546:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594443648 00000100:00100000:3.0:1746143771.431566:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594456960:192.168.202.48@tcp:105: 00002000:00100000:1.0:1746143771.431567:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (614400->618495) req@ffff880093804380 x1830963594443648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.431573:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804380 with x1830963594443648 ext(614400->618495) 00002000:00010000:1.0:1746143771.431575:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804380 00010000:00010000:3.0:1746143771.431578:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.431595:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6628 00000100:00100000:1.0:1746143771.431599:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594443648:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143771.431648:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594443392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3031us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.431655:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7510 00000100:00100000:1.0:1746143771.431706:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594443648:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 106us (212us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143771.431710:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6628 00002000:00100000:1.0:1746143771.431713:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x351:0x0] (614400->618495) req@ffff880093804380 x1830963594443648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.431717:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093804380 with x1830963594443648 ext(614400->618495) 00002000:00010000:1.0:1746143771.431719:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093804380 00000100:00100000:0.0:1746143771.436790:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.436877:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594443904 00000100:00100000:1.0:1746143771.436884:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594443904 00002000:00100000:1.0:1746143771.436923:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (2035712->2039807) req@ffff880093805180 x1830963594443904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.436932:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805180 with x1830963594443904 ext(2035712->2039807) 00002000:00010000:1.0:1746143771.436937:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805180 00000100:00100000:1.0:1746143771.437026:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6629 00000100:00100000:1.0:1746143771.437034:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594443904:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143771.437454:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594443904:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 420us (670us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143771.437460:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6629 00002000:00100000:1.0:1746143771.437466:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (2035712->2039807) req@ffff880093805180 x1830963594443904/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.437473:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093805180 with x1830963594443904 ext(2035712->2039807) 00002000:00010000:1.0:1746143771.437475:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093805180 00000100:00100000:0.0:1746143771.439922:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.440023:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594444160 00000100:00100000:1.0:1746143771.440029:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594444160 00002000:00100000:1.0:1746143771.440060:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094763b80 x1830963594444160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 504/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.440078:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763b80 with x1830963594444160 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.440081:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094763b80 00000100:00100000:1.0:1746143771.440105:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6630 00000100:00100000:1.0:1746143771.440110:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1964:x1830963594444160:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143771.440786:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.440827:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.440897:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594444416 00000100:00100000:3.0:1746143771.440901:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594444416 00000100:00100000:3.0:1746143771.440921:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594444288 00000100:00100000:3.0:1746143771.440922:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594444288 00000100:00100000:3.0:1746143771.440934:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14044 00000100:00100000:3.0:1746143771.440939:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31612:x1830963594444416:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.440947:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.440960:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86ff expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.440981:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.440987:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.440989:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.440992:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.441014:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.441024:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.441039:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594457088:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.441399:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14045 00000100:00100000:2.0:1746143771.441406:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31610:x1830963594444288:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.441413:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.441421:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a86f8 expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.441435:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.441442:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.441449:0:9527:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 34 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.441454:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.441455:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.441458:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.441470:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 34 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.441477:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 34 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.441489:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594457216:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.441531:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 19 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.441538:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 19 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.441545:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594457344:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.441564:0:9527:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 12 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.441572:0:9527:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 12 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.441579:0:9527:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594457472:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.441592:0:9527:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.441729:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.447562:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.447597:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.447730:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594457216:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.447741:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594457344:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.447750:0:9527:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:9527:1830963594457472:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.447775:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->1216511] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 19 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.447796:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da23c00, rc 0) 00000100:00100000:2.0:1746143771.447845:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31610:x1830963594444288:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6439us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.447856:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14045 00000100:00100000:2.0:1746143771.448941:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594444800 00000100:00100000:2.0:1746143771.448947:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594444800 00010000:00010000:2.0:1746143771.448971:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 13 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.448972:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594444544 00000100:00100000:3.0:1746143771.448976:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594444544 00010000:00010000:3.0:1746143771.448991:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.448993:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7511 00000100:00100000:2.0:1746143771.448999:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594444800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.449009:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143771.449018:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7512 00000100:00100000:3.0:1746143771.449023:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594444544:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.449027:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 13 pid: 4582 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.449029:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.449037:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 13 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.449054:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.449138:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594444672 00000100:00100000:1.0:1746143771.449152:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594444672 00010000:00010000:1.0:1746143771.449166:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 19 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.449181:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7513 00000100:00100000:1.0:1746143771.449185:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594444672:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.449194:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.449292:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.449301:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.449301:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1600/0xe984082ccd7313d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a863b expref: 13 pid: 4582 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.449312:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02bca00/0xe984082ccd73149d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a867a expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.449317:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143771.449323:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.449338:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5972050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594444800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 339us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.449339:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594444544:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 316us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.449343:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7511 00000100:00100000:3.0:1746143771.449347:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7512 00000100:00100000:3.0:1746143771.449412:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594457088:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.449429:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.449437:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511200, rc 0) 00000100:00100000:3.0:1746143771.449454:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31612:x1830963594444416:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8515us (8669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.449459:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14044 00000100:00100000:0.0:1746143771.449572:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1964:x1830963594444160:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 9461us (9656us total) trans 0 rc 1044480/1044480 00000100:00100000:0.0:1746143771.449578:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6630 00002000:00100000:0.0:1746143771.449586:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880094763b80 x1830963594444160/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 504/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.449594:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094763b80 with x1830963594444160 ext(1048576->2097151) 00010000:00010000:0.0:1746143771.449599:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 32 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:0.0:1746143771.449606:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 32 pid: 4582 timeout: 950 lvb_type: 0 00002000:00010000:0.0:1746143771.449617:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094763b80 00010000:00010000:1.0:1746143771.449794:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 18 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.449805:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 18 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.449816:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79de00/0xe984082ccd7314ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86a4 expref: 18 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.449828:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.449831:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.449836:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.449844:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.449867:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 17 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.449875:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594457600:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143771.449924:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.451046:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594457600:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143771.451057:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.451085:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594444672:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1898us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.451092:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7513 00000100:00100000:0.0:1746143771.452685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.452721:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.452744:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594445056 00000100:00100000:2.0:1746143771.452750:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594445056 00000100:00100000:0.0:1746143771.452755:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143771.452779:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x356:0x0] (1212416->1216511) req@ffff880094762300 x1830963594445056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.452788:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762300 with x1830963594445056 ext(1212416->1216511) 00002000:00010000:2.0:1746143771.452792:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094762300 00000100:00100000:2.0:1746143771.452813:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594445440 00000100:00100000:2.0:1746143771.452815:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594445440 00002000:00100000:2.0:1746143771.452824:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (2035712->2097151) req@ffff880136919500 x1830963594445440/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.452831:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919500 with x1830963594445440 ext(2035712->2097151) 00010000:00010000:2.0:1746143771.452838:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 32 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.452850:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 32 pid: 4582 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.452855:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136919500 00000100:00100000:2.0:1746143771.452866:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1870 00000100:00100000:2.0:1746143771.452872:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+32:1963:x1830963594445440:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:1.0:1746143771.452874:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6631 00000100:00100000:3.0:1746143771.452880:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594445312 00000100:00100000:1.0:1746143771.452882:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963594445056:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143771.452884:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594445312 00000100:00100000:3.0:1746143771.452907:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14046 00000100:00100000:3.0:1746143771.452912:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31606:x1830963594445312:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143771.452921:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.452932:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8706 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.452963:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.452972:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.452978:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.452984:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143771.453001:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1962:x1830963594445056:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 121us (321us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143771.453005:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6631 00002000:00100000:1.0:1746143771.453009:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1212416->1216511) req@ffff880094762300 x1830963594445056/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.453013:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094762300 with x1830963594445056 ext(1212416->1216511) 00002000:00010000:1.0:1746143771.453015:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094762300 00010000:00010000:3.0:1746143771.453279:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.453284:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1794047] (req 1048576->1794047) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.453309:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.453318:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.453328:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594457728:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.453396:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 17 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.453405:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 17 pid: 8497 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.453412:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594457856:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.453438:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 12 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.453447:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 12 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.453454:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594457984:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.453467:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.454735:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1963:x1830963594445440:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 1859us (1976us total) trans 17179873241 rc 0/0 00000100:00100000:2.0:1746143771.454742:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1870 00002000:00100000:2.0:1746143771.454749:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x357:0x0] (2035712->2097151) req@ffff880136919500 x1830963594445440/t17179873241(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.454761:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919500 with x1830963594445440 ext(2035712->2097151) 00010000:00010000:2.0:1746143771.454768:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.454777:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.454783:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136919500 00000100:00100000:3.0:1746143771.455902:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594457728:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.455917:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594457856:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.455925:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594457984:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.455951:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1048576->1794047] (req 1048576->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.455966:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511800, rc 0) 00000100:00100000:0.0:1746143771.456002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.456010:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31606:x1830963594445312:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3097us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.456016:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14046 00000100:00100000:1.0:1746143771.456090:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594445696 00000100:00100000:1.0:1746143771.456095:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594445696 00010000:00010000:1.0:1746143771.456115:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 13 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.456273:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7514 00000100:00100000:2.0:1746143771.456281:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594445696:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.456291:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.456308:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 13 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.456309:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143771.456317:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 13 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.456331:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594445568 00010000:00010000:2.0:1746143771.456334:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e32c00/0xe984082ccd7313d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8649 expref: 13 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.456337:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594445568 00010000:00010000:2.0:1746143771.456347:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.456348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143771.456363:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 18 pid: 8497 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.456368:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594445696:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 88us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.456373:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7514 00000100:00100000:2.0:1746143771.456386:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7515 00000100:00100000:2.0:1746143771.456392:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594445568:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.456397:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.456404:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 18 pid: 8497 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.456411:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 18 pid: 8497 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.456413:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594445952 00000100:00100000:3.0:1746143771.456417:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594445952 00010000:00010000:2.0:1746143771.456421:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792000/0xe984082ccd7314d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b2 expref: 18 pid: 8497 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.456428:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143771.456438:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012b79c700 x1830963594445952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.456445:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c700 with x1830963594445952 ext(1048576->2097151) 00000100:00100000:2.0:1746143771.456446:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594445568:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 53us (136us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143771.456450:0:8501:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.456451:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7515 00010000:00010000:3.0:1746143771.456459:0:8501:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 950 lvb_type: 1 00002000:00010000:3.0:1746143771.456465:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79c700 00000100:00100000:3.0:1746143771.456483:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1871 00000100:00100000:3.0:1746143771.456488:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594445952:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143771.457700:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.457935:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594446080 00000100:00100000:2.0:1746143771.457941:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594446080 00010000:00010000:2.0:1746143771.457962:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.458409:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7516 00000100:00100000:2.0:1746143771.458419:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594446080:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.458433:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143771.458451:0:9890:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143769 -> 1746143771 00002000:00010000:2.0:1746143771.458453:0:9890:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143769 -> 1746143771 00010000:00010000:2.0:1746143771.458459:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.458471:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.458492:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b161600/0xe984082ccd731522 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f1 expref: 34 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.458507:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.458509:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.458515:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.458524:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.458559:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.458573:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594458112:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143771.458882:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.464826:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594445952:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8329us (8468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.464835:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1871 00002000:00100000:3.0:1746143771.464844:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012b79c700 x1830963594445952/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.464852:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79c700 with x1830963594445952 ext(1048576->2097151) 00010000:00010000:3.0:1746143771.464861:0:26145:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.464876:0:26145:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 950 lvb_type: 1 00002000:00010000:3.0:1746143771.464882:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b79c700 00000100:00100000:2.0:1746143771.465578:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594458112:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143771.465598:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.465632:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+33:1965:x1830963594446080:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 7214us (7934us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.465641:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7516 00000100:00100000:0.0:1746143771.467119:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.467289:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594446336 00000100:00100000:3.0:1746143771.467299:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594446336 00002000:00100000:3.0:1746143771.467340:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136918700 x1830963594446336/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.467348:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918700 with x1830963594446336 ext(1048576->2097151) 00002000:00010000:3.0:1746143771.467352:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136918700 00000100:00100000:3.0:1746143771.467374:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6632 00000100:00100000:3.0:1746143771.467382:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594446336:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143771.475518:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.475557:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.475586:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.475598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.475636:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.475797:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594446592 00000100:00100000:2.0:1746143771.475810:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594446592 00010000:00010000:2.0:1746143771.475853:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 24 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.475897:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7517 00000100:00100000:2.0:1746143771.475904:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594446592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143771.475913:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594446464 00010000:00010000:2.0:1746143771.475918:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143771.475920:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594446464 00010000:00010000:2.0:1746143771.475943:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 25 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.475953:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594446848 00000100:00100000:1.0:1746143771.475955:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594446848 00010000:00010000:2.0:1746143771.475956:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 25 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.475966:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594446720 00000100:00100000:1.0:1746143771.475967:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594446720 00000100:00100000:1.0:1746143771.475974:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594446976 00000100:00100000:1.0:1746143771.475976:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594446976 00010000:00010000:2.0:1746143771.475980:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02bc800/0xe984082ccd7314b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8688 expref: 26 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.475991:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14047 00000100:00100000:1.0:1746143771.475997:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594446464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.476008:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.476010:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.476013:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.476017:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.476026:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.476026:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091716c00/0xe984082ccd73153e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a870d expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.476061:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.476065:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594458368:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143771.476073:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594458240:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143771.476121:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.476182:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14048 00000100:00100000:1.0:1746143771.476187:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594446848:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.476194:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.476202:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a871b expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.476205:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14049 00000100:00100000:3.0:1746143771.476213:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594446720:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.476213:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.476214:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.476219:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.476221:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 35 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.476227:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d511e00/0xe984082ccd73154c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8714 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.476232:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 35 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.476240:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716400, rc 0) 00000100:00100000:3.0:1746143771.476255:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594458496:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143771.476260:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594446848:12345-192.168.202.48@tcp:101:cat.0 Request processed in 73us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.476265:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14048 00000100:00100000:1.0:1746143771.476278:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14050 00000100:00100000:3.0:1746143771.476282:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.476282:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594446976:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.476287:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.476293:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731553 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8722 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.476311:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594458624:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143771.476328:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.476395:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed540 going to sleep for 11 seconds 00002000:00010000:3.0:1746143771.479013:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime: 1746143769 -> 1746143771 00002000:00010000:3.0:1746143771.479019:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime: 1746143769 -> 1746143771 00002000:00010000:3.0:1746143771.479021:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime: 1746143769 -> 1746143771 00000100:00100000:3.0:1746143771.479041:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594458496:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143771.479065:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d511e00/0xe984082ccd73154c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8714 expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.479076:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511e00/0xe984082ccd73154c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8714 expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.479097:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511e00, rc 0) 00000100:00100000:3.0:1746143771.479127:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594446720:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2916us (3527us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143771.479169:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14049 00002000:00010000:1.0:1746143771.479557:0:12618:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime: 1746143768 -> 1746143771 00002000:00010000:1.0:1746143771.479560:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime: 1746143768 -> 1746143771 00002000:00010000:1.0:1746143771.479562:0:12618:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime: 1746143768 -> 1746143771 00000100:00100000:1.0:1746143771.479572:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594458624:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143771.479588:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731553 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8722 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.479596:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091716600/0xe984082ccd731553 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8722 expref: 27 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143771.479613:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594458240:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143771.479614:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716600, rc 0) 00010000:00010000:2.0:1746143771.479634:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.479645:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594446976:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3361us (4008us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.479650:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14050 00000100:00100000:2.0:1746143771.479678:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594446592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3772us (4167us total) trans 0 rc 0/0 00002000:00010000:1.0:1746143771.479682:0:8495:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime: 1746143769 -> 1746143771 00002000:00010000:1.0:1746143771.479684:0:8495:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime: 1746143769 -> 1746143771 00002000:00010000:1.0:1746143771.479686:0:8495:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime: 1746143769 -> 1746143771 00000100:00100000:2.0:1746143771.479692:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7517 00000100:00100000:1.0:1746143771.479697:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594458368:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143771.479711:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091716c00/0xe984082ccd73153e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a870d expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.479721:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091716c00/0xe984082ccd73153e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a870d expref: 24 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.479728:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716c00, rc 0) 00000100:00100000:1.0:1746143771.479745:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594446464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3748us (4188us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.479750:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14047 00000100:00100000:3.0:1746143771.482588:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594446336:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 15200us (15470us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.482598:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6632 00002000:00100000:3.0:1746143771.482607:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880136918700 x1830963594446336/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.482616:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136918700 with x1830963594446336 ext(1048576->2097151) 00002000:00010000:3.0:1746143771.482621:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136918700 00000100:00100000:0.0:1746143771.485268:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.485365:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594447232 00000100:00100000:3.0:1746143771.485371:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594447232 00002000:00100000:3.0:1746143771.485404:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1789952->1794047) req@ffff88008f532d80 x1830963594447232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.485416:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532d80 with x1830963594447232 ext(1789952->1794047) 00002000:00010000:3.0:1746143771.485420:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f532d80 00000100:00100000:3.0:1746143771.485440:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6633 00000100:00100000:3.0:1746143771.485446:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594447232:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.485597:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1963:x1830963594447232:12345-192.168.202.48@tcp:3:cat.0 Request processed in 150us (335us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143771.485603:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6633 00002000:00100000:3.0:1746143771.485607:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x353:0x0] (1789952->1794047) req@ffff88008f532d80 x1830963594447232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.485613:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f532d80 with x1830963594447232 ext(1789952->1794047) 00002000:00010000:3.0:1746143771.485616:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f532d80 00000100:00100000:0.0:1746143771.489890:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.490386:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594447488 00000100:00100000:2.0:1746143771.490394:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594447488 00000100:00100000:2.0:1746143771.490446:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4032 00000100:00100000:2.0:1746143771.490453:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31606:x1830963594447488:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:0.0:1746143771.490855:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.491541:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31606:x1830963594447488:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 1088us (1657us total) trans 8589943677 rc 0/0 00000100:00100000:2.0:1746143771.491548:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4032 00000100:00100000:0.0:1746143771.491775:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.491832:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594447744 00000100:00100000:1.0:1746143771.491836:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594447744 00002000:00100000:1.0:1746143771.491871:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f533480 x1830963594447744/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.491881:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533480 with x1830963594447744 ext(2097152->3145727) 00002000:00010000:1.0:1746143771.491886:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f533480 00000100:00100000:1.0:1746143771.491986:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6634 00000100:00100000:1.0:1746143771.491993:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594447744:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.493054:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.493081:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.493153:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594447872 00000100:00100000:2.0:1746143771.493157:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594447872 00000100:00100000:2.0:1746143771.493183:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14051 00000100:00100000:2.0:1746143771.493188:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31612:x1830963594447872:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.493196:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.493212:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8729 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.493234:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.493241:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143771.493243:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143771.493246:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.493270:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 24 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.493281:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 24 pid: 4582 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.493291:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594458752:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.493348:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.493435:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.493518:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594448128 00000100:00100000:2.0:1746143771.493521:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594448128 00002000:00100000:2.0:1746143771.493538:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9d500 x1830963594448128/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.493545:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d500 with x1830963594448128 ext(3145728->4194303) 00002000:00010000:2.0:1746143771.493548:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9d500 00000100:00100000:2.0:1746143771.493632:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594448384 00000100:00100000:2.0:1746143771.493636:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594448384 00002000:00100000:2.0:1746143771.493648:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc1f80 x1830963594448384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.493655:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1f80 with x1830963594448384 ext(2097152->3145727) 00002000:00010000:2.0:1746143771.493658:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1f80 00000100:00100000:3.0:1746143771.493679:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594448640 00000100:00100000:3.0:1746143771.493683:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594448640 00000100:00100000:3.0:1746143771.493693:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6635 00000100:00100000:3.0:1746143771.493700:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594448128:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143771.495478:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6636 00000100:00100000:1.0:1746143771.495490:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1964:x1830963594448384:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:3.0:1746143771.495597:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009cdc3b80 x1830963594448640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.495606:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963594448640 ext(3145728->4194303) 00002000:00010000:3.0:1746143771.495609:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:3.0:1746143771.495633:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6637 00000100:00100000:3.0:1746143771.495638:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594448640:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.500374:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594458752:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.500400:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 18 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.500415:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2da600, rc 0) 00000100:00100000:3.0:1746143771.500456:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31612:x1830963594447872:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7268us (8680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.500464:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14051 00000100:00100000:0.0:1746143771.500699:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.500717:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594448768 00000100:00100000:2.0:1746143771.500726:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594448768 00002000:00100000:2.0:1746143771.500754:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1794047) req@ffff8800a63a2300 x1830963594448768/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.500768:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2300 with x1830963594448768 ext(1048576->1794047) 00010000:00010000:2.0:1746143771.500774:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 27 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.500785:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 27 pid: 4582 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.500791:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a2300 00000100:00100000:2.0:1746143771.500860:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1872 00000100:00100000:2.0:1746143771.500866:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594448768:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143771.509413:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594448128:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15705us (16353us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.509423:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6635 00002000:00100000:3.0:1746143771.509432:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff880136b9d500 x1830963594448128/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.509440:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136b9d500 with x1830963594448128 ext(3145728->4194303) 00002000:00010000:3.0:1746143771.509445:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136b9d500 00000100:00100000:3.0:1746143771.512541:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594448640:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16895us (19099us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.512551:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6637 00002000:00100000:3.0:1746143771.512559:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009cdc3b80 x1830963594448640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.512568:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc3b80 with x1830963594448640 ext(3145728->4194303) 00002000:00010000:3.0:1746143771.512572:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc3b80 00000100:00100000:2.0:1746143771.518755:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594448384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 23262us (25666us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.518765:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6636 00000100:00100000:1.0:1746143771.518771:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594447744:12345-192.168.202.48@tcp:3:cat.0 Request processed in 26778us (27916us total) trans 0 rc 1048576/1048576 00002000:00100000:2.0:1746143771.518774:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009cdc1f80 x1830963594448384/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143771.518778:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6634 00002000:00100000:2.0:1746143771.518781:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cdc1f80 with x1830963594448384 ext(2097152->3145727) 00002000:00010000:2.0:1746143771.518786:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cdc1f80 00002000:00100000:1.0:1746143771.518786:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88008f533480 x1830963594447744/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.518798:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f533480 with x1830963594447744 ext(2097152->3145727) 00002000:00010000:1.0:1746143771.518801:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f533480 00000100:00100000:2.0:1746143771.522300:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a63a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594448768:12345-192.168.202.48@tcp:4:cat.0 Request processed in 21427us (21594us total) trans 21474840569 rc 0/0 00000100:00100000:2.0:1746143771.522310:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1872 00002000:00100000:2.0:1746143771.522319:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->1794047) req@ffff8800a63a2300 x1830963594448768/t21474840569(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.522328:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a63a2300 with x1830963594448768 ext(1048576->1794047) 00010000:00010000:2.0:1746143771.522338:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.522352:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.522358:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a63a2300 00000100:00100000:0.0:1746143771.524680:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.524757:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594448896 00000100:00100000:2.0:1746143771.524764:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594448896 00010000:00010000:2.0:1746143771.524790:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.524824:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7518 00000100:00100000:2.0:1746143771.524830:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594448896:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.524841:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.524858:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.524867:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.524884:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d511800/0xe984082ccd731537 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8706 expref: 25 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.524910:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.524912:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.524918:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.524929:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.524956:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 17 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.524967:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594458880:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143771.525047:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.526620:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594458880:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143771.526633:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.526667:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1962:x1830963594448896:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1836us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.526674:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7518 00000100:00100000:0.0:1746143771.528421:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.528540:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594449152 00000100:00100000:2.0:1746143771.528547:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594449152 00002000:00100000:2.0:1746143771.528581:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009ff6df80 x1830963594449152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.528590:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6df80 with x1830963594449152 ext(1048576->2097151) 00002000:00010000:2.0:1746143771.528594:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6df80 00000100:00100000:2.0:1746143771.528625:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6638 00000100:00100000:2.0:1746143771.528632:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594449152:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143771.529961:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.529977:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.530004:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.530015:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594449280 00000100:00100000:3.0:1746143771.530071:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594449536 00000100:00100000:3.0:1746143771.530075:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594449536 00000100:00100000:2.0:1746143771.530156:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594449280 00000100:00100000:3.0:1746143771.530269:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594449408 00000100:00100000:3.0:1746143771.530272:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594449408 00000100:00100000:2.0:1746143771.530392:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14052 00000100:00100000:2.0:1746143771.530399:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594449536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.530409:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.530421:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a873e expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.530439:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.530441:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.530447:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.530460:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 26 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.530469:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da23600, rc 0) 00000100:00100000:2.0:1746143771.530494:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594449536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 96us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.530632:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14053 00000100:00100000:3.0:1746143771.530638:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594449280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.530645:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.530652:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091716e00/0xe984082ccd731568 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8730 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.530681:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594459008:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143771.530719:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.530736:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14054 00000100:00100000:3.0:1746143771.530741:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594449408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.530747:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.530755:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091716000/0xe984082ccd73156f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8737 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.530774:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594459136:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143771.530792:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.530896:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14052 00000100:00100000:3.0:1746143771.533540:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594459008:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143771.533565:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091716e00/0xe984082ccd731568 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8730 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.533577:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091716e00/0xe984082ccd731568 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8730 expref: 26 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.533594:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716e00, rc 0) 00000100:00100000:3.0:1746143771.533627:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594449280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2988us (3667us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143771.533634:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14053 00000100:00100000:2.0:1746143771.535080:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8495:1830963594459136:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143771.535099:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091716000/0xe984082ccd73156f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8737 expref: 35 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.535110:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091716000/0xe984082ccd73156f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8737 expref: 35 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.535164:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716000, rc 0) 00000100:00100000:2.0:1746143771.535204:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1964:x1830963594449408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4462us (5198us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143771.535211:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14054 00000100:00100000:2.0:1746143771.536800:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594449152:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 8165us (8378us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.536809:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6638 00002000:00100000:2.0:1746143771.536817:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009ff6df80 x1830963594449152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.536827:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6df80 with x1830963594449152 ext(1048576->2097151) 00002000:00010000:2.0:1746143771.536831:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6df80 00000100:00100000:0.0:1746143771.541978:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.542391:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594449792 00000100:00100000:2.0:1746143771.542399:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594449792 00002000:00100000:2.0:1746143771.542438:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012e17e300 x1830963594449792/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.542447:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17e300 with x1830963594449792 ext(4194304->4771839) 00002000:00010000:2.0:1746143771.542451:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17e300 00000100:00100000:2.0:1746143771.542469:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6639 00000100:00100000:2.0:1746143771.542475:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594449792:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.553017:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.553064:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.553170:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594450048 00000100:00100000:2.0:1746143771.553178:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594450048 00002000:00100000:2.0:1746143771.553213:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012e17c700 x1830963594450048/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.553222:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c700 with x1830963594450048 ext(2097152->3145727) 00002000:00010000:2.0:1746143771.553227:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17c700 00000100:00100000:2.0:1746143771.553255:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594450304 00000100:00100000:2.0:1746143771.553258:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594450304 00002000:00100000:2.0:1746143771.553269:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012e17d180 x1830963594450304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.553276:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17d180 with x1830963594450304 ext(3145728->4194303) 00002000:00010000:2.0:1746143771.553278:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17d180 00000100:00100000:2.0:1746143771.553291:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6640 00000100:00100000:2.0:1746143771.553297:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594450048:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.553624:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6641 00000100:00100000:0.0:1746143771.553632:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594450304:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.555578:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.555624:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.555632:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594450560 00000100:00100000:3.0:1746143771.555639:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594450560 00002000:00100000:3.0:1746143771.555674:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012e17f100 x1830963594450560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.555682:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f100 with x1830963594450560 ext(2097152->3145727) 00002000:00010000:3.0:1746143771.555686:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17f100 00000100:00100000:3.0:1746143771.555703:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594450688 00000100:00100000:3.0:1746143771.555705:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594450688 00002000:00100000:3.0:1746143771.555715:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f01f80 x1830963594450688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.555722:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01f80 with x1830963594450688 ext(3145728->4194303) 00002000:00010000:3.0:1746143771.555724:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01f80 00000100:00100000:3.0:1746143771.555734:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6642 00000100:00100000:3.0:1746143771.555740:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594450560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143771.557187:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6643 00000100:00100000:2.0:1746143771.557197:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594450688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.559033:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594449792:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16553us (17057us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143771.559041:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6639 00002000:00100000:3.0:1746143771.559048:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012e17e300 x1830963594449792/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.559062:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17e300 with x1830963594449792 ext(4194304->4771839) 00002000:00010000:3.0:1746143771.559066:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17e300 00000100:00100000:2.0:1746143771.569889:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594450048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16581us (16869us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.569899:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6640 00002000:00100000:2.0:1746143771.569910:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88012e17c700 x1830963594450048/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.569919:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17c700 with x1830963594450048 ext(2097152->3145727) 00002000:00010000:2.0:1746143771.569923:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17c700 00000100:00100000:0.0:1746143771.570081:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.570107:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.570124:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594450944 00000100:00100000:2.0:1746143771.570154:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594450944 00000100:00100000:3.0:1746143771.570173:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451072 00000100:00100000:3.0:1746143771.570177:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451072 00000100:00100000:2.0:1746143771.570183:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14055 00000100:00100000:2.0:1746143771.570189:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594450944:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:3.0:1746143771.570195:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14056 00000100:00100000:3.0:1746143771.570200:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594451072:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.570202:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.570207:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.570217:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091716600/0xe984082ccd73157d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a874c expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.570259:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594459264:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143771.570302:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143771.570343:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731576 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8745 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.570369:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594459392:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143771.570393:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.570881:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594450304:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17248us (17815us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.570887:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6641 00002000:00100000:1.0:1746143771.570893:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012e17d180 x1830963594450304/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.570900:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17d180 with x1830963594450304 ext(3145728->4194303) 00002000:00010000:1.0:1746143771.570903:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e17d180 00000100:00100000:3.0:1746143771.572036:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594450560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 16292us (16459us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.572043:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6642 00002000:00100000:3.0:1746143771.572048:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012e17f100 x1830963594450560/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.572063:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e17f100 with x1830963594450560 ext(2097152->3145727) 00002000:00010000:3.0:1746143771.572066:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e17f100 00000100:00100000:2.0:1746143771.574964:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594459392:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143771.574992:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731576 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8745 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.575005:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6347e00/0xe984082ccd731576 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8745 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143771.575008:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594459264:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143771.575023:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091716600/0xe984082ccd73157d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a874c expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.575031:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091716600/0xe984082ccd73157d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a874c expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.575106:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716600, rc 0) 00010000:00010000:2.0:1746143771.575374:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347e00, rc 0) 00000100:00100000:3.0:1746143771.575397:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594451072:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5195us (5288us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143771.575405:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14056 00000100:00100000:2.0:1746143771.575510:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594450944:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5320us (5429us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143771.575516:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14055 00000100:00100000:2.0:1746143771.576044:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594450688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18848us (20418us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.576051:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6643 00002000:00100000:2.0:1746143771.576060:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff880093f01f80 x1830963594450688/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.576068:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01f80 with x1830963594450688 ext(3145728->4194303) 00002000:00010000:2.0:1746143771.576072:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f01f80 00000100:00100000:0.0:1746143771.578885:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.579191:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451200 00000100:00100000:2.0:1746143771.579199:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451200 00000100:00100000:2.0:1746143771.579244:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14057 00000100:00100000:2.0:1746143771.579250:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594451200:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.579263:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.579277:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6347a00/0xe984082ccd731584 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8753 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143771.579319:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594459520:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143771.579398:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.579542:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.579706:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451328 00000100:00100000:3.0:1746143771.579710:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451328 00000100:00100000:3.0:1746143771.579746:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14058 00000100:00100000:3.0:1746143771.579751:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594451328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.579760:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.579770:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091716c00/0xe984082ccd73158b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a875a expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.579796:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594459648:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143771.579837:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.581228:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594459520:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143771.581249:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6347a00/0xe984082ccd731584 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8753 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.581259:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6347a00/0xe984082ccd731584 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8753 expref: 26 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.581269:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347a00, rc 0) 00000100:00100000:2.0:1746143771.581308:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594451200:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2058us (2429us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143771.581315:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14057 00000100:00100000:3.0:1746143771.581330:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594459648:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143771.581351:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091716c00/0xe984082ccd73158b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a875a expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.581361:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091716c00/0xe984082ccd73158b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a875a expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.581374:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716c00, rc 0) 00000100:00100000:3.0:1746143771.581393:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594451328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1641us (1852us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143771.581402:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14058 00000100:00100000:1.0:1746143771.581507:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.581606:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451584 00000100:00100000:3.0:1746143771.581611:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451584 00002000:00100000:3.0:1746143771.581636:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012b79dc00 x1830963594451584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.581645:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79dc00 with x1830963594451584 ext(4194304->4771839) 00002000:00010000:3.0:1746143771.581649:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79dc00 00000100:00100000:3.0:1746143771.581677:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6644 00000100:00100000:3.0:1746143771.581682:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594451584:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.586277:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.586397:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594451840 00000100:00100000:2.0:1746143771.586408:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594451840 00000100:00100000:2.0:1746143771.586457:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4033 00000100:00100000:2.0:1746143771.586464:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31611:x1830963594451840:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143771.586621:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31611:x1830963594451840:12345-192.168.202.48@tcp:35:cat.0 Request processed in 157us (352us total) trans 8589943678 rc 0/0 00000100:00100000:2.0:1746143771.586627:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4033 00000100:00100000:3.0:1746143771.586949:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594451584:12345-192.168.202.48@tcp:3:cat.0 Request processed in 5266us (5445us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143771.586957:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6644 00002000:00100000:3.0:1746143771.586964:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012b79dc00 x1830963594451584/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.586971:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79dc00 with x1830963594451584 ext(4194304->4771839) 00002000:00010000:3.0:1746143771.586976:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79dc00 00000100:00100000:0.0:1746143771.593873:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.593973:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452096 00000100:00100000:2.0:1746143771.593981:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452096 00000100:00100000:2.0:1746143771.594031:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4034 00000100:00100000:2.0:1746143771.594038:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+9:31612:x1830963594452096:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143771.594242:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31612:x1830963594452096:12345-192.168.202.48@tcp:35:cat.0 Request processed in 204us (377us total) trans 8589943679 rc 0/0 00000100:00100000:2.0:1746143771.594248:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4034 00000100:00100000:0.0:1746143771.675885:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.677927:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452352 00000100:00100000:2.0:1746143771.677938:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452352 00000100:00100000:2.0:1746143771.678056:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9327 00000100:00100000:2.0:1746143771.678064:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+10:31618:x1830963594452352:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.678087:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.678102:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd731592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8761 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.678215:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678226:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678235:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678250:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678255:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678260:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678348:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346e00/0xe984082ccd7315a7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678359:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346e00/0xe984082ccd7315a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678365:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346e00/0xe984082ccd7315a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143771.678372:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.678436:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678442:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678447:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678453:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6347400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.678456:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678461:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678471:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.678474:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.678476:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678481:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347400/0xe984082ccd731599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678805:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678815:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678819:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678823:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6347200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.678825:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678830:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678836:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365de00) 00010000:00010000:2.0:1746143771.678839:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.678841:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678845:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.678876:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd731592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8761 expref: 13 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.678885:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346e00/0xe984082ccd7315a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8761 expref: 12 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.678891:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.678893:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143771.678895:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346e00, rc 0) 00000100:00100000:2.0:1746143771.681016:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31618:x1830963594452352:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2947us (5133us total) trans 8589943680 rc 0/0 00000100:00100000:2.0:1746143771.681025:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9327 00000100:00100000:0.0:1746143771.683214:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.683980:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452608 00000100:00100000:2.0:1746143771.683988:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452608 00000100:00100000:2.0:1746143771.684034:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4035 00000100:00100000:2.0:1746143771.684040:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+12:31618:x1830963594452608:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143771.684254:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31618:x1830963594452608:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 214us (1046us total) trans 8589943681 rc 0/0 00000100:00100000:2.0:1746143771.684265:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4035 00000100:00100000:0.0:1746143771.689688:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.690447:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452736 00000100:00100000:3.0:1746143771.690455:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452736 00000100:00100000:3.0:1746143771.690563:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14059 00000100:00100000:3.0:1746143771.690571:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31618:x1830963594452736:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143771.690585:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.690599:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8768 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.690627:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.690635:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.690641:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.690643:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.690646:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1953792->2060287] (req 1953792->2060287) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.690669:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 24 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.690680:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 24 pid: 12618 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.690691:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594459776:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.690984:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 19 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.690993:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.691001:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594459904:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.691020:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.694178:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.694218:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594459776:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143771.694228:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594459904:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143771.694253:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1953792->2060287] (req 1953792->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.694255:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143771.694268:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716a00, rc 0) 00000100:00100000:0.0:1746143771.694304:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31618:x1830963594452736:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3734us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.694311:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14059 00000100:00100000:2.0:1746143771.694312:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452992 00000100:00100000:2.0:1746143771.694317:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452992 00010000:00010000:2.0:1746143771.694340:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.694364:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594452864 00000100:00100000:2.0:1746143771.694366:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594452864 00010000:00010000:2.0:1746143771.694374:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 25 pid: 12618 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.694386:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7519 00000100:00100000:2.0:1746143771.694392:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594452992:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.694402:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.694419:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.694428:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.694445:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c2da600/0xe984082ccd73155a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8729 expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.694459:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.694475:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594452992:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.694480:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7519 00000100:00100000:0.0:1746143771.694512:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7520 00000100:00100000:0.0:1746143771.694518:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594452864:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.694525:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.694533:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 25 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.694542:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 25 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.694553:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da23600/0xe984082ccd731561 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a873e expref: 25 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.694565:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.694567:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.694573:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.694579:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.694600:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 17 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.694609:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594460032:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143771.694656:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.696501:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130fd4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7150:1830963594460032:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143771.696514:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.696868:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594452864:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2349us (2612us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.696876:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7520 00000100:00100000:0.0:1746143771.697369:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.697442:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594453248 00000100:00100000:3.0:1746143771.697447:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594453248 00002000:00100000:3.0:1746143771.697502:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1953792->1957887) req@ffff880130fd6a00 x1830963594453248/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.697511:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963594453248 ext(1953792->1957887) 00002000:00010000:3.0:1746143771.697515:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd6a00 00000100:00100000:3.0:1746143771.697528:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6645 00000100:00100000:3.0:1746143771.697535:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594453248:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143771.698184:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594453248:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 648us (814us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143771.698190:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6645 00002000:00100000:3.0:1746143771.698195:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1953792->1957887) req@ffff880130fd6a00 x1830963594453248/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.698203:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6a00 with x1830963594453248 ext(1953792->1957887) 00002000:00010000:3.0:1746143771.698205:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd6a00 00000100:00100000:0.0:1746143771.701952:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.702253:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594453504 00000100:00100000:3.0:1746143771.702261:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594453504 00002000:00100000:3.0:1746143771.702297:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (2056192->2060287) req@ffff880130fd4700 x1830963594453504/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.702306:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4700 with x1830963594453504 ext(2056192->2060287) 00002000:00010000:3.0:1746143771.702311:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4700 00000100:00100000:3.0:1746143771.702326:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6646 00000100:00100000:3.0:1746143771.702334:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594453504:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143771.702483:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594453504:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 149us (537us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143771.702489:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6646 00002000:00100000:3.0:1746143771.702495:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (2056192->2060287) req@ffff880130fd4700 x1830963594453504/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.702501:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4700 with x1830963594453504 ext(2056192->2060287) 00002000:00010000:3.0:1746143771.702504:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd4700 00000100:00100000:0.0:1746143771.713794:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.713890:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594453760 00000100:00100000:2.0:1746143771.713898:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594453760 00000100:00100000:2.0:1746143771.714001:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9328 00000100:00100000:2.0:1746143771.714009:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31620:x1830963594453760:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.714029:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.714043:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346200/0xe984082ccd7315bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a876f expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.714269:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714281:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714290:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714301:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714306:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714312:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714399:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714406:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714412:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143771.714419:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.714483:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714489:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714495:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714500:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6346800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.714504:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714509:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714519:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.714521:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.714524:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714529:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346800/0xe984082ccd7315c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714593:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714598:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714602:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714606:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6346a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.714608:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714612:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714618:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365d300) 00010000:00010000:2.0:1746143771.714620:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.714622:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714626:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.714655:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346200/0xe984082ccd7315bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a876f expref: 246 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.714665:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a876f expref: 245 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.714671:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.714673:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143771.714675:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347200, rc 0) 00000100:00100000:2.0:1746143771.714896:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31620:x1830963594453760:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 887us (1106us total) trans 8589943682 rc 0/0 00000100:00100000:2.0:1746143771.714902:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9328 00000100:00100000:0.0:1746143771.730592:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.733005:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594453888 00000100:00100000:2.0:1746143771.733014:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594453888 00000100:00100000:2.0:1746143771.733059:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14060 00000100:00100000:2.0:1746143771.733065:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31620:x1830963594453888:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.733078:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.733092:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8776 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.733118:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.733124:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 16 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.733155:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.733164:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.733166:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.733168:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 35 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.733195:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.733205:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.733215:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594460160:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.733600:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 16 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.733608:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 16 pid: 25369 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.733615:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594460288:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.733640:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 11 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.733648:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 11 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.733660:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594460416:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.733674:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.737997:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594460160:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.738567:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594460288:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143771.738882:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.739598:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594460416:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.739624:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [4005888->4194303] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 35 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.739637:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6347400, rc 0) 00000100:00100000:2.0:1746143771.739991:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31620:x1830963594453888:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6924us (9404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.739998:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14060 00000100:00100000:3.0:1746143771.740331:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454016 00000100:00100000:3.0:1746143771.740337:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454016 00010000:00010000:3.0:1746143771.740361:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.740380:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7521 00000100:00100000:3.0:1746143771.740386:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:1965:x1830963594454016:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.740396:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.740413:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.740422:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.740439:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f79d800/0xe984082ccd7314c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8696 expref: 35 pid: 6929 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.740458:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.740479:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594454016:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 93us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.740484:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7521 00000100:00100000:0.0:1746143771.740870:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.740904:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.740962:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454144 00000100:00100000:2.0:1746143771.740963:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454272 00000100:00100000:3.0:1746143771.740966:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454144 00000100:00100000:2.0:1746143771.740967:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454272 00010000:00010000:3.0:1746143771.740978:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 17 pid: 25369 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.740980:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 12 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.741005:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7522 00000100:00100000:3.0:1746143771.741009:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7523 00000100:00100000:2.0:1746143771.741010:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594454272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143771.741015:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594454144:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.741016:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.741021:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.741025:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 12 pid: 2839 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.741029:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 17 pid: 25369 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.741037:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 17 pid: 25369 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.741084:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 12 pid: 2839 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.741098:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a2000/0xe984082ccd7314ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c0 expref: 17 pid: 25369 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.741103:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e33200/0xe984082ccd7313e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8657 expref: 12 pid: 2839 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.741108:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.741109:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.741115:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.741136:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.741179:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 33 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.741182:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.741189:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594460544:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143771.741298:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594454272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 286us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.741304:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7522 00000100:00100000:3.0:1746143771.741306:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.743980:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.743997:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454528 00000100:00100000:0.0:1746143771.744001:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454528 00002000:00100000:0.0:1746143771.744031:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4009983) req@ffff88012f187800 x1830963594454528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.744039:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187800 with x1830963594454528 ext(4005888->4009983) 00002000:00010000:0.0:1746143771.744044:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187800 00000100:00100000:0.0:1746143771.744058:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6647 00000100:00100000:0.0:1746143771.744063:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594454528:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143771.744191:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594460544:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143771.744208:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143771.744219:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594454528:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 154us (243us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143771.744224:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6647 00002000:00100000:0.0:1746143771.744230:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4009983) req@ffff88012f187800 x1830963594454528/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143771.744231:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594454144:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3215us (3361us total) trans 0 rc 0/0 00002000:00100000:0.0:1746143771.744237:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187800 with x1830963594454528 ext(4005888->4009983) 00000100:00100000:3.0:1746143771.744238:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7523 00002000:00010000:0.0:1746143771.744239:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187800 00000100:00100000:0.0:1746143771.747612:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.747841:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454656 00000100:00100000:2.0:1746143771.747848:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454656 00000100:00100000:2.0:1746143771.747890:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14061 00000100:00100000:2.0:1746143771.747896:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31620:x1830963594454656:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.747910:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.747923:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a877d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.748204:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.748212:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.748219:0:6929:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 25 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.748226:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.748228:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.748231:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [4194304->4345855] (req 4194304->4345855) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.748256:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 25 pid: 2839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.748267:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 25 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.748277:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594460672:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.748985:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.748994:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 17 pid: 25369 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.749002:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594460800:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.749028:0:6929:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 11 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.749035:0:6929:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 11 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:2.0:1746143771.749048:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594460928:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.749063:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c0ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.750135:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594460672:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143771.756849:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.756880:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.756914:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.757078:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454784 00000100:00100000:2.0:1746143771.757087:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454784 00010000:00010000:2.0:1746143771.757113:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 12 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.757200:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594454912 00000100:00100000:0.0:1746143771.757203:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594454912 00010000:00010000:0.0:1746143771.757217:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 26 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.757231:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455040 00000100:00100000:0.0:1746143771.757233:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455040 00010000:00010000:0.0:1746143771.757240:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 18 pid: 25369 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.757252:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7524 00000100:00100000:0.0:1746143771.757257:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594454784:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143771.757268:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143771.757286:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 12 pid: 4582 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.757295:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 12 pid: 4582 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.757320:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.757350:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7525 00000100:00100000:0.0:1746143771.757356:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1962:x1830963594454784:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 99us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.757358:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1964:x1830963594454912:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143771.757362:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7524 00010000:00010000:3.0:1746143771.757366:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.757375:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 26 pid: 2839 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.757376:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7526 00000100:00100000:0.0:1746143771.757380:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594455040:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.757385:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 26 pid: 2839 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.757387:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.757398:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792400/0xe984082ccd7314b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a868f expref: 26 pid: 2839 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.757406:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 18 pid: 25369 timeout: 950 lvb_type: 1 00010000:00010000:0.0:1746143771.757413:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 18 pid: 25369 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.757419:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143771.757424:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.757425:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.757430:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.757437:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594454912:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 80us (556us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143771.757437:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 25 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.757442:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7525 00010000:00010000:0.0:1746143771.757463:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.757473:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594461056:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143771.757521:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143771.757550:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3000/0xe984082ccd7314e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86b9 expref: 18 pid: 25369 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.757563:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594460800:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143771.757576:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930b1a00/0xe984082ccd7313f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8650 expref: 11 pid: 4582 timeout: 950 lvb_type: 1 00000100:00100000:0.0:1746143771.757593:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c3f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594460928:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143771.757613:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.757620:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6346a00, rc 0) 00000100:00100000:0.0:1746143771.757640:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31620:x1830963594454656:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 9744us (10036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.757646:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14061 00000100:00100000:2.0:1746143771.759965:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594461056:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143771.759979:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143771.760018:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1963:x1830963594455040:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2636us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.760025:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7526 00000100:00100000:0.0:1746143771.762497:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.763472:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455296 00000100:00100000:2.0:1746143771.763478:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455296 00002000:00100000:2.0:1746143771.763509:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4341760->4345855) req@ffff8800930d2d80 x1830963594455296/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.763516:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2d80 with x1830963594455296 ext(4341760->4345855) 00002000:00010000:2.0:1746143771.763519:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d2d80 00000100:00100000:2.0:1746143771.763536:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6648 00000100:00100000:2.0:1746143771.763540:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594455296:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143771.763674:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1964:x1830963594455296:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 132us (1182us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143771.763684:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6648 00002000:00100000:2.0:1746143771.763689:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4341760->4345855) req@ffff8800930d2d80 x1830963594455296/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.763696:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930d2d80 with x1830963594455296 ext(4341760->4345855) 00002000:00010000:2.0:1746143771.763698:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800930d2d80 00000100:00100000:0.0:1746143771.766249:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.766470:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455552 00000100:00100000:1.0:1746143771.766648:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455552 00000100:00100000:1.0:1746143771.766962:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4036 00000100:00100000:1.0:1746143771.766968:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+245:31620:x1830963594455552:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143771.767551:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31620:x1830963594455552:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 582us (1307us total) trans 8589943683 rc 0/0 00000100:00100000:1.0:1746143771.767557:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4036 00010000:00010000:2.0:1746143771.789666:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143771.808045:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.808178:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455808 00000100:00100000:2.0:1746143771.808185:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455808 00000100:00100000:2.0:1746143771.809223:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9329 00000100:00100000:2.0:1746143771.809235:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+246:31625:x1830963594455808:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.809252:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.809268:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd7315ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8784 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.809358:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809368:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809377:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809386:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809391:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809396:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809554:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd731602 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809562:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd731602 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809568:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd731602 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143771.809575:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.809634:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809639:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809644:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809649:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5c200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.809652:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809657:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809664:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.809666:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.809669:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809672:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7315f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809700:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809704:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809708:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809711:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e5c000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.809713:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809717:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809721:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365d300) 00010000:00010000:2.0:1746143771.809723:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.809725:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809729:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5c000/0xe984082ccd7315fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.809755:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de800/0xe984082ccd7315ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8784 expref: 249 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.813294:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd731602 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8784 expref: 248 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.813303:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.813306:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143771.813309:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5ce00, rc 0) 00000100:00100000:2.0:1746143771.813372:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31625:x1830963594455808:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4138us (5333us total) trans 8589943684 rc 0/0 00000100:00100000:2.0:1746143771.813380:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9329 00000100:00100000:0.0:1746143771.816774:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.816824:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.816836:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594455936 00000100:00100000:2.0:1746143771.816843:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594455936 00000100:00100000:2.0:1746143771.816884:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 753 00000100:00100000:2.0:1746143771.816890:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1965:x1830963594455936:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.816901:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.816919:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5e5ce00/0xe984082ccd731602 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8784 expref: 248 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.816933:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00000100:00100000:1.0:1746143771.816935:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594456192 00010000:00010000:2.0:1746143771.816937:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.816939:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594456192 00000100:00100000:1.0:1746143771.816966:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14062 00000100:00100000:1.0:1746143771.816972:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594456192:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:2.0:1746143771.816977:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:1965:x1830963594455936:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.816983:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 753 00010000:00010000:1.0:1746143771.816983:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.817048:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d510400/0xe984082ccd731610 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8792 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.817387:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594461184:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143771.818616:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.820671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.820756:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.821442:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.821463:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594456576 00000100:00100000:2.0:1746143771.821468:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594456576 00000100:00100000:2.0:1746143771.821504:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9330 00000100:00100000:2.0:1746143771.821510:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+13:31628:x1830963594456576:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.821526:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.821538:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd731617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87a0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.821625:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821636:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821644:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821654:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821659:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821664:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821741:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89ca00/0xe984082ccd73162c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821748:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89ca00/0xe984082ccd73162c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821753:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89ca00/0xe984082ccd73162c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143771.821761:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.821819:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821825:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821834:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821840:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6165e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.821844:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821849:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821857:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.821859:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.821862:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821866:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6165e00/0xe984082ccd73161e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821876:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821880:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821884:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821888:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f89da00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.821890:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821895:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821903:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365d900) 00010000:00010000:2.0:1746143771.821905:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.821907:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821911:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89da00/0xe984082ccd731625 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.821937:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4de600/0xe984082ccd731617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87a0 expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.821946:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89ca00/0xe984082ccd73162c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87a0 expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.821951:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.821953:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143771.821955:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f89ca00, rc 0) 00000100:00100000:0.0:1746143771.821966:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594456064 00000100:00100000:0.0:1746143771.821969:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594456064 00000100:00100000:2.0:1746143771.821985:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:31628:x1830963594456576:12345-192.168.202.48@tcp:101:cat.0 Request processed in 476us (544us total) trans 8589943685 rc 0/0 00000100:00100000:2.0:1746143771.821991:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9330 00000100:00100000:0.0:1746143771.821994:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594456320 00000100:00100000:0.0:1746143771.821995:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594456320 00000100:00100000:0.0:1746143771.822009:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14063 00000100:00100000:0.0:1746143771.822014:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594456064:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.822021:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.822029:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a792a00/0xe984082ccd73163a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a878b expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.822057:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594461312:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143771.822108:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.822119:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14064 00000100:00100000:0.0:1746143771.822125:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1965:x1830963594456320:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.822153:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.822159:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a793e00/0xe984082ccd731641 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8799 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.822179:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594461440:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143771.822207:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.824001:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090766300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594461440:192.168.202.48@tcp:106: 00010000:00010000:0.0:1746143771.824018:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a793e00/0xe984082ccd731641 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8799 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.824028:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a793e00/0xe984082ccd731641 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8799 expref: 27 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.824038:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a793e00, rc 0) 00000100:00100000:2.0:1746143771.824046:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090765180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594461312:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143771.824060:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a792a00/0xe984082ccd73163a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a878b expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.824070:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a792a00/0xe984082ccd73163a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a878b expref: 26 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.824077:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a792a00, rc 0) 00000100:00100000:1.0:1746143771.824339:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:6929:1830963594461184:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143771.824356:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d510400/0xe984082ccd731610 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8792 expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.824364:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d510400/0xe984082ccd731610 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8792 expref: 35 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.825268:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510400, rc 0) 00000100:00100000:2.0:1746143771.825386:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594456064:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3369us (4716us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143771.825393:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14063 00000100:00100000:0.0:1746143771.825425:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594456320:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3299us (4667us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143771.825431:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14064 00000100:00100000:1.0:1746143771.825517:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:1965:x1830963594456192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8545us (8692us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.825523:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14062 00000100:00100000:2.0:1746143771.825749:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.825770:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.825814:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594456704 00000100:00100000:1.0:1746143771.825818:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594456704 00000100:00100000:1.0:1746143771.825843:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14065 00000100:00100000:1.0:1746143771.825848:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594456704:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.825859:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.825869:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d510e00/0xe984082ccd731648 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87a7 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.825901:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594461568:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143771.825949:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.825980:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594456832 00000100:00100000:3.0:1746143771.825983:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594456832 00000100:00100000:3.0:1746143771.826008:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 754 00000100:00100000:3.0:1746143771.826012:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+15:1965:x1830963594456832:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.826019:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.826033:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f89ca00/0xe984082ccd73162c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87a0 expref: 15 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.826049:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.826052:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.826067:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:1965:x1830963594456832:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 54us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.826073:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 754 00000100:00100000:0.0:1746143771.826213:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.826227:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594456960 00000100:00100000:3.0:1746143771.826230:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594456960 00000100:00100000:3.0:1746143771.826245:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14066 00000100:00100000:3.0:1746143771.826250:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594456960:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.826256:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.826264:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091717000/0xe984082ccd73164f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87ae expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.826284:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594461696:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143771.826308:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143771.827842:0:6929:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143769 -> 1746143771 00002000:00010000:1.0:1746143771.827848:0:6929:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143769 -> 1746143771 00002000:00010000:1.0:1746143771.827850:0:6929:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143769 -> 1746143771 00000100:00100000:1.0:1746143771.827867:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594461568:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143771.827891:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d510e00/0xe984082ccd731648 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87a7 expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.827900:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d510e00/0xe984082ccd731648 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87a7 expref: 18 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.827908:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d510e00, rc 0) 00000100:00100000:1.0:1746143771.827935:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594456704:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2086us (2185us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.827940:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14065 00002000:00010000:3.0:1746143771.828011:0:25369:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143769 -> 1746143771 00002000:00010000:3.0:1746143771.828013:0:25369:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143769 -> 1746143771 00002000:00010000:3.0:1746143771.828015:0:25369:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143769 -> 1746143771 00000100:00100000:3.0:1746143771.828026:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594461696:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143771.828039:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091717000/0xe984082ccd73164f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ae expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.828047:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091717000/0xe984082ccd73164f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ae expref: 17 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.828054:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091717000, rc 0) 00000100:00100000:3.0:1746143771.828069:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594456960:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1819us (1856us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143771.828073:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14066 00000100:00100000:0.0:1746143771.829112:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.829864:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594457088 00000100:00100000:3.0:1746143771.829868:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594457088 00000100:00100000:3.0:1746143771.829900:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14067 00000100:00100000:3.0:1746143771.829904:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:31625:x1830963594457088:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.829915:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.829924:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87b5 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.829945:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.829952:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.829961:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.829965:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.829985:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 16 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.829994:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 16 pid: 8495 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.830002:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594461824:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.830751:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.831708:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594461824:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.831726:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 25 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.831737:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716800, rc 0) 00000100:00100000:3.0:1746143771.831761:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:31625:x1830963594457088:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1856us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.831768:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14067 00000100:00100000:0.0:1746143771.832634:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.832834:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594457216 00000100:00100000:2.0:1746143771.832839:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594457216 00002000:00100000:2.0:1746143771.832868:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (614400->1048575) req@ffff88012fc24e00 x1830963594457216/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.832876:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24e00 with x1830963594457216 ext(614400->1048575) 00010000:00010000:2.0:1746143771.832882:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 17 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.832892:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 17 pid: 8495 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.832898:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc24e00 00000100:00100000:2.0:1746143771.832920:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1873 00000100:00100000:2.0:1746143771.832925:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594457216:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143771.833847:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.833861:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.833892:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.834355:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594457472 00000100:00100000:1.0:1746143771.834359:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594457472 00002000:00100000:1.0:1746143771.834381:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->614399) req@ffff88012fc25500 x1830963594457472/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.834387:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25500 with x1830963594457472 ext(0->614399) 00010000:00010000:1.0:1746143771.834391:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.834400:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00002000:00010000:1.0:1746143771.834405:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc25500 00000100:00100000:1.0:1746143771.834415:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594457856 00000100:00100000:1.0:1746143771.834418:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594457856 00002000:00100000:1.0:1746143771.834429:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1216512->2097151) req@ffff88012fc27480 x1830963594457856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.834435:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc27480 with x1830963594457856 ext(1216512->2097151) 00002000:00010000:1.0:1746143771.834438:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc27480 00000100:00100000:1.0:1746143771.834447:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594457984 00000100:00100000:1.0:1746143771.834448:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594457984 00002000:00100000:1.0:1746143771.834457:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc25c00 x1830963594457984/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 504/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.834464:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25c00 with x1830963594457984 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.834467:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc25c00 00000100:00100000:1.0:1746143771.834479:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1874 00000100:00100000:1.0:1746143771.834485:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594457472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143771.835311:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6649 00000100:00100000:1.0:1746143771.835318:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594457856:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.836262:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6650 00000100:00100000:3.0:1746143771.836270:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594457984:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143771.846644:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594457216:12345-192.168.202.48@tcp:4:cat.0 Request processed in 13709us (14003us total) trans 21474840570 rc 0/0 00000100:00100000:2.0:1746143771.846654:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1873 00002000:00100000:2.0:1746143771.846664:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x351:0x0] (614400->1048575) req@ffff88012fc24e00 x1830963594457216/t21474840570(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.846672:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc24e00 with x1830963594457216 ext(614400->1048575) 00010000:00010000:2.0:1746143771.846681:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 22 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.846693:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 22 pid: 8495 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.846698:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc24e00 00000100:00100000:1.0:1746143771.846752:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594457472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12266us (12904us total) trans 0 rc 614400/614400 00000100:00100000:1.0:1746143771.846758:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1874 00002000:00100000:1.0:1746143771.846764:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x351:0x0] (0->614399) req@ffff88012fc25500 x1830963594457472/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.846770:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25500 with x1830963594457472 ext(0->614399) 00010000:00010000:1.0:1746143771.846775:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 21 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.846787:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 21 pid: 8495 timeout: 950 lvb_type: 0 00002000:00010000:1.0:1746143771.846792:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fc25500 00000100:00100000:1.0:1746143771.847091:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1962:x1830963594457856:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11773us (13228us total) trans 0 rc 880640/880640 00000100:00100000:1.0:1746143771.847096:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6649 00002000:00100000:1.0:1746143771.847101:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1216512->2097151) req@ffff88012fc27480 x1830963594457856/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 880640/880640 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.847107:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc27480 with x1830963594457856 ext(1216512->2097151) 00002000:00010000:1.0:1746143771.847110:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fc27480 00000100:00100000:3.0:1746143771.848161:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1962:x1830963594457984:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11890us (14266us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746143771.848167:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6650 00002000:00100000:3.0:1746143771.848173:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012fc25c00 x1830963594457984/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 504/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.848179:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fc25c00 with x1830963594457984 ext(1048576->2097151) 00002000:00010000:3.0:1746143771.848182:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fc25c00 00000100:00100000:0.0:1746143771.858495:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.858875:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594458112 00000100:00100000:3.0:1746143771.858882:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594458112 00010000:00010000:3.0:1746143771.858915:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.858947:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7527 00000100:00100000:3.0:1746143771.858954:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594458112:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.858964:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.858984:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.858995:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.859012:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b299e00/0xe984082ccd73151b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 614400->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ea expref: 19 pid: 8495 timeout: 950 lvb_type: 0 00000100:00100000:0.0:1746143771.859748:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143771.859898:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.859901:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.859907:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.859915:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143771.859928:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594458240 00000100:00100000:0.0:1746143771.859931:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594458240 00010000:00010000:3.0:1746143771.859940:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 24 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.859950:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594461952:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143771.859963:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14068 00000100:00100000:0.0:1746143771.859968:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594458240:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.859978:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.859988:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87bc expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.859998:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.859999:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143771.860003:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143771.860003:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.860012:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.860018:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e33200, rc 0) 00000100:00100000:0.0:1746143771.860036:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594458240:12345-192.168.202.48@tcp:101:cat.0 Request processed in 68us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.860040:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14068 00000100:00100000:0.0:1746143771.861373:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.861468:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.861536:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594458368 00000100:00100000:2.0:1746143771.861541:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594458368 00000100:00100000:2.0:1746143771.861564:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594458496 00000100:00100000:2.0:1746143771.861566:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594458496 00000100:00100000:1.0:1746143771.861587:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14069 00000100:00100000:1.0:1746143771.861595:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594458368:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.861602:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.861610:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d511000/0xe984082ccd731664 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87c3 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.861632:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14070 00000100:00100000:1.0:1746143771.861636:0:6929:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594462080:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143771.861640:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594458496:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.861649:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.861658:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd73166b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87ca expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.861665:0:6929:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.861682:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462208:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143771.861704:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.861724:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594461952:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143771.861735:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.861749:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594458112:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2796us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.861755:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7527 00000100:00100000:1.0:1746143771.862664:0:6929:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:6929:1830963594462080:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143771.862679:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d511000/0xe984082ccd731664 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87c3 expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.862692:0:6929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d511000/0xe984082ccd731664 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87c3 expref: 20 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.862714:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d511000, rc 0) 00000100:00100000:1.0:1746143771.862736:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1963:x1830963594458368:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1143us (1366us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.862741:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14069 00000100:00100000:0.0:1746143771.862771:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.862810:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594458752 00000100:00100000:3.0:1746143771.862814:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594458752 00002000:00100000:3.0:1746143771.862836:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ca6fb80 x1830963594458752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.862844:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6fb80 with x1830963594458752 ext(0->1048575) 00002000:00010000:3.0:1746143771.862848:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6fb80 00000100:00100000:3.0:1746143771.862860:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6651 00000100:00100000:3.0:1746143771.862865:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594458752:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.864687:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462208:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143771.864712:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd73166b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ca expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.864725:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091716e00/0xe984082ccd73166b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ca expref: 17 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.864748:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091716e00, rc 0) 00000100:00100000:3.0:1746143771.864785:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1963:x1830963594458496:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3145us (3315us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143771.864791:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14070 00000100:00100000:0.0:1746143771.870315:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.870454:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594458752:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7587us (7680us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.870464:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6651 00002000:00100000:3.0:1746143771.870474:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88009ca6fb80 x1830963594458752/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.870483:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6fb80 with x1830963594458752 ext(0->1048575) 00002000:00010000:3.0:1746143771.870488:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca6fb80 00000100:00100000:2.0:1746143771.870489:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594458880 00000100:00100000:2.0:1746143771.870496:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594458880 00000100:00100000:2.0:1746143771.870542:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14071 00000100:00100000:2.0:1746143771.870549:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31628:x1830963594458880:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.870562:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.870576:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87d1 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.870600:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.870607:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143771.870610:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143771.870613:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 20 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.870636:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 24 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.870657:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 24 pid: 6929 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.870666:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594462336:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.870726:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.872079:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594462336:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.872097:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 20 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.872113:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131266e00, rc 0) 00000100:00100000:2.0:1746143771.872176:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31628:x1830963594458880:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1626us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.872181:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14071 00000100:00100000:0.0:1746143771.873629:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.873874:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594459008 00000100:00100000:3.0:1746143771.873880:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594459008 00002000:00100000:3.0:1746143771.873911:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4345855) req@ffff88009c275880 x1830963594459008/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.873919:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275880 with x1830963594459008 ext(4194304->4345855) 00010000:00010000:3.0:1746143771.873926:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 25 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.873939:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 25 pid: 6929 timeout: 950 lvb_type: 0 00002000:00010000:3.0:1746143771.873945:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c275880 00000100:00100000:3.0:1746143771.874449:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1875 00000100:00100000:3.0:1746143771.874455:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1962:x1830963594459008:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143771.877716:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.877768:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594459136 00000100:00100000:2.0:1746143771.877775:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594459136 00000100:00100000:2.0:1746143771.877809:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14072 00000100:00100000:2.0:1746143771.877815:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+34:31625:x1830963594459136:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.877827:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.877839:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87d8 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.877858:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.877868:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143771.877870:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143771.877873:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 35 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.877897:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 15 pid: 9527 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.877906:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 15 pid: 9527 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.877915:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462464:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.877981:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.878300:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1962:x1830963594459008:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3843us (4672us total) trans 21474840571 rc 0/0 00000100:00100000:3.0:1746143771.878308:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1875 00002000:00100000:3.0:1746143771.878316:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4345855) req@ffff88009c275880 x1830963594459008/t21474840571(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.878324:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c275880 with x1830963594459008 ext(4194304->4345855) 00010000:00010000:3.0:1746143771.878331:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 27 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.878345:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 27 pid: 6929 timeout: 950 lvb_type: 0 00002000:00010000:3.0:1746143771.878350:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c275880 00000100:00100000:2.0:1746143771.878866:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fc12300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462464:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143771.878881:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 35 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.878891:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131267000, rc 0) 00000100:00100000:2.0:1746143771.878917:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31625:x1830963594459136:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1103us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.878922:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14072 00000100:00100000:0.0:1746143771.879540:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.879592:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.879635:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594459264 00000100:00100000:2.0:1746143771.879640:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594459264 00000100:00100000:3.0:1746143771.879658:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594459392 00002000:00100000:2.0:1746143771.879659:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1216511) req@ffff88009c276680 x1830963594459264/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143771.879662:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594459392 00002000:00100000:2.0:1746143771.879671:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276680 with x1830963594459264 ext(1048576->1216511) 00010000:00010000:2.0:1746143771.879675:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 16 pid: 9527 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.879678:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 27 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.879683:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 16 pid: 9527 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.879688:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c276680 00000100:00100000:3.0:1746143771.879698:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7528 00000100:00100000:3.0:1746143771.879703:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594459392:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.879712:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143771.879712:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1876 00000100:00100000:2.0:1746143771.879717:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594459264:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:3.0:1746143771.879727:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 27 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.879736:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 27 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.879752:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6346a00/0xe984082ccd7315e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4345855) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a877d expref: 27 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.879772:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.879774:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.879779:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.879791:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.879811:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 19 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.879820:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594462592:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143771.879857:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.882843:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594459264:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3118us (3242us total) trans 17179873242 rc 0/0 00000100:00100000:2.0:1746143771.882853:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1876 00002000:00100000:2.0:1746143771.882861:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1216511) req@ffff88009c276680 x1830963594459264/t17179873242(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.882869:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c276680 with x1830963594459264 ext(1048576->1216511) 00010000:00010000:2.0:1746143771.882877:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 18 pid: 9527 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.882888:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 18 pid: 9527 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.882894:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c276680 00000100:00100000:3.0:1746143771.883261:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7151:1830963594462592:192.168.202.48@tcp:105: 00000100:00100000:0.0:1746143771.883276:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143771.883278:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.883309:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:1963:x1830963594459392:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3604us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.883317:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7528 00000100:00100000:2.0:1746143771.883506:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594459648 00000100:00100000:2.0:1746143771.883512:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594459648 00002000:00100000:2.0:1746143771.883532:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009c277b80 x1830963594459648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.883539:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277b80 with x1830963594459648 ext(2097152->3145727) 00002000:00010000:2.0:1746143771.883542:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c277b80 00000100:00100000:2.0:1746143771.883567:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6652 00000100:00100000:2.0:1746143771.883572:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594459648:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.887868:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.887959:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.888041:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594460032 00000100:00100000:2.0:1746143771.888048:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594460032 00000100:00100000:2.0:1746143771.888095:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9331 00000100:00100000:2.0:1746143771.888102:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+247:31630:x1830963594460032:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.888120:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.888164:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131266c00/0xe984082ccd731680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87df expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.888198:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594459776 00000100:00100000:3.0:1746143771.888203:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594459776 00010000:00010000:3.0:1746143771.888223:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 18 pid: 9527 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.888258:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7529 00000100:00100000:3.0:1746143771.888264:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594459776:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143771.888271:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.888275:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143771.888284:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888294:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143771.888295:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 18 pid: 9527 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.888311:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 18 pid: 9527 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.888327:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da23c00/0xe984082ccd731530 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86f8 expref: 18 pid: 9527 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.888429:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.888431:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.888437:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.888445:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.888475:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 34 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.888485:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594462720:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143771.888754:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888762:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888771:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:3.0:1746143771.888786:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143771.888868:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786400/0xe984082ccd731695 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888875:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786400/0xe984082ccd731695 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888881:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786400/0xe984082ccd731695 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143771.888888:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.888954:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888961:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888965:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888969:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0786000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.888973:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888979:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.888987:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.888989:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.888992:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889000:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786000/0xe984082ccd731687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889011:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889016:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889020:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889024:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0786200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.889026:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889030:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889035:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365de00) 00010000:00010000:2.0:1746143771.889037:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.889039:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889043:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786200/0xe984082ccd73168e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.889069:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131266c00/0xe984082ccd731680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87df expref: 250 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.889078:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786400/0xe984082ccd731695 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87df expref: 249 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.889087:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.889089:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143771.889091:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0786400, rc 0) 00000100:00100000:2.0:1746143771.889155:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31630:x1830963594460032:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1026us (1168us total) trans 8589943686 rc 0/0 00000100:00100000:2.0:1746143771.889161:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9331 00000100:00100000:3.0:1746143771.890062:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594462720:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143771.890075:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.890304:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594459776:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2039us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.890312:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7529 00000100:00100000:0.0:1746143771.891159:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594459648:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7584us (7881us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143771.891166:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6652 00002000:00100000:0.0:1746143771.891174:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009c277b80 x1830963594459648/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.891183:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c277b80 with x1830963594459648 ext(2097152->3145727) 00002000:00010000:0.0:1746143771.891188:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c277b80 00000100:00100000:0.0:1746143771.891579:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.891626:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594460160 00000100:00100000:3.0:1746143771.891631:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594460160 00000100:00100000:3.0:1746143771.891662:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 755 00000100:00100000:3.0:1746143771.891666:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:1962:x1830963594460160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.891674:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.891799:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0786400/0xe984082ccd731695 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87df expref: 249 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.891809:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143771.891812:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.891965:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:1962:x1830963594460160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 298us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.891970:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 755 00000100:00100000:2.0:1746143771.892043:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.892165:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594460288 00000100:00100000:3.0:1746143771.892168:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594460288 00000100:00100000:3.0:1746143771.892237:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14073 00000100:00100000:3.0:1746143771.892243:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+35:31630:x1830963594460288:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143771.892255:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.892265:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87e6 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.892283:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.892292:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 36 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.892297:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.892300:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.892303:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1105920->1200127] (req 1105920->1200127) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.892324:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 36 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143771.892335:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 36 pid: 12618 timeout: 950 lvb_type: 1 00000100:00100000:3.0:1746143771.892345:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462848:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.892415:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 16 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.892423:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 16 pid: 4582 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.892430:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462976:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.892531:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.893702:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462848:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143771.894407:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.894449:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.894544:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594460544 00000100:00100000:1.0:1746143771.894549:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594460544 00002000:00100000:1.0:1746143771.894578:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880130fd4380 x1830963594460544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746143771.894584:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594460672 00002000:00100000:1.0:1746143771.894587:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963594460544 ext(1048576->2097151) 00000100:00100000:2.0:1746143771.894588:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594460672 00002000:00010000:1.0:1746143771.894591:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4380 00002000:00100000:2.0:1746143771.894606:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093f01500 x1830963594460672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143771.894611:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6653 00002000:00100000:2.0:1746143771.894613:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963594460672 ext(1048576->2097151) 00000100:00100000:1.0:1746143771.894617:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594460544:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:2.0:1746143771.894619:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 38 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:2.0:1746143771.894629:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 38 pid: 12618 timeout: 950 lvb_type: 1 00002000:00010000:2.0:1746143771.894635:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f01500 00000100:00100000:2.0:1746143771.894658:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1877 00000100:00100000:2.0:1746143771.894664:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594460672:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143771.896703:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.896723:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594462976:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143771.896748:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143771.896754:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1105920->1200127] (req 1105920->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 40 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.896769:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c2da600, rc 0) 00000100:00100000:3.0:1746143771.896811:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:31630:x1830963594460288:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 4567us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.896819:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14073 00000100:00100000:3.0:1746143771.896837:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594460928 00000100:00100000:3.0:1746143771.896841:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594460928 00000100:00100000:3.0:1746143771.896860:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14074 00000100:00100000:3.0:1746143771.896865:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31628:x1830963594460928:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.896875:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.896886:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87ed expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.896902:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.896909:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.896911:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.896913:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 18 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.896934:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 39 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.896944:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 39 pid: 6929 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.896953:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594463104:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.896995:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.897007:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594461056 00000100:00100000:3.0:1746143771.897010:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594461056 00010000:00010000:3.0:1746143771.897274:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 19 pid: 4582 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.897305:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7530 00000100:00100000:3.0:1746143771.897310:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594461056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.897318:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.897331:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 19 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.897339:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 19 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.897353:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d511200/0xe984082ccd731529 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86ff expref: 19 pid: 4582 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.897362:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.898058:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594461056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 746us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.898065:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7530 00000100:00100000:0.0:1746143771.898892:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.898961:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594463104:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143771.898976:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 17 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.898987:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b161800, rc 0) 00000100:00100000:3.0:1746143771.899004:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31628:x1830963594460928:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2139us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143771.899011:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14074 00000100:00100000:3.0:1746143771.900887:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594461184 00000100:00100000:3.0:1746143771.900895:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594461184 00002000:00100000:3.0:1746143771.900923:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4194303) req@ffff880093f02680 x1830963594461184/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.900933:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02680 with x1830963594461184 ext(4005888->4194303) 00010000:00010000:3.0:1746143771.900940:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 40 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.900951:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 40 pid: 6929 timeout: 950 lvb_type: 0 00002000:00010000:3.0:1746143771.900958:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f02680 00000100:00100000:3.0:1746143771.900987:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1878 00000100:00100000:3.0:1746143771.900994:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594461184:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:3.0:1746143771.906339:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594460672:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11665us (11880us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.906348:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1877 00002000:00100000:3.0:1746143771.906358:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff880093f01500 x1830963594460672/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.906367:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f01500 with x1830963594460672 ext(1048576->2097151) 00010000:00010000:3.0:1746143771.906377:0:31339:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 40 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:3.0:1746143771.906393:0:31339:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 40 pid: 12618 timeout: 950 lvb_type: 1 00002000:00010000:3.0:1746143771.906399:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f01500 00000100:00100000:2.0:1746143771.906727:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594461184:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 5732us (7834us total) trans 17179873243 rc 0/0 00000100:00100000:2.0:1746143771.906734:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1878 00002000:00100000:2.0:1746143771.906740:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (4005888->4194303) req@ffff880093f02680 x1830963594461184/t17179873243(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.906748:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f02680 with x1830963594461184 ext(4005888->4194303) 00010000:00010000:2.0:1746143771.906754:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 40 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.906763:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 40 pid: 6929 timeout: 950 lvb_type: 0 00002000:00010000:2.0:1746143771.906769:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f02680 00000100:00100000:1.0:1746143771.908652:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594460544:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14030us (14241us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.908660:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6653 00002000:00100000:1.0:1746143771.908667:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880130fd4380 x1830963594460544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.908675:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd4380 with x1830963594460544 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.908679:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd4380 00000100:00100000:0.0:1746143771.908728:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.908809:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594461312 00000100:00100000:3.0:1746143771.908815:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594461312 00010000:00010000:3.0:1746143771.908834:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 38 pid: 6929 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.908853:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7531 00000100:00100000:3.0:1746143771.908859:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594461312:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143771.908868:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143771.908880:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 38 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.908889:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 38 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.908907:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6347400/0xe984082ccd7315df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4005888->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8776 expref: 38 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.908919:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.908921:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143771.908926:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.908939:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.908963:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 16 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143771.908973:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594463232:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143771.909021:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.909865:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.910030:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594463232:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143771.910042:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143771.910071:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594461312:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1211us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.910077:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594461440 00000100:00100000:3.0:1746143771.910078:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7531 00000100:00100000:1.0:1746143771.910081:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594461440 00010000:00010000:1.0:1746143771.910230:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 37 pid: 12618 timeout: 950 lvb_type: 1 00000100:00100000:1.0:1746143771.910259:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7532 00000100:00100000:1.0:1746143771.910265:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1963:x1830963594461440:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.910271:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.910283:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 37 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.910292:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 37 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.910305:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091716400/0xe984082ccd731545 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a871b expref: 37 pid: 12618 timeout: 950 lvb_type: 1 00010000:00010000:1.0:1746143771.910327:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.910329:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.910332:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.910339:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.910356:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.910364:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594463360:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143771.910412:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.912624:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594463360:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143771.912640:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.912674:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1963:x1830963594461440:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2409us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.912681:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7532 00000100:00100000:0.0:1746143771.912841:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.913186:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594461696 00000100:00100000:1.0:1746143771.913191:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594461696 00002000:00100000:1.0:1746143771.913215:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1105920->1110015) req@ffff88009ff6ea00 x1830963594461696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.913224:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ea00 with x1830963594461696 ext(1105920->1110015) 00002000:00010000:1.0:1746143771.913228:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ea00 00000100:00100000:1.0:1746143771.913252:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6654 00000100:00100000:1.0:1746143771.913258:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594461696:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143771.913376:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594461696:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 118us (536us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143771.913382:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6654 00002000:00100000:1.0:1746143771.913387:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1105920->1110015) req@ffff88009ff6ea00 x1830963594461696/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/4536 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.913393:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ea00 with x1830963594461696 ext(1105920->1110015) 00002000:00010000:1.0:1746143771.913395:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ea00 00000100:00100000:0.0:1746143771.915011:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.915745:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.915757:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594462080 00000100:00100000:2.0:1746143771.915767:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594462080 00000100:00100000:0.0:1746143771.915769:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00002000:00100000:2.0:1746143771.915810:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6dc00 x1830963594462080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.915819:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6dc00 with x1830963594462080 ext(3145728->4194303) 00002000:00010000:2.0:1746143771.915824:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6dc00 00000100:00100000:0.0:1746143771.917295:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.917339:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594461952 00000100:00100000:1.0:1746143771.917350:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594461952 00000100:00100000:3.0:1746143771.917360:0:31339:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594462464 00000100:00100000:3.0:1746143771.917366:0:31339:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594462464 00000100:00100000:2.0:1746143771.917369:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6655 00000100:00100000:2.0:1746143771.917379:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594462080:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:3.0:1746143771.917389:0:31339:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009c3fa300 x1830963594462464/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.917393:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c3fa680 x1830963594461952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.917397:0:31339:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830963594462464 ext(3145728->4194303) 00002000:00010000:3.0:1746143771.917400:0:31339:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa300 00002000:00100000:1.0:1746143771.917402:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830963594461952 ext(2097152->3145727) 00002000:00010000:1.0:1746143771.917406:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:1.0:1746143771.917437:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6656 00000100:00100000:1.0:1746143771.917445:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594462464:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.917500:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594462720 00000100:00100000:3.0:1746143771.917503:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594462720 00002000:00100000:3.0:1746143771.917517:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6e680 x1830963594462720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 504/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.917524:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e680 with x1830963594462720 ext(1048576->2097151) 00002000:00010000:3.0:1746143771.917528:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6e680 00000100:00100000:3.0:1746143771.917538:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6657 00000100:00100000:3.0:1746143771.917543:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594461952:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143771.918660:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6658 00000100:00100000:2.0:1746143771.918668:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594462720:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:0.0:1746143771.926945:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.927009:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594462976 00000100:00100000:2.0:1746143771.927020:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594462976 00000100:00100000:2.0:1746143771.927076:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9332 00000100:00100000:2.0:1746143771.927083:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+14:31632:x1830963594462976:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143771.927109:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.927137:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ce00/0xe984082ccd7316b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87f4 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.927270:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927284:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927295:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927307:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927311:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927316:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927419:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d400/0xe984082ccd7316c6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927427:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d400/0xe984082ccd7316c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927432:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d400/0xe984082ccd7316c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143771.927440:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143771.927520:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927530:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927536:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927542:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594d000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.927545:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927551:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927561:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.927563:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.927567:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927571:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd7316b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927597:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927602:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927607:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927610:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594d200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.927612:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927625:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927631:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365de00) 00010000:00010000:2.0:1746143771.927633:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.927635:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927640:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd7316bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.927672:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ce00/0xe984082ccd7316b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87f4 expref: 17 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.927682:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d400/0xe984082ccd7316c6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87f4 expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.927688:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.927690:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143771.927692:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594d400, rc 0) 00000100:00100000:2.0:1746143771.927752:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31632:x1830963594462976:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 670us (818us total) trans 8589943687 rc 0/0 00000100:00100000:2.0:1746143771.927759:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9332 00000100:00100000:3.0:1746143771.928975:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594461952:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11426us (13227us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.928985:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6657 00002000:00100000:3.0:1746143771.928995:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88009c3fa680 x1830963594461952/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.929005:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa680 with x1830963594461952 ext(2097152->3145727) 00002000:00010000:3.0:1746143771.929010:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c3fa680 00000100:00100000:2.0:1746143771.931248:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594462720:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 12570us (13947us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746143771.931260:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6658 00002000:00100000:2.0:1746143771.931270:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009ca6e680 x1830963594462720/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 504/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.931285:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca6e680 with x1830963594462720 ext(1048576->2097151) 00002000:00010000:2.0:1746143771.931289:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca6e680 00000100:00100000:1.0:1746143771.936038:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594462464:12345-192.168.202.48@tcp:3:cat.0 Request processed in 18583us (20258us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.936052:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6656 00002000:00100000:1.0:1746143771.936063:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009c3fa300 x1830963594462464/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.936072:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c3fa300 with x1830963594462464 ext(3145728->4194303) 00002000:00010000:1.0:1746143771.936078:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c3fa300 00000100:00100000:0.0:1746143771.936556:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.936650:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594463232 00000100:00100000:1.0:1746143771.936659:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594463232 00000100:00100000:1.0:1746143771.936711:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4037 00000100:00100000:1.0:1746143771.936719:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+248:31630:x1830963594463232:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143771.937189:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31630:x1830963594463232:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 470us (633us total) trans 8589943688 rc 0/0 00000100:00100000:1.0:1746143771.937215:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4037 00000100:00100000:3.0:1746143771.938030:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594462080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20651us (23066us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.938041:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6655 00002000:00100000:3.0:1746143771.938050:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6dc00 x1830963594462080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.938060:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6dc00 with x1830963594462080 ext(3145728->4194303) 00002000:00010000:3.0:1746143771.938065:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6dc00 00000100:00100000:0.0:1746143771.939184:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.939237:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.939288:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594463360 00000100:00100000:1.0:1746143771.939299:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594463360 00000100:00100000:2.0:1746143771.939317:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594463616 00000100:00100000:2.0:1746143771.939324:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594463616 00000100:00100000:2.0:1746143771.939354:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4038 00000100:00100000:1.0:1746143771.939359:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 756 00000100:00100000:2.0:1746143771.939361:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31632:x1830963594463616:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:1.0:1746143771.939368:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1964:x1830963594463360:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.939381:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.939402:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d400/0xe984082ccd7316c6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87f4 expref: 17 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.939421:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143771.939424:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.939475:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1964:x1830963594463360:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.939480:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 756 00000100:00100000:2.0:1746143771.939846:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31632:x1830963594463616:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 484us (607us total) trans 8589943689 rc 0/0 00000100:00100000:2.0:1746143771.939853:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4038 00000100:00100000:0.0:1746143771.939971:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.940073:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594463744 00000100:00100000:3.0:1746143771.940111:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594463744 00000100:00100000:3.0:1746143771.940179:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14075 00000100:00100000:3.0:1746143771.940186:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+26:31625:x1830963594463744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143771.940198:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143771.940210:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a87fb expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.940235:0:25369:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.940242:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.940243:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143771.940246:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.940268:0:25369:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 19 pid: 6929 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.940279:0:25369:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 19 pid: 6929 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.940289:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594463488:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143771.940408:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.942880:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.942985:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:25369:1830963594463488:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.942990:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594463872 00000100:00100000:2.0:1746143771.942998:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594463872 00010000:00010000:3.0:1746143771.943014:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143771.943031:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b161c00, rc 0) 00002000:00100000:2.0:1746143771.943035:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1953792->2060287) req@ffff880090767480 x1830963594463872/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.943044:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767480 with x1830963594463872 ext(1953792->2060287) 00010000:00010000:2.0:1746143771.943051:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 20 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:2.0:1746143771.943065:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 20 pid: 6929 timeout: 950 lvb_type: 0 00000100:00100000:3.0:1746143771.943070:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31625:x1830963594463744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2884us (3098us total) trans 0 rc 0/0 00002000:00010000:2.0:1746143771.943071:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090767480 00000100:00100000:3.0:1746143771.943078:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14075 00000100:00100000:2.0:1746143771.943101:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1879 00000100:00100000:2.0:1746143771.943107:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594463872:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143771.946316:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.946357:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.946394:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.946423:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594464000 00000100:00100000:0.0:1746143771.946431:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594464000 00000100:00100000:0.0:1746143771.946460:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594464128 00000100:00100000:0.0:1746143771.946461:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594464128 00000100:00100000:1.0:1746143771.946467:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594464256 00000100:00100000:1.0:1746143771.946476:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594464256 00000100:00100000:0.0:1746143771.946476:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14076 00000100:00100000:0.0:1746143771.946482:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594464000:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.946496:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.946510:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8802 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.946511:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14077 00000100:00100000:1.0:1746143771.946519:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594464128:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143771.946532:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.946535:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.946537:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.946543:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd7316e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8809 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.946545:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143771.946590:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14078 00000100:00100000:1.0:1746143771.946593:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594463616:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143771.946598:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594464256:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.946606:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.946615:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a594d800/0xe984082ccd7316e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8810 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.946630:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 20 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143771.946642:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f0e8200, rc 0) 00000100:00100000:2.0:1746143771.946647:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594463744:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143771.946659:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.946670:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1962:x1830963594464000:12345-192.168.202.48@tcp:101:cat.0 Request processed in 188us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143771.946676:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14076 00000100:00100000:2.0:1746143771.946678:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143771.947112:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594463872:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4003us (4237us total) trans 21474840572 rc 0/0 00000100:00100000:3.0:1746143771.947123:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1879 00002000:00100000:3.0:1746143771.947165:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x353:0x0] (1953792->2060287) req@ffff880090767480 x1830963594463872/t21474840572(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/448 e 0 to 0 dl 1746143782 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.947175:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090767480 with x1830963594463872 ext(1953792->2060287) 00010000:00010000:3.0:1746143771.947183:0:31338:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 24 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:3.0:1746143771.947195:0:31338:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 24 pid: 6929 timeout: 950 lvb_type: 0 00002000:00010000:3.0:1746143771.947201:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090767480 00002000:00010000:1.0:1746143771.948273:0:12618:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143769 -> 1746143771 00000100:00100000:2.0:1746143771.948278:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594463744:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143771.948302:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a594d800/0xe984082ccd7316e9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8810 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.948311:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a594d800/0xe984082ccd7316e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8810 expref: 23 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.948340:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594d800, rc 0) 00000100:00100000:2.0:1746143771.948367:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594464256:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1771us (1972us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143771.948373:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14078 00000100:00100000:1.0:1746143771.948445:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594463616:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143771.948623:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd7316e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8809 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.948638:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd7316e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8809 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.948649:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e621800, rc 0) 00000100:00100000:1.0:1746143771.948693:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594464128:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2175us (2335us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.948700:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14077 00000100:00100000:0.0:1746143771.949558:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.949831:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594464384 00000100:00100000:1.0:1746143771.949836:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594464384 00010000:00010000:1.0:1746143771.949862:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 22 pid: 6929 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.949894:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7533 00000100:00100000:1.0:1746143771.949900:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594464384:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.949913:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.949929:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 22 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.949939:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 22 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.949958:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091716a00/0xe984082ccd7315b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2060287) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8768 expref: 22 pid: 6929 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.949972:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.949974:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.949981:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.949994:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.950019:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 26 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.950030:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594463872:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143771.950107:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.951607:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594463872:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143771.951625:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143771.951655:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1962:x1830963594464384:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1754us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.951662:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7533 00000100:00100000:0.0:1746143771.953828:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.953957:0:31338:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594464768 00000100:00100000:3.0:1746143771.953967:0:31338:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594464768 00000100:00100000:0.0:1746143771.953974:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.954024:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594464896 00000100:00100000:1.0:1746143771.954028:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594464896 00002000:00100000:3.0:1746143771.954068:0:31338:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880090765180 x1830963594464768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.954068:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012f184700 x1830963594464896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.954078:0:31338:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765180 with x1830963594464768 ext(4194304->4771839) 00002000:00100000:1.0:1746143771.954078:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184700 with x1830963594464896 ext(1048576->2097151) 00002000:00010000:3.0:1746143771.954084:0:31338:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090765180 00002000:00010000:1.0:1746143771.954084:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f184700 00000100:00100000:1.0:1746143771.954116:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6659 00000100:00100000:1.0:1746143771.954123:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594464896:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143771.954167:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6660 00000100:00100000:3.0:1746143771.954172:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594464768:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.960707:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594464768:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6521us (6875us total) trans 0 rc 577536/577536 00000100:00100000:3.0:1746143771.960720:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6660 00002000:00100000:3.0:1746143771.960734:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880090765180 x1830963594464768/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.960749:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090765180 with x1830963594464768 ext(4194304->4771839) 00002000:00010000:3.0:1746143771.960755:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090765180 00000100:00100000:1.0:1746143771.962032:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594464896:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 7905us (8053us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143771.962044:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6659 00002000:00100000:1.0:1746143771.962049:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88012f184700 x1830963594464896/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143771.962057:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f184700 with x1830963594464896 ext(1048576->2097151) 00002000:00010000:1.0:1746143771.962061:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f184700 00000100:00100000:0.0:1746143771.963456:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.963483:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143771.963505:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594465152 00000100:00100000:1.0:1746143771.963513:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594465152 00000100:00100000:1.0:1746143771.963556:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594465024 00000100:00100000:1.0:1746143771.963558:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594465024 00000100:00100000:2.0:1746143771.963575:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14079 00000100:00100000:1.0:1746143771.963590:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14080 00000100:00100000:2.0:1746143771.963591:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594465152:12345-192.168.202.48@tcp:101:cat.0 00000100:00100000:1.0:1746143771.963596:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594465024:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143771.963608:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143771.963608:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.963623:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a881e expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143771.963624:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e621e00/0xe984082ccd7316f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8817 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.963646:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.963648:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143771.963654:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.963666:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 22 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.963675:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594d400, rc 0) 00000100:00100000:1.0:1746143771.963675:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594464000:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143771.963737:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594465152:12345-192.168.202.48@tcp:101:cat.0 Request processed in 152us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.963743:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14079 00000100:00100000:1.0:1746143771.963763:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143771.965434:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12618:1830963594464000:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143771.965464:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e621e00/0xe984082ccd7316f7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8817 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.965476:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e621e00/0xe984082ccd7316f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8817 expref: 19 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.965501:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e621e00, rc 0) 00000100:00100000:1.0:1746143771.965549:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1963:x1830963594465024:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1951us (2062us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143771.965556:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14080 00000100:00100000:0.0:1746143771.968635:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.968667:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.968697:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.968716:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594465280 00000100:00100000:0.0:1746143771.968723:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594465280 00000100:00100000:0.0:1746143771.968752:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594465408 00000100:00100000:0.0:1746143771.968754:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594465408 00000100:00100000:1.0:1746143771.968765:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594465536 00000100:00100000:0.0:1746143771.968769:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14081 00000100:00100000:1.0:1746143771.968774:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594465536 00000100:00100000:0.0:1746143771.968775:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594465280:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.968796:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.968809:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8825 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.968821:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14082 00010000:00010000:0.0:1746143771.968827:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143771.968828:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1965:x1830963594465408:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.968828:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143771.968835:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.968843:0:12618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.968848:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 28 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143771.968855:0:12618:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a882c expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143771.968858:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a622c00, rc 0) 00010000:00010000:1.0:1746143771.968878:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.968880:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143771.968886:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 37 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143771.968894:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1964:x1830963594465280:12345-192.168.202.48@tcp:101:cat.0 Request processed in 119us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143771.968899:0:12618:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 37 pid: 12618 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143771.968900:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14081 00010000:00010000:1.0:1746143771.968908:0:12618:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e621800, rc 0) 00000100:00100000:0.0:1746143771.968916:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14083 00000100:00100000:0.0:1746143771.968921:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594465536:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143771.968928:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143771.968936:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a622e00/0xe984082ccd73170c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8833 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143771.968943:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094763100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963594465408:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.968949:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14082 00000100:00100000:0.0:1746143771.968971:0:25369:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594464128:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143771.969352:0:25369:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143771.971515:0:25369:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094760700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:25369:1830963594464128:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143771.971537:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a622e00/0xe984082ccd73170c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8833 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.971549:0:25369:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a622e00/0xe984082ccd73170c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8833 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143771.971571:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a622e00, rc 0) 00000100:00100000:2.0:1746143771.971678:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094762680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594465536:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2755us (2978us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143771.971685:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14083 00000100:00100000:0.0:1746143771.974418:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.974620:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594465792 00000100:00100000:2.0:1746143771.974627:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594465792 00000100:00100000:2.0:1746143771.974723:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4039 00000100:00100000:2.0:1746143771.974730:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31628:x1830963594465792:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143771.974961:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31628:x1830963594465792:12345-192.168.202.48@tcp:35:cat.0 Request processed in 230us (548us total) trans 8589943690 rc 0/0 00000100:00100000:2.0:1746143771.974968:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4039 00000100:00100000:0.0:1746143771.977069:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.977102:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.977124:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143771.977194:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143771.977238:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594466048 00000100:00100000:3.0:1746143771.977250:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594466048 00002000:00100000:3.0:1746143771.977297:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880136919c00 x1830963594466048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.977307:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919c00 with x1830963594466048 ext(2097152->3145727) 00002000:00010000:3.0:1746143771.977312:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136919c00 00000100:00100000:2.0:1746143771.977318:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594466176 00000100:00100000:2.0:1746143771.977323:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594466176 00000100:00100000:3.0:1746143771.977330:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594466560 00000100:00100000:3.0:1746143771.977333:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594466560 00002000:00100000:3.0:1746143771.977349:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88013691a300 x1830963594466560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.977351:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88013691a680 x1830963594466176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.977356:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691a300 with x1830963594466560 ext(2097152->3145727) 00002000:00010000:3.0:1746143771.977360:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013691a300 00002000:00100000:2.0:1746143771.977360:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691a680 with x1830963594466176 ext(3145728->4194303) 00002000:00010000:2.0:1746143771.977364:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691a680 00000100:00100000:2.0:1746143771.977378:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594466688 00000100:00100000:2.0:1746143771.977380:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594466688 00000100:00100000:3.0:1746143771.977384:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6661 00002000:00100000:2.0:1746143771.977390:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800930dd880 x1830963594466688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/0 e 0 to 0 dl 1746143782 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143771.977391:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594466048:12345-192.168.202.48@tcp:3:cat.0 00002000:00100000:2.0:1746143771.977397:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd880 with x1830963594466688 ext(3145728->4194303) 00002000:00010000:2.0:1746143771.977400:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dd880 00000100:00100000:2.0:1746143771.977410:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6662 00000100:00100000:2.0:1746143771.977415:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594466560:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143771.977564:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6663 00000100:00100000:1.0:1746143771.977571:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594466176:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143771.979632:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6664 00000100:00100000:3.0:1746143771.980029:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594466688:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143771.987270:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143771.987363:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594466944 00000100:00100000:2.0:1746143771.987371:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594466944 00000100:00100000:2.0:1746143771.987408:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9333 00000100:00100000:2.0:1746143771.987414:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:31635:x1830963594466944:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143771.987434:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143771.987448:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d800/0xe984082ccd731713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a883a expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.987498:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987509:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987518:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987528:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987534:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987538:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987635:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987642:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.987649:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.987674:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 16 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.987685:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 16 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:2.0:1746143771.987700:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594464256:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143771.987775:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143771.989472:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594466176:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11897us (12364us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143771.989480:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6663 00002000:00100000:0.0:1746143771.989489:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88013691a680 x1830963594466176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143771.989498:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691a680 with x1830963594466176 ext(3145728->4194303) 00002000:00010000:0.0:1746143771.989502:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013691a680 00000100:00100000:3.0:1746143771.994754:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594466048:12345-192.168.202.48@tcp:3:cat.0 Request processed in 17356us (17681us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.994763:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6661 00002000:00100000:3.0:1746143771.994773:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff880136919c00 x1830963594466048/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.994787:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136919c00 with x1830963594466048 ext(2097152->3145727) 00002000:00010000:3.0:1746143771.994792:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136919c00 00000100:00100000:3.0:1746143771.995027:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594464256:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143771.995031:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143771.995045:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:1.0:1746143771.995091:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594467072 00000100:00100000:1.0:1746143771.995097:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594467072 00010000:00010000:1.0:1746143771.995121:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 17 pid: 14762 timeout: 950 lvb_type: 0 00000100:00100000:1.0:1746143771.995189:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7534 00000100:00100000:1.0:1746143771.995196:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:1965:x1830963594467072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143771.995206:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143771.995212:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 17 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.995221:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 17 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.995240:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1c00/0xe984082ccd7314a4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86c7 expref: 17 pid: 14762 timeout: 950 lvb_type: 0 00010000:00010000:1.0:1746143771.995255:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143771.995259:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.995267:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.995272:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143771.995295:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143771.995314:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995322:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143771.995358:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:2.0:1746143771.995362:0:14762:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746143771.995375:0:14762:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995384:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995392:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995397:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995402:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995406:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594cc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.995410:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995415:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995426:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143771.995429:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.995431:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995436:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd73171a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995446:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995451:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995455:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995458:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594d600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143771.995460:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995464:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995469:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365d300) 00010000:00010000:2.0:1746143771.995471:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143771.995474:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995478:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d600/0xe984082ccd731721 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143771.995504:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d800/0xe984082ccd731713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.995514:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 7 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143771.995520:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143771.995522:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143771.995523:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594ca00, rc 0) 00000100:00100000:2.0:1746143771.995544:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31635:x1830963594466944:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 8131us (8282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143771.995550:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9333 00000100:00100000:1.0:1746143771.996651:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:1965:x1830963594467072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 122us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143771.996662:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7534 00000100:00100000:2.0:1746143771.997925:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594466560:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20506us (20797us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143771.997933:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6662 00002000:00100000:2.0:1746143771.997941:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88013691a300 x1830963594466560/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143771.997949:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013691a300 with x1830963594466560 ext(2097152->3145727) 00002000:00010000:2.0:1746143771.997954:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013691a300 00000100:00100000:3.0:1746143771.999655:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594466688:12345-192.168.202.48@tcp:3:cat.0 Request processed in 20009us (22454us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143771.999663:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6664 00002000:00100000:3.0:1746143771.999670:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff8800930dd880 x1830963594466688/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:167/0 lens 488/440 e 0 to 0 dl 1746143782 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143771.999677:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dd880 with x1830963594466688 ext(3145728->4194303) 00002000:00010000:3.0:1746143771.999681:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dd880 00000100:00100000:0.0:1746143772.005922:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.005955:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.005992:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.005994:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594467200 00000100:00100000:2.0:1746143772.006001:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594467200 00000100:00100000:1.0:1746143772.006018:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594467328 00000100:00100000:1.0:1746143772.006024:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594467328 00000100:00100000:0.0:1746143772.006034:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.006041:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594467456 00000100:00100000:2.0:1746143772.006043:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594467456 00000100:00100000:0.0:1746143772.006053:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00080000:3.0:1746143772.006111:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143772.006115:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143772.006234:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594467584 00000100:00100000:2.0:1746143772.006235:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594467712 00000100:00100000:1.0:1746143772.006237:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594467584 00000100:00100000:2.0:1746143772.006238:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594467712 00000100:00100000:3.0:1746143772.006243:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14084 00000100:00100000:0.0:1746143772.006250:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.006253:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14085 00000100:00100000:1.0:1746143772.006260:0:6929:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594467840 00000100:00100000:1.0:1746143772.006262:0:6929:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594467840 00000100:00100000:3.0:1746143772.006265:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14086 00000100:00100000:3.0:1746143772.006271:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594467456:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143772.006276:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14087 00000100:00100000:0.0:1746143772.006276:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.006281:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594467712:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143772.006286:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.006289:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.006299:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368a3000/0xe984082ccd731736 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a884f expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.006300:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a885d expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.006315:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594467328:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143772.006316:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.006318:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.006323:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.006325:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.006331:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8848 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.006339:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594464384:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143772.006339:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.006343:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.006344:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.006347:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b7400, rc 0) 00010000:00010000:2.0:1746143772.006349:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.006360:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.006367:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594d800, rc 0) 00000100:00100000:1.0:1746143772.006395:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594467712:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 112us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.006400:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594467328:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 140us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.006400:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14087 00000100:00100000:2.0:1746143772.006405:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14085 00000100:00100000:3.0:1746143772.006412:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.006414:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14088 00000100:00100000:2.0:1746143772.006417:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14089 00000100:00100000:1.0:1746143772.006419:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594467584:12345-192.168.202.48@tcp:101:mirror_io.0 00000100:00100000:2.0:1746143772.006422:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594467840:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143772.006425:0:6929:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.006427:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.006431:0:6929:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8856 expref: -99 pid: 6929 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.006432:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594468096 00010000:00010000:2.0:1746143772.006432:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8864 expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.006435:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594468096 00010000:00010000:2.0:1746143772.006443:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.006444:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.006448:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.006456:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 15 pid: 25369 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746143772.006460:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880130638a80 x1830963594468096/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.006468:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130638a80 with x1830963594468096 ext(4194304->4771839) 00010000:00010000:2.0:1746143772.006468:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594d600, rc 0) 00002000:00010000:3.0:1746143772.006471:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130638a80 00000100:00100000:2.0:1746143772.006480:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+15:1965:x1830963594467840:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 58us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.006483:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6665 00000100:00100000:2.0:1746143772.006485:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14089 00000100:00100000:3.0:1746143772.006488:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594468096:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:1.0:1746143772.006870:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.006872:0:6929:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.006876:0:6929:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.006885:0:6929:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 14 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.006892:0:6929:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b7600, rc 0) 00000100:00100000:1.0:1746143772.006975:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594467584:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 554us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.006980:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14088 00000100:00080000:3.0:1746143772.007098:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143772.007108:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594467200:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143772.007115:0:8495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.007122:0:8495:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8841 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.007164:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.007165:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.007171:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.007180:0:8495:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 14 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.007186:0:8495:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3600, rc 0) 00000100:00100000:3.0:1746143772.007211:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594467200:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 961us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.007216:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14084 00000100:00100000:3.0:1746143772.010414:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594464384:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143772.010443:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801368a3000/0xe984082ccd731736 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a884f expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.010455:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368a3000/0xe984082ccd731736 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a884f expref: 14 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.010464:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a3000, rc 0) 00000100:00100000:3.0:1746143772.010515:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594467456:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 4239us (4517us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.010523:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14086 00000100:00100000:2.0:1746143772.010628:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594468096:12345-192.168.202.48@tcp:3:cat.0 Request processed in 4139us (4350us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143772.010635:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6665 00002000:00100000:2.0:1746143772.010642:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff880130638a80 x1830963594468096/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.010649:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130638a80 with x1830963594468096 ext(4194304->4771839) 00002000:00010000:2.0:1746143772.010653:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130638a80 00000100:00100000:0.0:1746143772.012494:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.012650:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594468352 00000100:00100000:2.0:1746143772.012657:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594468352 00000100:00100000:2.0:1746143772.012785:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9334 00000100:00100000:2.0:1746143772.012791:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31635:x1830963594468352:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143772.012804:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.012816:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd731759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a886b expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.012889:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.012900:0:14762:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.012910:0:14762:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.012932:0:14762:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.012941:0:14762:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 8 pid: 14762 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.012950:0:14762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594464512:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.013013:0:14762:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a565f480 going to sleep for 11 seconds 00000100:00080000:3.0:1746143772.013048:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143772.015857:0:14762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14762:1830963594464512:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.015878:0:14762:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000100:00100000:0.0:1746143772.019540:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.019637:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.019718:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594468480 00000100:00100000:1.0:1746143772.019726:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594468480 00010000:00010000:1.0:1746143772.019758:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 9 pid: 14762 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.019867:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7535 00000100:00100000:1.0:1746143772.019876:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+9:1965:x1830963594468480:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.019888:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.019893:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 9 pid: 14762 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.019904:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 9 pid: 14762 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.019927:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ca00/0xe984082ccd731728 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a883a expref: 9 pid: 14762 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.019943:0:9890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143772.019947:0:9890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143772.019955:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143772.019961:0:9890:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14762 initiator: MDT0 00010000:00010000:1.0:1746143772.019979:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.020012:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1965:x1830963594468480:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 138us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.020019:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7535 00000100:00100000:2.0:1746143772.020482:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594468736 00000100:00100000:2.0:1746143772.020486:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594468736 00000100:00100000:2.0:1746143772.020531:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4040 00000100:00100000:2.0:1746143772.020536:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+249:31625:x1830963594468736:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143772.020696:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31625:x1830963594468736:12345-192.168.202.48@tcp:35:cat.0 Request processed in 155us (1054us total) trans 8589943691 rc 0/0 00000100:00100000:2.0:1746143772.020702:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4040 00010000:00010000:2.0:1746143772.020717:0:14762:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.020724:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143772.020741:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143772.020799:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd731759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a886b expref: 9 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.020810:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a886b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.020817:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.020819:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143772.020821:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594c600, rc 0) 00000100:00100000:2.0:1746143772.020838:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31635:x1830963594468352:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 8047us (8348us total) trans 8589943692 rc 0/0 00000100:00100000:2.0:1746143772.020843:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9334 00000100:00080000:3.0:1746143772.020910:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143772.022927:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.023002:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594468992 00000100:00100000:2.0:1746143772.023007:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594468992 00000100:00100000:2.0:1746143772.023046:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9335 00000100:00100000:2.0:1746143772.023052:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31635:x1830963594468992:12345-192.168.202.48@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143772.023065:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.023068:0:14762:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143772.023083:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd731760 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a886b expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.023093:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.023097:0:14762:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143772.023104:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73176e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8872 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.023215:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023224:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023231:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023240:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023245:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023250:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023255:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594c800 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143772.023258:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023264:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023270:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.023272:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143772.023274:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023278:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd731775 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.023300:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73176e lrc: 1/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8872 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.023306:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73176e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8872 expref: 8 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.023313:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594da00, rc 0) 00000100:00100000:2.0:1746143772.023352:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31635:x1830963594468992:12345-192.168.202.48@tcp:101:mirror_io.0 Request processed in 299us (427us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143772.023357:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9335 00000100:00100000:0.0:1746143772.026726:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.026820:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594469248 00000100:00100000:2.0:1746143772.026826:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594469248 00000100:00100000:2.0:1746143772.026859:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4041 00000100:00100000:2.0:1746143772.026865:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+7:31635:x1830963594469248:12345-192.168.202.48@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143772.027045:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:31635:x1830963594469248:12345-192.168.202.48@tcp:35:mirror_io.0 Request processed in 179us (324us total) trans 8589943693 rc 0/0 00000100:00100000:2.0:1746143772.027052:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4041 00000100:00100000:0.0:1746143772.035002:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.035102:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594469376 00000100:00100000:3.0:1746143772.035111:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594469376 00000100:00100000:3.0:1746143772.035221:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14090 00000100:00100000:3.0:1746143772.035231:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31632:x1830963594469376:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.035247:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746143772.035332:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746143772.035361:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8879 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.035390:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.035398:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.035409:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.035415:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.035417:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.035420:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.035445:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 23 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.035456:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 23 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.035466:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594464640:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143772.035662:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 13 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.035670:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 13 pid: 8495 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.035676:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594464768:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143772.035698:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 27 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.035710:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 27 pid: 25369 timeout: 951 lvb_type: 0 00000100:00100000:3.0:1746143772.035717:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594464896:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143772.035734:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.037813:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.037863:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.037934:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594464640:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143772.037946:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594464768:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143772.037954:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594464896:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143772.037986:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [868352->1048575] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.038000:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368a2c00, rc 0) 00000100:00100000:2.0:1746143772.038022:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594469504 00000100:00100000:2.0:1746143772.038029:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594469504 00000100:00100000:3.0:1746143772.038042:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31632:x1830963594469376:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2813us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.038053:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14090 00010000:00010000:2.0:1746143772.038062:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 24 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.038086:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594469632 00000100:00100000:2.0:1746143772.038088:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594469632 00010000:00010000:2.0:1746143772.038097:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 14 pid: 8495 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.038101:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7536 00000100:00100000:3.0:1746143772.038112:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594469504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143772.038118:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7537 00000100:00100000:2.0:1746143772.038123:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+14:1965:x1830963594469632:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143772.038134:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.038175:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143772.038182:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 23 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.038193:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 14 pid: 8495 timeout: 951 lvb_type: 1 00010000:00010000:3.0:1746143772.038195:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 23 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.038204:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 14 pid: 8495 timeout: 951 lvb_type: 1 00010000:00010000:3.0:1746143772.038568:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e33200/0xe984082ccd73165d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87bc expref: 23 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:3.0:1746143772.038585:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.038604:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.038610:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5971050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594469504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 500us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.038616:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7536 00000100:00100000:3.0:1746143772.038698:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594469760 00000100:00100000:3.0:1746143772.038703:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594469760 00010000:00010000:3.0:1746143772.038716:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.038746:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a3600/0xe984082ccd731752 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8841 expref: 14 pid: 8495 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.038749:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7538 00000100:00100000:3.0:1746143772.038754:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963594469760:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143772.038761:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.038764:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143772.038769:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.038778:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.038789:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091716800/0xe984082ccd731656 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87b5 expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.038796:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594469632:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 672us (932us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143772.038798:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.038800:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143772.038802:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7537 00010000:00010000:3.0:1746143772.038806:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.038815:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.039005:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.039015:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594465024:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143772.039079:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.040565:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594465024:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143772.040577:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143772.040609:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594469760:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1854us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.040623:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7538 00000100:00100000:0.0:1746143772.040690:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.040788:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470016 00000100:00100000:2.0:1746143772.040794:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470016 00002000:00100000:2.0:1746143772.040833:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (868352->872447) req@ffff88013063aa00 x1830963594470016/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.040843:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013063aa00 with x1830963594470016 ext(868352->872447) 00002000:00010000:2.0:1746143772.040847:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013063aa00 00000100:00100000:2.0:1746143772.040867:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6666 00000100:00100000:2.0:1746143772.040873:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594470016:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143772.041043:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1965:x1830963594470016:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 170us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.041049:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6666 00002000:00100000:2.0:1746143772.041055:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x351:0x0] (868352->872447) req@ffff88013063aa00 x1830963594470016/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.041061:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013063aa00 with x1830963594470016 ext(868352->872447) 00002000:00010000:2.0:1746143772.041064:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013063aa00 00000100:00100000:0.0:1746143772.043364:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.043469:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470144 00000100:00100000:3.0:1746143772.043476:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470144 00000100:00100000:3.0:1746143772.043532:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14091 00000100:00100000:3.0:1746143772.043539:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31632:x1830963594470144:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:3.0:1746143772.043554:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.043567:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8880 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.043592:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.043604:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.043610:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.043614:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.043616:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.043619:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.043643:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 19 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.043655:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 19 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.043672:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465152:192.168.202.48@tcp:104: 00000100:00080000:0.0:1746143772.043686:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746143772.043749:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 12 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.043756:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 12 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.043764:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465280:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143772.043787:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 36 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.044042:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 36 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:3.0:1746143772.044051:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465408:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143772.044072:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.044790:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465152:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143772.044797:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465280:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143772.045018:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.045070:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.045181:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470272 00000100:00100000:3.0:1746143772.045185:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470272 00000100:00100000:2.0:1746143772.045188:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470400 00000100:00100000:2.0:1746143772.045196:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470400 00010000:00010000:3.0:1746143772.045202:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 20 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.045228:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 13 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.045231:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7539 00000100:00100000:3.0:1746143772.045237:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1965:x1830963594470272:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143772.045245:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143772.045259:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7540 00010000:00010000:3.0:1746143772.045263:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 20 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.045266:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1965:x1830963594470400:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143772.045272:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 20 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.045278:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143772.045287:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f0e8200/0xe984082ccd7316db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8802 expref: 20 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.045296:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 13 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:3.0:1746143772.045303:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143772.045307:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 13 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.045322:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594470272:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 85us (305us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143772.045324:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a594d800/0xe984082ccd73173d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8848 expref: 13 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.045328:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7539 00010000:00010000:2.0:1746143772.045344:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.045380:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594470400:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 115us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.045386:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7540 00000100:00100000:3.0:1746143772.045858:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465408:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143772.045879:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.045889:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b1a00, rc 0) 00000100:00100000:3.0:1746143772.045908:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31632:x1830963594470144:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2370us (2551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.045914:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14091 00000100:00100000:0.0:1746143772.046483:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.047226:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470528 00000100:00100000:1.0:1746143772.047232:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470528 00010000:00010000:1.0:1746143772.047259:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 37 pid: 12618 timeout: 951 lvb_type: 0 00000100:00080000:0.0:1746143772.047325:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143772.047426:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7541 00000100:00100000:1.0:1746143772.047432:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1964:x1830963594470528:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.047442:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.047457:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 37 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.047471:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 37 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.047486:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131267000/0xe984082ccd731679 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d8 expref: 37 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.047507:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.047509:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.047515:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.047522:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.047546:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.047556:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594465536:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.047614:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.048826:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594465536:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.048837:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.048854:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594470528:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1423us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.048866:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7541 00000100:00100000:0.0:1746143772.053415:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.053853:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470784 00000100:00100000:2.0:1746143772.053864:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470784 00002000:00100000:2.0:1746143772.053915:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1654784->1658879) req@ffff88013063bb80 x1830963594470784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.053925:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013063bb80 with x1830963594470784 ext(1654784->1658879) 00002000:00010000:2.0:1746143772.053931:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013063bb80 00000100:00100000:2.0:1746143772.053962:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6667 00000100:00100000:2.0:1746143772.053970:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013063bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594470784:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143772.054221:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013063bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594470784:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 252us (817us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.054228:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6667 00002000:00100000:2.0:1746143772.054233:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1654784->1658879) req@ffff88013063bb80 x1830963594470784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.054240:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013063bb80 with x1830963594470784 ext(1654784->1658879) 00002000:00010000:2.0:1746143772.054243:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013063bb80 00000100:00100000:0.0:1746143772.056476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.056635:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471040 00000100:00100000:2.0:1746143772.056645:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471040 00000100:00080000:0.0:1746143772.056848:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143772.056958:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4042 00000100:00100000:2.0:1746143772.056967:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+16:31632:x1830963594471040:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143772.057262:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31632:x1830963594471040:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 295us (794us total) trans 8589943694 rc 0/0 00000100:00100000:2.0:1746143772.057269:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4042 00000100:00100000:0.0:1746143772.079270:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.079371:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471168 00000100:00100000:2.0:1746143772.079382:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471168 00002000:00100000:2.0:1746143772.079431:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1105920->1200127) req@ffff880090766300 x1830963594471168/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.079441:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766300 with x1830963594471168 ext(1105920->1200127) 00002000:00010000:2.0:1746143772.079447:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766300 00000100:00100000:2.0:1746143772.079482:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6668 00000100:00100000:2.0:1746143772.079489:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+36:1964:x1830963594471168:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143772.084236:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594471168:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4737us (4966us total) trans 17179873244 rc 0/0 00000100:00100000:2.0:1746143772.084249:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6668 00002000:00100000:2.0:1746143772.084260:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1105920->1200127) req@ffff880090766300 x1830963594471168/t17179873244(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.084269:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090766300 with x1830963594471168 ext(1105920->1200127) 00002000:00010000:2.0:1746143772.084275:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090766300 00000100:00100000:0.0:1746143772.093613:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.093714:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471424 00000100:00100000:2.0:1746143772.093725:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471424 00000100:00100000:2.0:1746143772.093773:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9336 00000100:00100000:2.0:1746143772.093781:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+17:31642:x1830963594471424:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143772.093806:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.093825:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d800/0xe984082ccd73178a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8887 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.093933:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.093950:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.093960:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.093972:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.093977:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.093981:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094085:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094093:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094098:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143772.094105:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143772.094252:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094259:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094264:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094272:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594d200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143772.094276:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094282:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094294:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143772.094297:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.094301:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094306:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d200/0xe984082ccd731791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094338:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094343:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094346:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094350:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594cc00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143772.094352:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094356:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094361:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365d900) 00010000:00010000:2.0:1746143772.094362:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.094365:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094368:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594cc00/0xe984082ccd731798 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.094401:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d800/0xe984082ccd73178a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 20 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.094410:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 19 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.094416:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.094417:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143772.094419:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594da00, rc 0) 00000100:00100000:2.0:1746143772.094463:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31642:x1830963594471424:12345-192.168.202.48@tcp:101:cat.0 Request processed in 683us (862us total) trans 8589943695 rc 0/0 00000100:00100000:2.0:1746143772.094469:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9336 00000100:00100000:0.0:1746143772.098283:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.098470:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471552 00000100:00100000:3.0:1746143772.098480:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471552 00000100:00100000:3.0:1746143772.098927:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14092 00000100:00100000:3.0:1746143772.098935:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594471552:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143772.098949:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.098963:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930b1e00/0xe984082ccd7317ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a888e expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.099007:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465664:192.168.202.48@tcp:106: 00000100:00100000:3.0:1746143772.099097:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.100444:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465664:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143772.100467:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930b1e00/0xe984082ccd7317ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a888e expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.100479:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1e00/0xe984082ccd7317ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a888e expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.100854:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b1e00, rc 0) 00000100:00100000:3.0:1746143772.100900:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1965:x1830963594471552:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1964us (2627us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.100907:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14092 00000100:00100000:0.0:1746143772.105675:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.106203:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.106320:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471936 00000100:00100000:3.0:1746143772.106328:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471936 00002000:00100000:3.0:1746143772.106364:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (0->868351) req@ffff880130fd7800 x1830963594471936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.106374:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7800 with x1830963594471936 ext(0->868351) 00002000:00010000:3.0:1746143772.106379:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd7800 00000100:00100000:3.0:1746143772.106391:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472064 00000100:00100000:3.0:1746143772.106393:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472064 00002000:00100000:3.0:1746143772.106401:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x356:0x0] (1658880->2097151) req@ffff880130fd6d80 x1830963594472064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.106408:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6d80 with x1830963594472064 ext(1658880->2097151) 00002000:00010000:3.0:1746143772.106411:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6d80 00000100:00100000:3.0:1746143772.106422:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6669 00000100:00100000:3.0:1746143772.106428:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594471936:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.106726:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6670 00000100:00100000:2.0:1746143772.106734:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594472064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.113202:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594472064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 6462us (6992us total) trans 0 rc 438272/438272 00000100:00100000:2.0:1746143772.113211:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6670 00002000:00100000:2.0:1746143772.113220:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x356:0x0] (1658880->2097151) req@ffff880130fd6d80 x1830963594472064/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 438272/438272 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.113229:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd6d80 with x1830963594472064 ext(1658880->2097151) 00002000:00010000:2.0:1746143772.113234:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130fd6d80 00000100:00100000:3.0:1746143772.114107:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1962:x1830963594471936:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7677us (8437us total) trans 0 rc 868352/868352 00000100:00100000:3.0:1746143772.114115:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6669 00002000:00100000:3.0:1746143772.114121:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (0->868351) req@ffff880130fd7800 x1830963594471936/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.114162:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130fd7800 with x1830963594471936 ext(0->868351) 00002000:00010000:3.0:1746143772.114165:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130fd7800 00000100:00100000:0.0:1746143772.122936:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.123070:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472192 00000100:00100000:3.0:1746143772.123079:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472192 00000100:00100000:3.0:1746143772.123133:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14093 00000100:00100000:3.0:1746143772.123248:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:31642:x1830963594472192:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143772.123263:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.123277:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8895 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.123301:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 37 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.123308:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.123309:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.123313:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.123336:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 37 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.123346:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 37 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:3.0:1746143772.123357:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465792:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143772.123748:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.126465:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594465792:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143772.126488:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.126504:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b0e00, rc 0) 00000100:00100000:3.0:1746143772.126534:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136b9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31642:x1830963594472192:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3394us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.126541:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14093 00000100:00100000:0.0:1746143772.128609:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.128674:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472320 00000100:00100000:1.0:1746143772.128680:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472320 00010000:00010000:1.0:1746143772.128715:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 38 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.128746:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7542 00000100:00100000:1.0:1746143772.128752:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594472320:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.128763:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.128779:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 38 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.128790:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 38 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.128806:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c2da600/0xe984082ccd7316a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1105920->1200127) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87e6 expref: 38 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.128830:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.128832:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.128838:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.128849:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.128874:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.128884:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594465920:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.128955:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.131433:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594465920:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.131452:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.131495:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+37:1965:x1830963594472320:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2741us (2890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.131505:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7542 00000100:00100000:0.0:1746143772.135003:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.135045:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.135116:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472576 00000100:00100000:3.0:1746143772.135132:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472576 00000100:00100000:2.0:1746143772.135160:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472832 00000100:00100000:2.0:1746143772.135164:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472832 00002000:00100000:3.0:1746143772.135192:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800930dea00 x1830963594472576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.135192:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009445b100 x1830963594472832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.135201:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dea00 with x1830963594472576 ext(1048576->2097151) 00002000:00100000:2.0:1746143772.135201:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b100 with x1830963594472832 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.135205:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dea00 00002000:00010000:2.0:1746143772.135205:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b100 00000100:00100000:2.0:1746143772.135235:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6671 00000100:00100000:2.0:1746143772.135241:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594472832:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143772.135296:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6672 00000100:00100000:3.0:1746143772.135301:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594472576:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143772.143900:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594472832:12345-192.168.202.48@tcp:3:cat.0 Request processed in 8649us (8844us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.143911:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6671 00002000:00100000:3.0:1746143772.143922:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff88009445b100 x1830963594472832/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.143931:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009445b100 with x1830963594472832 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.143936:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009445b100 00000100:00100000:3.0:1746143772.147713:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1965:x1830963594472576:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12403us (12710us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.147724:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6672 00002000:00100000:3.0:1746143772.147733:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800930dea00 x1830963594472576/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.147742:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800930dea00 with x1830963594472576 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.147747:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800930dea00 00000100:00100000:0.0:1746143772.160627:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.161724:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473088 00000100:00100000:2.0:1746143772.161734:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473088 00000100:00100000:2.0:1746143772.161938:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4043 00000100:00100000:2.0:1746143772.161945:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:31642:x1830963594473088:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:2.0:1746143772.162219:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31642:x1830963594473088:12345-192.168.202.48@tcp:35:cat.0 Request processed in 275us (1598us total) trans 8589943696 rc 0/0 00000100:00100000:2.0:1746143772.162225:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4043 00000100:00100000:0.0:1746143772.166509:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.167271:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473344 00000100:00100000:2.0:1746143772.167278:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473344 00000100:00100000:2.0:1746143772.167316:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9337 00000100:00100000:2.0:1746143772.167322:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+250:31644:x1830963594473344:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143772.167341:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.167355:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c200/0xe984082ccd7317bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a889c expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.167446:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167457:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167466:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167475:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167480:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167485:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167569:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167577:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167582:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143772.167590:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143772.167659:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167665:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167670:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167675:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594c400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143772.167678:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167685:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167693:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143772.167696:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.167699:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167704:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c400/0xe984082ccd7317c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167733:0:2976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167738:0:2976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167743:0:2976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167747:0:2976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a594c000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143772.167749:0:2976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167753:0:2976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167759:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009365d300) 00010000:00010000:2.0:1746143772.167761:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143772.167763:0:2976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167767:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c000/0xe984082ccd7317c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.167795:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c200/0xe984082ccd7317bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 253 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.167804:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 252 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.167810:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.167812:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143772.167814:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594de00, rc 0) 00000100:00100000:2.0:1746143772.167850:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31644:x1830963594473344:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 528us (1348us total) trans 8589943697 rc 0/0 00000100:00100000:2.0:1746143772.167856:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9337 00000100:00100000:0.0:1746143772.242529:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.243718:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473600 00000100:00100000:2.0:1746143772.243726:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473600 00000100:00100000:2.0:1746143772.243767:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9338 00000100:00100000:2.0:1746143772.243773:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+252:31648:x1830963594473600:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143772.243793:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.243807:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd7317de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88a3 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.243888:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd7317e5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.243900:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd7317e5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.243909:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd7317e5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00000004:00200000:2.0:1746143772.243922:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143772.244020:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c600/0xe984082ccd7317de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88a3 expref: 255 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.244039:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd7317e5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88a3 expref: 254 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.244046:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.244049:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143772.244051:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594c800, rc 0) 00000100:00100000:2.0:1746143772.244091:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31648:x1830963594473600:12345-192.168.202.48@tcp:101:cat.0 Request processed in 318us (1568us total) trans 8589943698 rc 0/0 00000100:00100000:2.0:1746143772.244097:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9338 00000100:00100000:0.0:1746143772.246673:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.246763:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473728 00000100:00100000:3.0:1746143772.246770:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473728 00000100:00100000:3.0:1746143772.246852:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14094 00000100:00100000:3.0:1746143772.246859:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594473728:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143772.246872:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.246884:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800930b1600/0xe984082ccd7317f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88aa expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.246922:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594466048:192.168.202.48@tcp:106: 00000100:00100000:0.0:1746143772.248450:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.248544:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.248611:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473856 00000100:00100000:1.0:1746143772.248615:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473856 00000100:00100000:1.0:1746143772.248641:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473984 00000100:00100000:1.0:1746143772.248642:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473984 00000100:00100000:1.0:1746143772.248655:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14095 00000100:00100000:1.0:1746143772.248660:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594473856:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.248669:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.248680:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6e00/0xe984082ccd7317fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88b1 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.248714:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594466176:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143772.248758:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14096 00000100:00100000:1.0:1746143772.248763:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1963:x1830963594473984:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.248769:0:8496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.248775:0:8496:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88b8 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.248785:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.248787:0:8496:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.248795:0:8496:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 40 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.248811:0:8496:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 40 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.248820:0:8496:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b6600, rc 0) 00000100:00100000:1.0:1746143772.248838:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1963:x1830963594473984:12345-192.168.202.48@tcp:101:cat.0 Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.248844:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14096 00000100:00100000:3.0:1746143772.249450:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.249571:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.255290:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594466048:192.168.202.48@tcp:106: 00010000:00010000:3.0:1746143772.255321:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800930b1600/0xe984082ccd7317f3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88aa expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.255333:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800930b1600/0xe984082ccd7317f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88aa expref: 28 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143772.255362:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b1600, rc 0) 00000100:00100000:3.0:1746143772.255406:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1963:x1830963594473728:12345-192.168.202.48@tcp:101:cat.0 Request processed in 8547us (8739us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143772.255413:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14094 00000100:00100000:1.0:1746143772.255590:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594466176:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143772.255605:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6e00/0xe984082ccd7317fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b1 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.255613:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6e00/0xe984082ccd7317fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b1 expref: 39 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.255622:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b6e00, rc 0) 00000100:00100000:1.0:1746143772.255650:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1963:x1830963594473856:12345-192.168.202.48@tcp:101:cat.0 Request processed in 6990us (7205us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.255655:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14095 00000100:00100000:0.0:1746143772.258917:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.259000:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474112 00000100:00100000:1.0:1746143772.259007:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474112 00000100:00100000:1.0:1746143772.259056:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14097 00000100:00100000:1.0:1746143772.259063:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31648:x1830963594474112:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.259078:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.259092:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88bf expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.259118:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.259135:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.259136:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.259163:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.259189:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.259200:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 21 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.259210:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594466304:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143772.259287:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.263490:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.264317:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594466304:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143772.264341:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 28 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.264356:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b6a00, rc 0) 00000100:00100000:1.0:1746143772.264693:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31648:x1830963594474112:12345-192.168.202.48@tcp:101:cat.0 Request processed in 5629us (5781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.264700:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14097 00000100:00100000:3.0:1746143772.265902:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474240 00000100:00100000:3.0:1746143772.265909:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474240 00002000:00100000:3.0:1746143772.265946:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (868352->1048575) req@ffff88009bfe1180 x1830963594474240/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.265955:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830963594474240 ext(868352->1048575) 00010000:00010000:3.0:1746143772.265962:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 22 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.265978:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 22 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.265984:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe1180 00000100:00100000:1.0:1746143772.266646:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.266716:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474368 00000100:00100000:0.0:1746143772.266720:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474368 00000100:00100000:0.0:1746143772.266744:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14098 00000100:00100000:0.0:1746143772.266750:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:31644:x1830963594474368:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143772.266762:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.266774:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88c6 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.266795:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.266801:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 39 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.266807:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.266808:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.266811:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1093632->1855487] (req 1093632->1855487) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.266832:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 39 pid: 8496 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143772.266846:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 39 pid: 8496 timeout: 951 lvb_type: 1 00000100:00100000:0.0:1746143772.266856:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594466432:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143772.266930:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.266938:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 18 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:0.0:1746143772.266946:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594466560:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143772.266964:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.267234:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1880 00000100:00100000:3.0:1746143772.267242:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594474240:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:0.0:1746143772.274679:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594466432:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143772.274690:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594466560:192.168.202.48@tcp:104: 00010000:00010000:0.0:1746143772.274715:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [1093632->1855487] (req 1093632->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.274729:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c687c00, rc 0) 00000100:00100000:0.0:1746143772.274763:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:31644:x1830963594474368:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 8012us (8118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.274769:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14098 00000100:00100000:3.0:1746143772.276103:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1964:x1830963594474240:12345-192.168.202.48@tcp:4:cat.0 Request processed in 8858us (12616us total) trans 21474840573 rc 0/0 00000100:00100000:3.0:1746143772.276112:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1880 00002000:00100000:3.0:1746143772.276130:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (868352->1048575) req@ffff88009bfe1180 x1830963594474240/t21474840573(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.276154:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bfe1180 with x1830963594474240 ext(868352->1048575) 00010000:00010000:3.0:1746143772.276162:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 24 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.276178:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 24 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.276184:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bfe1180 00000100:00100000:0.0:1746143772.276695:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.276761:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.276964:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474496 00000100:00100000:1.0:1746143772.276969:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474496 00010000:00010000:1.0:1746143772.276991:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 39 pid: 8496 timeout: 951 lvb_type: 1 00000100:00100000:1.0:1746143772.277019:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474624 00000100:00100000:1.0:1746143772.277022:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474624 00010000:00010000:1.0:1746143772.277030:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 19 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.277042:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7543 00000100:00100000:1.0:1746143772.277047:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1965:x1830963594474496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.277057:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.277072:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 39 pid: 8496 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.277081:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 39 pid: 8496 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.277097:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6600/0xe984082ccd731801 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88b8 expref: 39 pid: 8496 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.277129:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.277165:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594474496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 117us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.277171:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7543 00000100:00100000:1.0:1746143772.277204:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7544 00000100:00100000:1.0:1746143772.277209:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+19:1964:x1830963594474624:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.277215:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.277222:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 19 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.277229:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 19 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.277239:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd7317b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8895 expref: 19 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.277247:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.277249:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.277254:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.277262:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.277282:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 37 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.277292:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594466688:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.277332:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.282855:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.283074:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474880 00000100:00100000:3.0:1746143772.283081:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474880 00002000:00100000:3.0:1746143772.283288:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1093632->1097727) req@ffff88008efaf800 x1830963594474880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.283297:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaf800 with x1830963594474880 ext(1093632->1097727) 00002000:00010000:3.0:1746143772.283301:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaf800 00000100:00100000:3.0:1746143772.283704:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6673 00000100:00100000:3.0:1746143772.283712:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594474880:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:1.0:1746143772.283948:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594466688:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.283969:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.284020:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594474624:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 6810us (7258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.284028:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7544 00000100:00100000:3.0:1746143772.284481:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1964:x1830963594474880:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 769us (1632us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143772.284487:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6673 00002000:00100000:3.0:1746143772.284493:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1093632->1097727) req@ffff88008efaf800 x1830963594474880/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.284500:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaf800 with x1830963594474880 ext(1093632->1097727) 00002000:00010000:3.0:1746143772.284503:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaf800 00000100:00100000:0.0:1746143772.284835:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.285135:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594475008 00000100:00100000:1.0:1746143772.285157:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594475008 00010000:00010000:1.0:1746143772.285178:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 24 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.285203:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7545 00000100:00100000:1.0:1746143772.285208:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594475008:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.285217:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.285230:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 24 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.285239:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 24 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.285255:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801368a2c00/0xe984082ccd73177c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 868352->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8879 expref: 24 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.285265:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.285266:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.285272:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.285279:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.285304:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 27 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.285314:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594466816:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.285356:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.290639:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.290809:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.291080:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594475264 00000100:00100000:2.0:1746143772.291088:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594475264 00000100:00100000:3.0:1746143772.291112:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594475520 00000100:00100000:3.0:1746143772.291116:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594475520 00000100:00100000:2.0:1746143772.291156:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9339 00000100:00100000:2.0:1746143772.291164:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31651:x1830963594475264:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:3.0:1746143772.291170:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9340 00000100:00100000:3.0:1746143772.291176:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31653:x1830963594475520:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143772.291182:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.291186:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.291196:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1200/0xe984082ccd731816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88d4 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.291196:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ce00/0xe984082ccd73181d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88cd expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.291275:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0400/0xe984082ccd73182b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.291275:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143772.291287:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0400/0xe984082ccd73182b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:3.0:1746143772.291295:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0400/0xe984082ccd73182b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143772.291298:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 23 pid: 14762 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746143772.291303:0:14762:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143772.291304:0:2976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 253 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.291309:0:2976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.291335:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 253 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.291344:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 253 pid: 2976 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.291354:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594466944:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143772.291395:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b1200/0xe984082ccd731816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88d4 expref: 25 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.291410:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0400/0xe984082ccd73182b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88d4 expref: 24 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.291417:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143772.291419:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746143772.291421:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143772.291427:0:14762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:3.0:1746143772.291431:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b0400, rc 0) 00010000:00010000:2.0:1746143772.291444:0:2976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 24 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.291451:0:2976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 24 pid: 14762 timeout: 951 lvb_type: 0 00000100:00100000:3.0:1746143772.291455:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31653:x1830963594475520:12345-192.168.202.48@tcp:101:cat.0 Request processed in 279us (647us total) trans 8589943699 rc 0/0 00000100:00100000:2.0:1746143772.291459:0:2976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594467072:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143772.291464:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9340 00000100:00100000:2.0:1746143772.291477:0:2976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.293884:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594466816:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.293902:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.293953:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1965:x1830963594475008:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 8743us (9118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.293962:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7545 00000100:00100000:0.0:1746143772.295712:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.295774:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.295808:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594466944:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.295817:0:2976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:2976:1830963594467072:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.295833:0:2976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000100:00100000:0.0:1746143772.295842:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.295867:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594475904 00000100:00100000:2.0:1746143772.295871:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594475904 00010000:00010000:2.0:1746143772.295895:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 254 pid: 2976 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.295914:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476032 00000100:00100000:2.0:1746143772.295916:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476032 00010000:00010000:2.0:1746143772.295924:0:7151:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 24 pid: 14762 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.295939:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7546 00000100:00100000:2.0:1746143772.295944:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:1963:x1830963594475904:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.295954:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.295958:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 254 pid: 2976 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.295965:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 254 pid: 2976 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.295983:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594de00/0xe984082ccd7317d0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a889c expref: 254 pid: 2976 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.295999:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.296003:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.296010:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.296014:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.296039:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:1963:x1830963594475904:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.296045:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7546 00000100:00100000:2.0:1746143772.296056:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7547 00000100:00100000:2.0:1746143772.296060:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594476032:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.296065:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143772.296066:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594475776 00000100:00100000:3.0:1746143772.296069:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594475776 00010000:00010000:2.0:1746143772.296069:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 24 pid: 14762 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.296076:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 24 pid: 14762 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.296085:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594da00/0xe984082ccd73179f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8887 expref: 24 pid: 14762 timeout: 951 lvb_type: 0 00002000:00100000:3.0:1746143772.296092:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88008eface00 x1830963594475776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746143772.296092:0:7151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.296094:0:7151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00002000:00100000:3.0:1746143772.296100:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eface00 with x1830963594475776 ext(0->1048575) 00010000:00010000:2.0:1746143772.296100:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00002000:00010000:3.0:1746143772.296104:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eface00 00010000:00010000:2.0:1746143772.296105:0:7151:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 2976 initiator: MDT0 00000100:00100000:3.0:1746143772.296115:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6674 00010000:00010000:2.0:1746143772.296118:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143772.296119:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594475776:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143772.296162:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594476032:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 101us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.296166:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7547 00010000:00010000:2.0:1746143772.296180:0:2976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.296185:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143772.296198:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143772.296298:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594ce00/0xe984082ccd73181d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88cd expref: 24 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.296308:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88cd expref: 23 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.296313:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.296315:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143772.296317:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a594d000, rc 0) 00000100:00100000:2.0:1746143772.296334:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31651:x1830963594475264:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 5172us (5704us total) trans 8589943700 rc 0/0 00000100:00100000:2.0:1746143772.296339:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9339 00000100:00100000:0.0:1746143772.298107:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.298184:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476160 00000100:00100000:1.0:1746143772.298189:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476160 00000100:00100000:1.0:1746143772.298214:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14099 00000100:00100000:1.0:1746143772.298219:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594476160:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.298228:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.298239:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7200/0xe984082ccd731840 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88db expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.298254:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.298256:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.298262:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7200/0xe984082ccd731840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88db expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.298278:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7200/0xe984082ccd731840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88db expref: 24 pid: 8497 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.298291:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b7200, rc 0) 00000100:00100000:1.0:1746143772.298314:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1963:x1830963594476160:12345-192.168.202.48@tcp:101:cat.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.298323:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14099 00000100:00100000:0.0:1746143772.303832:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.303903:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476288 00000100:00100000:2.0:1746143772.303911:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476288 00000100:00100000:2.0:1746143772.303958:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14100 00000100:00100000:2.0:1746143772.303965:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594476288:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143772.303979:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.303991:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0787e00/0xe984082ccd731847 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88e2 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.304033:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594467200:192.168.202.48@tcp:106: 00000100:00100000:2.0:1746143772.304100:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.305067:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.305522:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.305541:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476672 00000100:00100000:1.0:1746143772.305545:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476672 00000100:00100000:1.0:1746143772.305582:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14101 00000100:00100000:2.0:1746143772.305585:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476544 00000100:00100000:1.0:1746143772.305587:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:31651:x1830963594476672:12345-192.168.202.48@tcp:101:multiop.0 00000100:00100000:2.0:1746143772.305589:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476544 00010000:00010000:1.0:1746143772.305598:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.305609:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88e9 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143772.305616:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1851392->1855487) req@ffff880093502300 x1830963594476544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.305628:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963594476544 ext(1851392->1855487) 00010000:00010000:1.0:1746143772.305630:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143772.305632:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093502300 00010000:00010000:1.0:1746143772.305638:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143772.305644:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6675 00010000:00010000:1.0:1746143772.305644:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143772.305649:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594476544:12345-192.168.202.48@tcp:3:multiop.0 00010000:00010000:1.0:1746143772.305649:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.305651:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.305654:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [1830912->1961983] (req 1830912->1961983) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.305679:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 25 pid: 8495 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.305689:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 25 pid: 8495 timeout: 951 lvb_type: 1 00000100:00100000:1.0:1746143772.305697:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594467328:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143772.305747:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 12 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.305755:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 12 pid: 6929 timeout: 951 lvb_type: 1 00000100:00100000:1.0:1746143772.305761:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594467456:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.305765:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:1965:x1830963594476544:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 115us (700us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.305771:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6675 00002000:00100000:2.0:1746143772.305775:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1851392->1855487) req@ffff880093502300 x1830963594476544/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.305781:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093502300 with x1830963594476544 ext(1851392->1855487) 00002000:00010000:2.0:1746143772.305783:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093502300 00010000:00010000:1.0:1746143772.305785:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 29 pid: 25369 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.305792:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 29 pid: 25369 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.305798:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594467584:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143772.305814:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.307132:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eface00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594475776:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 10999us (11413us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.307160:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6674 00002000:00100000:3.0:1746143772.307167:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88008eface00 x1830963594475776/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.307174:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008eface00 with x1830963594475776 ext(0->1048575) 00002000:00010000:3.0:1746143772.307177:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008eface00 00002000:00010000:2.0:1746143772.308284:0:4582:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime: 1746143771 -> 1746143772 00002000:00010000:2.0:1746143772.308288:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime: 1746143771 -> 1746143772 00002000:00010000:2.0:1746143772.308290:0:4582:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime: 1746143771 -> 1746143772 00000100:00100000:2.0:1746143772.308306:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594467200:192.168.202.48@tcp:106: 00010000:00010000:2.0:1746143772.308328:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0787e00/0xe984082ccd731847 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e2 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.308338:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0787e00/0xe984082ccd731847 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e2 expref: 19 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.308351:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0787e00, rc 0) 00000100:00100000:2.0:1746143772.308391:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1962:x1830963594476288:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4426us (4566us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143772.308398:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14100 00000100:00100000:0.0:1746143772.310527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.311104:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594467456:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143772.311116:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594467584:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.311284:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476800 00000100:00100000:2.0:1746143772.311290:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476800 00010000:00010000:2.0:1746143772.311317:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 13 pid: 6929 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.311512:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7548 00000100:00100000:2.0:1746143772.311519:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+13:1964:x1830963594476800:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.311531:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.311547:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 13 pid: 6929 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.311556:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 13 pid: 6929 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.311572:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7600/0xe984082ccd731744 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8856 expref: 13 pid: 6929 timeout: 951 lvb_type: 1 00010000:00010000:2.0:1746143772.311583:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.311623:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594476800:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 105us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.311628:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7548 00000100:00100000:0.0:1746143772.316957:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.316981:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8497:1830963594467328:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143772.316989:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.317009:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476928 00010000:00010000:1.0:1746143772.317012:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [1830912->1961983] (req 1830912->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 25 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.317014:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476928 00010000:00010000:1.0:1746143772.317027:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b6200, rc 0) 00010000:00010000:0.0:1746143772.317036:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.317066:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31651:x1830963594476672:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 11478us (11543us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.317067:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477056 00000100:00100000:0.0:1746143772.317069:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477056 00000100:00100000:1.0:1746143772.317073:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14101 00010000:00010000:0.0:1746143772.317077:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 26 pid: 8495 timeout: 951 lvb_type: 1 00000100:00100000:0.0:1746143772.317090:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7549 00000100:00100000:0.0:1746143772.317095:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594476928:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.317106:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143772.317110:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:0.0:1746143772.317134:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746143772.317167:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746143772.317185:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b161c00/0xe984082ccd7316d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87fb expref: 28 pid: 25369 timeout: 951 lvb_type: 0 00010000:00010000:0.0:1746143772.317198:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.317217:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1965:x1830963594476928:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 121us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143772.317221:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7549 00000100:00100000:1.0:1746143772.317233:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.317233:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7550 00000100:00100000:0.0:1746143772.317238:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594477056:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143772.317244:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143772.317247:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477440 00000100:00100000:1.0:1746143772.317250:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477440 00010000:00010000:0.0:1746143772.317250:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 25 pid: 8495 timeout: 951 lvb_type: 1 00010000:00010000:0.0:1746143772.317259:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 25 pid: 8495 timeout: 951 lvb_type: 1 00000100:00100000:1.0:1746143772.317269:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14102 00010000:00010000:0.0:1746143772.317269:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a594d400/0xe984082ccd7316f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a881e expref: 25 pid: 8495 timeout: 951 lvb_type: 1 00000100:00100000:1.0:1746143772.317274:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+38:31648:x1830963594477440:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:0.0:1746143772.317277:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.317279:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143772.317284:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.317285:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.317292:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.317297:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88f0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.317313:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.317313:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 24 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.317319:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.317320:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.317323:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143772.317324:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fe6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594467712:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.317342:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 17 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.317351:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 17 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.317359:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594467840:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143772.317365:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.317379:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.317450:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477312 00000100:00100000:2.0:1746143772.317454:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477312 00000100:00100000:2.0:1746143772.317475:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4044 00000100:00100000:2.0:1746143772.317480:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+253:31644:x1830963594477312:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:2.0:1746143772.317673:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31644:x1830963594477312:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 192us (562us total) trans 8589943701 rc 0/0 00000100:00100000:2.0:1746143772.317679:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4044 00000100:00100000:0.0:1746143772.318561:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.318994:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477696 00000100:00100000:3.0:1746143772.318999:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477696 00002000:00100000:3.0:1746143772.319024:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88008fe6dc00 x1830963594477696/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.319032:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe6dc00 with x1830963594477696 ext(0->1048575) 00002000:00010000:3.0:1746143772.319035:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe6dc00 00000100:00100000:3.0:1746143772.319061:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6676 00000100:00100000:3.0:1746143772.319066:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594477696:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143772.319861:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fe6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594467712:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.319875:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143772.319891:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.319903:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594477056:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2665us (2913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.319910:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7550 00000100:00100000:1.0:1746143772.319959:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478080 00000100:00100000:1.0:1746143772.319962:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478080 00002000:00100000:1.0:1746143772.319978:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1830912->1835007) req@ffff88008fe6e300 x1830963594478080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.319985:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe6e300 with x1830963594478080 ext(1830912->1835007) 00002000:00010000:1.0:1746143772.319988:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe6e300 00000100:00100000:1.0:1746143772.320010:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6677 00000100:00100000:1.0:1746143772.320015:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594478080:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143772.320106:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594478080:12345-192.168.202.48@tcp:3:cat.0 Request processed in 87us (212us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143772.320114:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6677 00002000:00100000:1.0:1746143772.320118:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1830912->1835007) req@ffff88008fe6e300 x1830963594478080/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143772.320133:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe6e300 with x1830963594478080 ext(1830912->1835007) 00002000:00010000:1.0:1746143772.320136:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe6e300 00000100:00100000:1.0:1746143772.320171:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b79df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594467840:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143772.320187:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 39 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.320198:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b6000, rc 0) 00000100:00100000:1.0:1746143772.320217:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:31648:x1830963594477440:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2943us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.320222:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14102 00000100:00100000:1.0:1746143772.328387:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.328442:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.328626:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477824 00000100:00100000:2.0:1746143772.328635:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477824 00002000:00100000:2.0:1746143772.328673:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1658879) req@ffff88012b79df80 x1830963594477824/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.328682:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79df80 with x1830963594477824 ext(1048576->1658879) 00010000:00010000:2.0:1746143772.328690:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 18 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.328703:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 18 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:2.0:1746143772.328709:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79df80 00000100:00100000:2.0:1746143772.328735:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478336 00000100:00100000:2.0:1746143772.328737:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478336 00002000:00100000:2.0:1746143772.328750:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1957888->1961983) req@ffff88012b79ed80 x1830963594478336/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.328756:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ed80 with x1830963594478336 ext(1957888->1961983) 00002000:00010000:2.0:1746143772.328759:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79ed80 00000100:00100000:0.0:1746143772.328761:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1881 00000100:00100000:0.0:1746143772.328771:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+18:1964:x1830963594477824:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143772.328953:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6678 00000100:00100000:2.0:1746143772.328960:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594478336:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.329096:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594478336:12345-192.168.202.48@tcp:3:cat.0 Request processed in 135us (652us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.329105:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6678 00002000:00100000:2.0:1746143772.329110:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x353:0x0] (1957888->1961983) req@ffff88012b79ed80 x1830963594478336/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.329117:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79ed80 with x1830963594478336 ext(1957888->1961983) 00002000:00010000:2.0:1746143772.329120:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b79ed80 00000100:00100000:3.0:1746143772.333540:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594477696:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14464us (14971us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.333550:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6676 00002000:00100000:3.0:1746143772.333561:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x351:0x0] (0->1048575) req@ffff88008fe6dc00 x1830963594477696/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.333570:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fe6dc00 with x1830963594477696 ext(0->1048575) 00002000:00010000:3.0:1746143772.333574:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fe6dc00 00000100:00100000:0.0:1746143772.340934:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.341164:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478464 00000100:00100000:1.0:1746143772.341171:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478464 00000100:00100000:1.0:1746143772.341245:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14103 00000100:00100000:1.0:1746143772.341252:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31653:x1830963594478464:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.341266:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.341278:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6800/0xe984082ccd73185c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88f7 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.341298:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.341303:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6800/0xe984082ccd73185c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f7 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.341313:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6800/0xe984082ccd73185c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f7 expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.341322:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5b6800, rc 0) 00000100:00100000:1.0:1746143772.341366:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31653:x1830963594478464:12345-192.168.202.48@tcp:101:cat.0 Request processed in 115us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.341372:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14103 00000100:00100000:2.0:1746143772.343009:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594477824:12345-192.168.202.48@tcp:4:cat.0 Request processed in 14234us (14624us total) trans 17179873245 rc 0/0 00000100:00100000:2.0:1746143772.343019:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1881 00002000:00100000:2.0:1746143772.343027:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->1658879) req@ffff88012b79df80 x1830963594477824/t17179873245(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.343037:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b79df80 with x1830963594477824 ext(1048576->1658879) 00010000:00010000:2.0:1746143772.343044:0:25544:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 21 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.343057:0:25544:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 21 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:2.0:1746143772.343063:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b79df80 00000100:00100000:0.0:1746143772.345356:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.345496:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478592 00000100:00100000:1.0:1746143772.345502:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478592 00010000:00010000:1.0:1746143772.345529:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 21 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.345676:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7551 00000100:00100000:1.0:1746143772.345684:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594478592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.345697:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143772.345712:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143771 -> 1746143772 00010000:00010000:1.0:1746143772.345717:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 21 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.345727:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 21 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.345744:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930b1a00/0xe984082ccd731783 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8880 expref: 21 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.345776:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.345778:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.345785:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.345791:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.345798:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.345799:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.345802:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6800/0xe984082ccd73185c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f7 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.345807:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6800/0xe984082ccd73185c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f7 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.345832:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6800/0xe984082ccd73185c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f7 expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.345842:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594467968:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.345905:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.345912:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594468096:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.345925:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.347182:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594467968:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.348118:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11106:1830963594468096:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.348166:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.348200:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1963:x1830963594478592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2515us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.348208:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7551 00000100:00100000:0.0:1746143772.349588:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.349814:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478848 00000100:00100000:2.0:1746143772.349820:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478848 00002000:00100000:2.0:1746143772.349862:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009e5cd500 x1830963594478848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.349870:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cd500 with x1830963594478848 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.349874:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cd500 00000100:00100000:2.0:1746143772.349900:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6679 00000100:00100000:2.0:1746143772.349906:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594478848:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143772.357471:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.357517:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.358476:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594479232 00000100:00100000:3.0:1746143772.358483:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594479232 00002000:00100000:3.0:1746143772.358520:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009e5cc700 x1830963594479232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 504/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.358528:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc700 with x1830963594479232 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.358532:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cc700 00000100:00100000:3.0:1746143772.358633:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594479104 00000100:00100000:3.0:1746143772.358636:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594479104 00002000:00100000:3.0:1746143772.358648:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094306300 x1830963594479104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.358653:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830963594479104 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.358657:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306300 00000100:00100000:2.0:1746143772.358718:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6680 00000100:00100000:2.0:1746143772.358727:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594479232:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143772.359217:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6681 00000100:00100000:3.0:1746143772.359224:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594479104:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143772.372098:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1964:x1830963594478848:12345-192.168.202.48@tcp:3:cat.0 Request processed in 22182us (22504us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.372109:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6679 00002000:00100000:2.0:1746143772.372120:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff88009e5cd500 x1830963594478848/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.372137:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cd500 with x1830963594478848 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.372156:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cd500 00000100:00100000:2.0:1746143772.373241:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e5cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594479232:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 14514us (15777us total) trans 0 rc 286720/286720 00000100:00100000:2.0:1746143772.373248:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6680 00002000:00100000:2.0:1746143772.373253:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88009e5cc700 x1830963594479232/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 504/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 286720/286720 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.373261:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e5cc700 with x1830963594479232 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.373264:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e5cc700 00000100:00100000:3.0:1746143772.376691:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1962:x1830963594479104:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 17460us (19166us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.376702:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6681 00002000:00100000:3.0:1746143772.376711:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x356:0x0] (1048576->2097151) req@ffff880094306300 x1830963594479104/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.376719:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830963594479104 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.376724:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306300 00000100:00100000:0.0:1746143772.378336:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.378968:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594479488 00000100:00100000:3.0:1746143772.378976:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594479488 00000100:00100000:3.0:1746143772.379058:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14104 00000100:00100000:3.0:1746143772.379065:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:31653:x1830963594479488:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:3.0:1746143772.379080:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.379093:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd731863 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a88fe expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.379116:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.379135:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.379137:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143772.379168:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd731863 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88fe expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.379408:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 38 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.379420:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 38 pid: 8497 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.379434:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594468224:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.379715:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.380928:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594468224:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.380948:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd731863 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88fe expref: 21 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.380960:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800930b0e00, rc 0) 00000100:00100000:2.0:1746143772.380985:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31653:x1830963594479488:12345-192.168.202.48@tcp:101:cat.0 Request processed in 1920us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.380991:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14104 00000100:00100000:0.0:1746143772.381777:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.381860:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594479616 00000100:00100000:3.0:1746143772.381865:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594479616 00002000:00100000:3.0:1746143772.381894:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1093632->1855487) req@ffff8800a0658000 x1830963594479616/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.381903:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0658000 with x1830963594479616 ext(1093632->1855487) 00010000:00010000:3.0:1746143772.381909:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 39 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.381919:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 39 pid: 8497 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.381926:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0658000 00000100:00100000:3.0:1746143772.381950:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1882 00000100:00100000:3.0:1746143772.381956:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+39:1964:x1830963594479616:12345-192.168.202.48@tcp:4:multiop.0 00000100:00100000:0.0:1746143772.384189:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.384457:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594479744 00000100:00100000:2.0:1746143772.384464:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594479744 00000100:00100000:2.0:1746143772.384509:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14105 00000100:00100000:2.0:1746143772.384516:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:31648:x1830963594479744:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143772.384534:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.384668:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8905 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.384695:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.384701:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143772.384703:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143772.384706:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.384734:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 23 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.384781:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 23 pid: 8497 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.384791:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468352:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.384859:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.392008:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468352:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143772.392029:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:2.0:1746143772.392034:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.392049:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f046200, rc 0) 00000100:00100000:2.0:1746143772.392092:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31648:x1830963594479744:12345-192.168.202.48@tcp:101:cat.0 Request processed in 7575us (7908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.392099:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14105 00000100:00100000:2.0:1746143772.392185:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594479872 00000100:00100000:2.0:1746143772.392191:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594479872 00002000:00100000:2.0:1746143772.392217:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1830912->1961983) req@ffff8800a0658700 x1830963594479872/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.392225:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0658700 with x1830963594479872 ext(1830912->1961983) 00010000:00010000:2.0:1746143772.392231:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 24 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.392245:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 24 pid: 8497 timeout: 951 lvb_type: 0 00002000:00010000:2.0:1746143772.392250:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0658700 00000100:00100000:2.0:1746143772.392276:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1883 00000100:00100000:2.0:1746143772.392282:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+24:1965:x1830963594479872:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:2.0:1746143772.395241:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594479872:12345-192.168.202.48@tcp:4:cat.0 Request processed in 2952us (3207us total) trans 21474840574 rc 0/0 00000100:00100000:2.0:1746143772.395250:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1883 00002000:00100000:2.0:1746143772.395258:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1830912->1961983) req@ffff8800a0658700 x1830963594479872/t21474840574(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.395266:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0658700 with x1830963594479872 ext(1830912->1961983) 00010000:00010000:2.0:1746143772.395273:0:8500:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 26 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.395284:0:8500:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 26 pid: 8497 timeout: 951 lvb_type: 0 00002000:00010000:2.0:1746143772.395290:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0658700 00000100:00100000:3.0:1746143772.397095:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963594479616:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 15132us (15314us total) trans 17179873246 rc 0/0 00000100:00100000:3.0:1746143772.397104:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1882 00002000:00100000:3.0:1746143772.397111:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1093632->1855487) req@ffff8800a0658000 x1830963594479616/t17179873246(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.397119:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0658000 with x1830963594479616 ext(1093632->1855487) 00010000:00010000:3.0:1746143772.397135:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 41 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.397161:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 41 pid: 8497 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.397167:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0658000 00000100:00100000:0.0:1746143772.400800:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.400868:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594480000 00000100:00100000:0.0:1746143772.400873:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.400876:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594480000 00010000:00010000:1.0:1746143772.400906:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 26 pid: 8497 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.400944:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594480128 00000100:00100000:1.0:1746143772.400947:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594480128 00010000:00010000:1.0:1746143772.400960:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 41 pid: 8497 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.400975:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7552 00000100:00100000:1.0:1746143772.400982:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1965:x1830963594480000:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.400993:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143772.401008:0:11106:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143772.401011:0:11106:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143771 -> 1746143772 00010000:00010000:1.0:1746143772.401016:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 26 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.401025:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 26 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.401047:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6200/0xe984082ccd73184e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1830912->1961983) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88e9 expref: 26 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.401064:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143772.401066:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7553 00010000:00010000:1.0:1746143772.401066:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.401072:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.401074:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1962:x1830963594480128:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.401079:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.401082:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143772.401095:0:7151:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 41 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.401104:0:7151:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 41 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.401107:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.401115:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c687c00/0xe984082ccd73180f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1855487) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88c6 expref: 41 pid: 8497 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.401117:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594468480:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143772.401135:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.401137:0:7151:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143772.401160:0:7151:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd731863 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88fe expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.401167:0:7151:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd731863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88fe expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143772.401185:0:7151:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd731863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88fe expref: 20 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.401193:0:7151:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594468608:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.401207:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.401214:0:7151:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c49bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.402675:0:7151:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7151:1830963594468608:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143772.402689:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.402774:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594468480:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.402783:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143772.403222:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1962:x1830963594480128:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2148us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.403230:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7553 00000100:00100000:1.0:1746143772.403379:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1965:x1830963594480000:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2396us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.403385:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7552 00000100:00100000:0.0:1746143772.405187:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.405261:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594480384 00000100:00100000:3.0:1746143772.405267:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594480384 00002000:00100000:3.0:1746143772.405329:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0659180 x1830963594480384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.405339:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0659180 with x1830963594480384 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.405342:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0659180 00000100:00100000:3.0:1746143772.405367:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6682 00000100:00100000:3.0:1746143772.405373:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594480384:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.412308:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.412406:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594480640 00000100:00100000:0.0:1746143772.412414:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594480640 00002000:00100000:0.0:1746143772.412449:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a5c21f80 x1830963594480640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143772.412458:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21f80 with x1830963594480640 ext(1048576->2097151) 00002000:00010000:0.0:1746143772.412462:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21f80 00000100:00100000:0.0:1746143772.412479:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6683 00000100:00100000:0.0:1746143772.412486:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594480640:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:3.0:1746143772.421320:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594480384:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15936us (16126us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.421334:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6682 00002000:00100000:3.0:1746143772.421345:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff8800a0659180 x1830963594480384/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.421357:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0659180 with x1830963594480384 ext(1048576->2097151) 00002000:00010000:3.0:1746143772.421363:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0659180 00000100:00100000:2.0:1746143772.424030:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594480640:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 11536us (11722us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.424040:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6683 00002000:00100000:2.0:1746143772.424049:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff8800a5c21f80 x1830963594480640/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.424058:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21f80 with x1830963594480640 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.424062:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21f80 00000100:00100000:0.0:1746143772.427027:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.427244:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594480768 00000100:00100000:2.0:1746143772.427252:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594480768 00000100:00100000:2.0:1746143772.427300:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14106 00000100:00100000:2.0:1746143772.427308:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31653:x1830963594480768:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143772.427322:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.427337:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f046800/0xe984082ccd731871 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a890c expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.427359:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.427360:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.427366:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f046800/0xe984082ccd731871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a890c expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.427378:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f046800/0xe984082ccd731871 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a890c expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.427386:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f046800, rc 0) 00000100:00100000:2.0:1746143772.428050:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31653:x1830963594480768:12345-192.168.202.48@tcp:101:cat.0 Request processed in 740us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.428055:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14106 00000100:00100000:0.0:1746143772.431952:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.432850:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594480896 00000100:00100000:2.0:1746143772.432858:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594480896 00000100:00100000:2.0:1746143772.432905:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14107 00000100:00100000:2.0:1746143772.432913:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594480896:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:2.0:1746143772.432927:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.432941:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8913 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.432960:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.432962:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.432969:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 41 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.432981:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 41 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.432990:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f046a00, rc 0) 00000100:00100000:2.0:1746143772.433336:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594480896:12345-192.168.202.48@tcp:101:cat.0 Request processed in 422us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.433342:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14107 00000100:00100000:0.0:1746143772.434840:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.434887:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594481152 00000100:00100000:2.0:1746143772.434892:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594481152 00002000:00100000:2.0:1746143772.434962:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880099c11050 x1830963594481152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.434971:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c11050 with x1830963594481152 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.434975:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099c11050 00000100:00100000:2.0:1746143772.435031:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6684 00000100:00100000:2.0:1746143772.435038:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594481152:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.447274:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1963:x1830963594481152:12345-192.168.202.48@tcp:3:cat.0 Request processed in 12228us (12427us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.447285:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6684 00002000:00100000:2.0:1746143772.447295:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x353:0x0] (1048576->2097151) req@ffff880099c11050 x1830963594481152/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.447304:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099c11050 with x1830963594481152 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.447309:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099c11050 00000100:00100000:0.0:1746143772.454572:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.456318:0:2976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594481408 00000100:00100000:2.0:1746143772.456328:0:2976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594481408 00000100:00100000:2.0:1746143772.456548:0:2976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9341 00000100:00100000:2.0:1746143772.456557:0:2976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+254:31657:x1830963594481408:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143772.456577:0:2976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.456591:0:2976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f046c00/0xe984082ccd73187f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a891a expref: -99 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.456672:0:2976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f046e00/0xe984082ccd731886 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.456685:0:2976:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f046e00/0xe984082ccd731886 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 2976 initiator: MDT0 00010000:00010000:2.0:1746143772.456693:0:2976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f046e00/0xe984082ccd731886 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 2976 initiator: MDT0 00000004:00200000:2.0:1746143772.456702:0:2976:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:2.0:1746143772.456794:0:2976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f046c00/0xe984082ccd73187f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a891a expref: 257 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.456817:0:2976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f046e00/0xe984082ccd731886 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a891a expref: 256 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.456828:0:2976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.456831:0:2976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143772.456834:0:2976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f046e00, rc 0) 00000100:00100000:2.0:1746143772.456891:0:2976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:31657:x1830963594481408:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 335us (2325us total) trans 8589943702 rc 0/0 00000100:00100000:2.0:1746143772.456897:0:2976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9341 00000100:00100000:0.0:1746143772.486111:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.486332:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594481536 00000100:00100000:2.0:1746143772.486340:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594481536 00000100:00100000:2.0:1746143772.486477:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14108 00000100:00100000:2.0:1746143772.486485:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:31657:x1830963594481536:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143772.486502:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143772.486516:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8921 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.486538:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.486545:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.486552:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 29 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.486557:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.486563:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.486568:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2125824->2555903] (req 2125824->2555903) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.486712:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 29 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.486723:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 29 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.486734:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468736:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.486825:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 11 pid: 6929 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.486833:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 11 pid: 6929 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.486840:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468864:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.486858:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 25 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.486865:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 25 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.486872:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468992:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.486882:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.488600:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468864:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.488611:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468992:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.489621:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594468736:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.489646:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [2125824->2555903] (req 2125824->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 29 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.489660:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f047000, rc 0) 00000100:00100000:2.0:1746143772.489707:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:31657:x1830963594481536:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 3223us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.489715:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14108 00000100:00100000:0.0:1746143772.495047:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.495085:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.495112:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594481664 00000100:00100000:1.0:1746143772.495119:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594481664 00000100:00100000:0.0:1746143772.495133:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:1.0:1746143772.495172:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 12 pid: 6929 timeout: 951 lvb_type: 1 00000100:00100000:1.0:1746143772.495199:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594481920 00000100:00100000:1.0:1746143772.495201:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594481920 00010000:00010000:1.0:1746143772.495209:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 26 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.495231:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594481792 00000100:00100000:1.0:1746143772.495233:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594481792 00010000:00010000:1.0:1746143772.495242:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 29 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:1.0:1746143772.495255:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7554 00000100:00100000:1.0:1746143772.495260:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1964:x1830963594481664:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.495272:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.495289:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 12 pid: 6929 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.495298:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 12 pid: 6929 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.495312:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7555 00010000:00010000:1.0:1746143772.495318:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7400/0xe984082ccd73172f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a885d expref: 12 pid: 6929 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.495320:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1964:x1830963594481920:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.495328:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.495335:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143772.495338:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 26 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.495346:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 26 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.495357:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131266e00/0xe984082ccd731672 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87d1 expref: 26 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.495365:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1964:x1830963594481664:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 104us (327us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143772.495370:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.495370:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7554 00000100:00100000:1.0:1746143772.495383:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7556 00000100:00100000:2.0:1746143772.495386:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1964:x1830963594481920:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.495387:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594481792:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143772.495391:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7555 00010000:00010000:1.0:1746143772.495392:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.495398:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 29 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.495406:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 29 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.495416:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a622c00/0xe984082ccd7316fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8825 expref: 29 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.495423:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.495425:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.495431:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.495439:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.495462:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.495472:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594469120:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.495515:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.497248:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.497300:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594482176 00000100:00100000:2.0:1746143772.497306:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594482176 00000100:00100000:1.0:1746143772.497326:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594469120:192.168.202.48@tcp:105: 00002000:00100000:2.0:1746143772.497337:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2125824->2129919) req@ffff8800a065ad80 x1830963594482176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143772.497342:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746143772.497345:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a065ad80 with x1830963594482176 ext(2125824->2129919) 00002000:00010000:2.0:1746143772.497349:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a065ad80 00000100:00100000:1.0:1746143772.497366:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594481792:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1979us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.497373:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7556 00000100:00100000:2.0:1746143772.497939:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6685 00000100:00100000:2.0:1746143772.497946:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963594482176:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143772.498090:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1963:x1830963594482176:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 143us (847us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.498095:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6685 00002000:00100000:2.0:1746143772.498100:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2125824->2129919) req@ffff8800a065ad80 x1830963594482176/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.498107:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a065ad80 with x1830963594482176 ext(2125824->2129919) 00002000:00010000:2.0:1746143772.498109:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a065ad80 00000100:00100000:0.0:1746143772.502907:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.502999:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594482432 00000100:00100000:3.0:1746143772.503005:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594482432 00002000:00100000:3.0:1746143772.503044:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (2551808->2555903) req@ffff8800a065b100 x1830963594482432/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.503052:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a065b100 with x1830963594482432 ext(2551808->2555903) 00002000:00010000:3.0:1746143772.503057:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a065b100 00000100:00100000:2.0:1746143772.503796:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6686 00000100:00100000:2.0:1746143772.503806:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594482432:12345-192.168.202.48@tcp:3:multiop.0 00000100:00100000:2.0:1746143772.503955:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1962:x1830963594482432:12345-192.168.202.48@tcp:3:multiop.0 Request processed in 151us (1053us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.503962:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6686 00002000:00100000:2.0:1746143772.503967:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (2551808->2555903) req@ffff8800a065b100 x1830963594482432/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.503974:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a065b100 with x1830963594482432 ext(2551808->2555903) 00002000:00010000:2.0:1746143772.503978:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a065b100 00000100:00100000:0.0:1746143772.552427:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.552511:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594482688 00000100:00100000:1.0:1746143772.552519:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594482688 00000100:00100000:1.0:1746143772.552679:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9342 00000100:00100000:1.0:1746143772.552687:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:31662:x1830963594482688:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:1.0:1746143772.552708:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.552722:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20600/0xe984082ccd73189b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8928 expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.553135:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553163:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553172:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553184:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553188:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553192:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553282:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21000/0xe984082ccd7318b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553290:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21000/0xe984082ccd7318b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553295:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21000/0xe984082ccd7318b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143772.553302:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143772.553373:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553379:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553385:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553390:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f20c00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143772.553393:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553399:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553408:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143772.553411:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143772.553413:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553418:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20c00/0xe984082ccd7318a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553443:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553452:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553456:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553460:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f20e00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143772.553461:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553465:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553471:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c900) 00010000:00010000:1.0:1746143772.553473:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143772.553475:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553479:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20e00/0xe984082ccd7318a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.553510:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f20600/0xe984082ccd73189b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8928 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.553520:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21000/0xe984082ccd7318b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8928 expref: 25 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.553526:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143772.553527:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143772.553529:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f21000, rc 0) 00000100:00100000:1.0:1746143772.553725:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31662:x1830963594482688:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 1038us (1305us total) trans 8589943703 rc 0/0 00000100:00100000:1.0:1746143772.553732:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9342 00000100:00100000:0.0:1746143772.556076:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.556208:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.556294:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594482944 00000100:00100000:3.0:1746143772.556300:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594482944 00000100:00100000:3.0:1746143772.556331:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4045 00000100:00100000:3.0:1746143772.556337:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31662:x1830963594482944:12345-192.168.202.48@tcp:35:multiop.0 00000100:00100000:3.0:1746143772.556487:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31662:x1830963594482944:12345-192.168.202.48@tcp:35:multiop.0 Request processed in 150us (416us total) trans 8589943704 rc 0/0 00000100:00100000:3.0:1746143772.556493:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4045 00000100:00100000:1.0:1746143772.556566:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594483072 00000100:00100000:1.0:1746143772.556569:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594483072 00000100:00100000:1.0:1746143772.556592:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 757 00000100:00100000:1.0:1746143772.556596:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594483072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.556603:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.556618:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21000/0xe984082ccd7318b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8928 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.556629:0:11106:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143772.556633:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.556645:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:1962:x1830963594483072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.556650:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 757 00000100:00100000:0.0:1746143772.579780:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.579918:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594483328 00000100:00100000:1.0:1746143772.579926:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594483328 00000100:00100000:1.0:1746143772.579977:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9343 00000100:00100000:1.0:1746143772.579985:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31665:x1830963594483328:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.580004:0:14763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.580018:0:14763:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21200/0xe984082ccd7318be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a892f expref: -99 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.580105:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580115:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580136:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580502:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580508:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580514:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580600:0:14763:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21800/0xe984082ccd7318d3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580607:0:14763:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21800/0xe984082ccd7318d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580613:0:14763:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21800/0xe984082ccd7318d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14763 initiator: MDT0 00000004:00200000:1.0:1746143772.580621:0:14763:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:1.0:1746143772.580685:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580690:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580696:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580700:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f21400 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143772.580703:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580709:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580716:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:1.0:1746143772.580719:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143772.580721:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580725:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21400/0xe984082ccd7318c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580743:0:14763:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580747:0:14763:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580751:0:14763:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580754:0:14763:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f21600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143772.580756:0:14763:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580759:0:14763:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580763:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d03c100) 00010000:00010000:1.0:1746143772.580765:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143772.580766:0:14763:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580770:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21600/0xe984082ccd7318cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14763 initiator: MDT0 00010000:00010000:1.0:1746143772.580797:0:14763:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21200/0xe984082ccd7318be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a892f expref: 28 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.580806:0:14763:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21800/0xe984082ccd7318d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a892f expref: 27 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.580811:0:14763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143772.580812:0:14763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143772.580814:0:14763:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f21800, rc 0) 00000100:00100000:1.0:1746143772.580853:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31665:x1830963594483328:12345-192.168.202.48@tcp:101:cat.0 Request processed in 869us (1080us total) trans 8589943705 rc 0/0 00000100:00100000:1.0:1746143772.580858:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9343 00000100:00100000:2.0:1746143772.581682:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.582231:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594483456 00000100:00100000:0.0:1746143772.582236:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594483456 00000100:00100000:0.0:1746143772.582278:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14109 00000100:00100000:0.0:1746143772.582283:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+25:31662:x1830963594483456:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:0.0:1746143772.582295:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143772.582306:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8936 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.582325:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.582331:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143772.582332:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143772.582334:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.582358:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143772.582369:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 27 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:0.0:1746143772.582378:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0658e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594469248:192.168.202.48@tcp:104: 00000100:00100000:0.0:1746143772.582455:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8e2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.583802:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.584182:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594483712 00000100:00100000:3.0:1746143772.584188:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594483712 00000100:00100000:3.0:1746143772.584217:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4046 00000100:00100000:3.0:1746143772.584223:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31665:x1830963594483712:12345-192.168.202.48@tcp:35:cat.0 00000100:00100000:3.0:1746143772.584374:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31665:x1830963594483712:12345-192.168.202.48@tcp:35:cat.0 Request processed in 150us (573us total) trans 8589943706 rc 0/0 00000100:00100000:3.0:1746143772.584381:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4046 00000100:00100000:1.0:1746143772.584987:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0658e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594469248:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143772.585006:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.585018:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c45fe00, rc 0) 00000100:00100000:1.0:1746143772.585046:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31662:x1830963594483456:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 2763us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.585051:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14109 00000100:00100000:0.0:1746143772.586606:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.586773:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594483840 00000100:00100000:2.0:1746143772.586778:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594483840 00000100:00100000:2.0:1746143772.587128:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 758 00000100:00100000:2.0:1746143772.587136:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594483840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.587186:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.587207:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f21800/0xe984082ccd7318d3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a892f expref: 28 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.587231:0:23335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143772.587234:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.587264:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1962:x1830963594483840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 129us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.587270:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 758 00000100:00100000:0.0:1746143772.587369:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.587474:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594484096 00000100:00100000:1.0:1746143772.587478:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594484096 00000100:00100000:0.0:1746143772.587491:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.587498:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14110 00000100:00100000:1.0:1746143772.587502:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594484096:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.587513:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.587524:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f21a00/0xe984082ccd7318e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a893d expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.587559:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594469376:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143772.587607:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.587847:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594483968 00000100:00100000:2.0:1746143772.587851:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594483968 00002000:00100000:2.0:1746143772.587872:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (2125824->2555903) req@ffff8800a065aa00 x1830963594483968/t0(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.587882:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a065aa00 with x1830963594483968 ext(2125824->2555903) 00010000:00010000:2.0:1746143772.587887:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 28 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.587898:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 28 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:2.0:1746143772.587905:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a065aa00 00000100:00100000:2.0:1746143772.588084:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1884 00000100:00100000:2.0:1746143772.588090:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+28:1965:x1830963594483968:12345-192.168.202.48@tcp:4:multiop.0 00002000:00010000:1.0:1746143772.591208:0:4582:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143772.591214:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143772.591216:0:4582:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime: 1746143771 -> 1746143772 00000100:00100000:1.0:1746143772.591231:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4582:1830963594469376:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143772.591256:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f21a00/0xe984082ccd7318e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a893d expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.591268:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f21a00/0xe984082ccd7318e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a893d expref: 27 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.591296:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f21a00, rc 0) 00000100:00100000:1.0:1746143772.591328:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:1962:x1830963594484096:12345-192.168.202.48@tcp:101:cat.0 Request processed in 3824us (3959us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.591335:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14110 00000100:00100000:2.0:1746143772.596630:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594483968:12345-192.168.202.48@tcp:4:multiop.0 Request processed in 8531us (9129us total) trans 21474840575 rc 0/0 00000100:00100000:2.0:1746143772.596641:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1884 00002000:00100000:2.0:1746143772.596652:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (2125824->2555903) req@ffff8800a065aa00 x1830963594483968/t21474840575(0) o4->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.596662:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a065aa00 with x1830963594483968 ext(2125824->2555903) 00010000:00010000:2.0:1746143772.596670:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 30 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.596684:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 30 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:2.0:1746143772.596691:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a065aa00 00000100:00100000:0.0:1746143772.600693:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.600910:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594484224 00000100:00100000:1.0:1746143772.600918:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594484224 00000100:00100000:1.0:1746143772.600972:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14111 00000100:00100000:1.0:1746143772.600980:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+26:31665:x1830963594484224:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.600994:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.601010:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f21e00/0xe984082ccd7318ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8944 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.601041:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.601046:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.601051:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143772.601054:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f21e00/0xe984082ccd7318ef lrc: 4/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8944 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.601084:0:4582:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3006464->3145727] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.601093:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f21e00/0xe984082ccd7318ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8944 expref: 27 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.601101:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f21e00, rc 0) 00000100:00100000:1.0:1746143772.601167:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31665:x1830963594484224:12345-192.168.202.48@tcp:101:cat.0 Request processed in 188us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.601173:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14111 00000100:00100000:0.0:1746143772.601456:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.601541:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594484352 00000100:00100000:2.0:1746143772.601545:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594484352 00010000:00010000:2.0:1746143772.601564:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 30 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.602752:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7557 00000100:00100000:2.0:1746143772.602761:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594484352:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.602773:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.602792:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 30 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.602809:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 30 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.602828:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f047000/0xe984082ccd731894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2125824->2555903) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8921 expref: 30 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.603040:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.603042:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.603050:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.603059:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.603099:0:11106:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 26 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.603111:0:11106:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 26 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.603134:0:11106:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594469632:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143772.603612:0:11106:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143772.605518:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.605575:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594484608 00000100:00100000:2.0:1746143772.605575:0:11106:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11106:1830963594469632:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143772.605581:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594484608 00010000:00010000:2.0:1746143772.605601:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143772.605618:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3006464->3010559) req@ffff8800a0659180 x1830963594484608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.605626:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0659180 with x1830963594484608 ext(3006464->3010559) 00010000:00010000:3.0:1746143772.605633:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.605642:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1964:x1830963594484352:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2882us (4185us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143772.605644:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.605650:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0659180 00000100:00100000:2.0:1746143772.605651:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7557 00000100:00100000:3.0:1746143772.605673:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1885 00000100:00100000:3.0:1746143772.605679:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594484608:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:3.0:1746143772.605838:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1964:x1830963594484608:12345-192.168.202.48@tcp:3:cat.0 Request processed in 159us (324us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143772.605844:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1885 00002000:00100000:3.0:1746143772.605849:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3006464->3010559) req@ffff8800a0659180 x1830963594484608/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.605855:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0659180 with x1830963594484608 ext(3006464->3010559) 00010000:00010000:3.0:1746143772.605859:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.605866:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.605872:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0659180 00000100:00100000:0.0:1746143772.610628:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.610685:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.610770:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594484864 00000100:00100000:2.0:1746143772.610773:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594484992 00000100:00100000:3.0:1746143772.610778:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594484864 00000100:00100000:2.0:1746143772.610778:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594484992 00002000:00100000:3.0:1746143772.610810:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3006464->3145727) req@ffff88009ff6c700 x1830963594484864/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.610819:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963594484864 ext(3006464->3145727) 00000100:00100000:2.0:1746143772.610820:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14112 00010000:00010000:3.0:1746143772.610827:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.610827:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:31662:x1830963594484992:12345-192.168.202.48@tcp:101:multiop.0 00010000:00010000:2.0:1746143772.610837:0:8497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143772.610839:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 27 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.610845:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6c700 00010000:00010000:2.0:1746143772.610850:0:8497:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a894b expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143772.610858:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1886 00000100:00100000:3.0:1746143772.610862:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:1965:x1830963594484864:12345-192.168.202.48@tcp:4:cat.0 00010000:00010000:2.0:1746143772.610871:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.610879:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.610886:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 40 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.610891:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.610893:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.610896:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2392063) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.610918:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 40 pid: 12618 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.610926:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 40 pid: 12618 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.610937:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594469760:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.610998:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 11 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143772.611006:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 11 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:2.0:1746143772.611013:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594469888:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.611031:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 22 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.611037:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 22 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.611044:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594470016:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.611055:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.614028:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1965:x1830963594484864:12345-192.168.202.48@tcp:4:cat.0 Request processed in 3158us (3335us total) trans 21474840576 rc 0/0 00000100:00100000:3.0:1746143772.614036:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1886 00002000:00100000:3.0:1746143772.614046:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3006464->3145727) req@ffff88009ff6c700 x1830963594484864/t21474840576(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.614056:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6c700 with x1830963594484864 ext(3006464->3145727) 00010000:00010000:3.0:1746143772.614064:0:3269:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 29 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.614075:0:3269:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 29 pid: 4582 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.614081:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff6c700 00000100:00100000:0.0:1746143772.617350:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.617375:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.617395:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.617700:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594469760:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.617710:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594469888:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143772.617717:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594470016:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143772.617756:0:8497:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2392063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.617775:0:8497:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e42200, rc 0) 00000100:00100000:2.0:1746143772.617824:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:31662:x1830963594484992:12345-192.168.202.48@tcp:101:multiop.0 Request processed in 6997us (7202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.617831:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14112 00000100:00100000:3.0:1746143772.617957:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594485120 00000100:00100000:3.0:1746143772.617963:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594485120 00010000:00010000:3.0:1746143772.617985:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 12 pid: 25369 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.618003:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594485248 00000100:00100000:3.0:1746143772.618005:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594485248 00010000:00010000:3.0:1746143772.618012:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 41 pid: 12618 timeout: 951 lvb_type: 1 00000100:00100000:3.0:1746143772.618022:0:23335:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594485376 00000100:00100000:3.0:1746143772.618024:0:23335:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594485376 00010000:00010000:3.0:1746143772.618030:0:23335:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 22 pid: 12618 timeout: 951 lvb_type: 0 00000100:00100000:3.0:1746143772.618045:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7558 00000100:00100000:3.0:1746143772.618051:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+12:1965:x1830963594485120:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143772.618060:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143772.618078:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 12 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:3.0:1746143772.618085:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 12 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:3.0:1746143772.618108:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a594d600/0xe984082ccd73174b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8864 expref: 12 pid: 25369 timeout: 951 lvb_type: 1 00010000:00010000:3.0:1746143772.618131:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.618217:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7559 00000100:00100000:1.0:1746143772.618225:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1964:x1830963594485248:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.618231:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.618240:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 41 pid: 12618 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.618248:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 41 pid: 12618 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.618260:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e621800/0xe984082ccd731705 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a882c expref: 41 pid: 12618 timeout: 951 lvb_type: 1 00010000:00010000:1.0:1746143772.618273:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.618288:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594485248:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 66us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.618293:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7559 00000100:00100000:0.0:1746143772.618294:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.618302:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594485504 00000100:00100000:1.0:1746143772.618305:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594485504 00010000:00010000:1.0:1746143772.618315:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 29 pid: 4582 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.618325:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7560 00000100:00100000:1.0:1746143772.618329:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594485376:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143772.618334:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143772.618339:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 22 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.618346:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 22 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.618355:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b161800/0xe984082ccd7316aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a87ed expref: 22 pid: 12618 timeout: 951 lvb_type: 0 00010000:00010000:1.0:1746143772.618362:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.618364:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.618370:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.618377:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.618397:0:7150:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 21 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.618406:0:7150:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594470144:192.168.202.48@tcp:105: 00000100:00100000:1.0:1746143772.618455:0:7150:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.618537:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7561 00000100:00100000:2.0:1746143772.618543:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594485504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.618554:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.618565:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 29 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.618573:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 29 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.618583:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c45fe00/0xe984082ccd7318e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3006464->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8936 expref: 29 pid: 4582 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.618594:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.618595:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.618599:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f21e00/0xe984082ccd7318ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8944 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.618605:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f21e00/0xe984082ccd7318ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8944 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.618619:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094f21e00/0xe984082ccd7318ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8944 expref: 28 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.618627:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594470272:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143772.618644:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143772.618652:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1965:x1830963594485120:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 598us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.618658:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7558 00000100:00100000:1.0:1746143772.622550:0:7150:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7150:1830963594470144:192.168.202.48@tcp:105: 00010000:00010000:1.0:1746143772.622569:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143772.622610:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594485376:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4279us (5212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.622620:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7560 00000100:00100000:2.0:1746143772.622782:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9890:1830963594470272:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143772.622805:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.622829:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594485504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4286us (4536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.622835:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7561 00000100:00100000:0.0:1746143772.624564:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.624663:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594485760 00000100:00100000:3.0:1746143772.624669:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594485760 00002000:00100000:3.0:1746143772.624701:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009ff6ce00 x1830963594485760/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.624709:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963594485760 ext(2097152->3145727) 00002000:00010000:3.0:1746143772.624713:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ce00 00000100:00100000:3.0:1746143772.624737:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6687 00000100:00100000:3.0:1746143772.624743:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594485760:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143772.630189:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.630563:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594486016 00000100:00100000:2.0:1746143772.630571:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594486016 00002000:00100000:2.0:1746143772.630603:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2387968->2392063) req@ffff88008efaea00 x1830963594486016/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.630612:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaea00 with x1830963594486016 ext(2387968->2392063) 00002000:00010000:2.0:1746143772.630616:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaea00 00000100:00100000:2.0:1746143772.630648:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6688 00000100:00100000:2.0:1746143772.630655:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594486016:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.630789:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594486016:12345-192.168.202.48@tcp:3:cat.0 Request processed in 134us (605us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143772.630795:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6688 00002000:00100000:2.0:1746143772.630800:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x358:0x0] (2387968->2392063) req@ffff88008efaea00 x1830963594486016/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/4536 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.630807:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008efaea00 with x1830963594486016 ext(2387968->2392063) 00002000:00010000:2.0:1746143772.630809:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008efaea00 00000100:00100000:2.0:1746143772.631817:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1964:x1830963594485760:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7071us (7255us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.631823:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6687 00002000:00100000:2.0:1746143772.631829:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff88009ff6ce00 x1830963594485760/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.631836:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ce00 with x1830963594485760 ext(2097152->3145727) 00002000:00010000:2.0:1746143772.631839:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6ce00 00000100:00100000:0.0:1746143772.636671:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.636731:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.637101:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594486272 00000100:00100000:2.0:1746143772.637109:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594486272 00002000:00100000:2.0:1746143772.637193:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2392064->3145727) req@ffff88009ff6ca80 x1830963594486272/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.637202:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963594486272 ext(2392064->3145727) 00000100:00100000:0.0:1746143772.637436:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.637504:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594486528 00000100:00100000:3.0:1746143772.637508:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594486528 00002000:00100000:3.0:1746143772.637526:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009ff6f480 x1830963594486528/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.637533:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963594486528 ext(3145728->4194303) 00002000:00010000:3.0:1746143772.637536:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6f480 00000100:00100000:3.0:1746143772.637549:0:25544:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594486784 00000100:00100000:3.0:1746143772.637551:0:25544:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594486784 00002000:00100000:3.0:1746143772.637559:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6d180 x1830963594486784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.637565:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d180 with x1830963594486784 ext(3145728->4194303) 00002000:00010000:3.0:1746143772.637567:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6d180 00000100:00100000:3.0:1746143772.637590:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6689 00000100:00100000:3.0:1746143772.637596:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1962:x1830963594486528:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:1.0:1746143772.637749:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6690 00000100:00100000:1.0:1746143772.637759:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594486784:12345-192.168.202.48@tcp:3:cat.0 00002000:00010000:2.0:1746143772.637922:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ca80 00000100:00100000:2.0:1746143772.637947:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6691 00000100:00100000:2.0:1746143772.637953:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1963:x1830963594486272:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:0.0:1746143772.639331:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.641445:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594487040 00000100:00100000:2.0:1746143772.641452:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594487040 00002000:00100000:2.0:1746143772.641484:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009ff6d500 x1830963594487040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.641494:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d500 with x1830963594487040 ext(4194304->4771839) 00002000:00010000:2.0:1746143772.641499:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6d500 00000100:00100000:2.0:1746143772.641514:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6692 00000100:00100000:2.0:1746143772.641520:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594487040:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.648369:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1963:x1830963594486272:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10408us (11696us total) trans 0 rc 753664/753664 00000100:00100000:2.0:1746143772.648379:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6691 00002000:00100000:2.0:1746143772.648389:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x358:0x0] (2392064->3145727) req@ffff88009ff6ca80 x1830963594486272/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.648398:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ca80 with x1830963594486272 ext(2392064->3145727) 00002000:00010000:2.0:1746143772.648403:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ca80 00000100:00100000:3.0:1746143772.652657:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+30:1962:x1830963594486528:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15053us (15917us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143772.652666:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6689 00002000:00100000:3.0:1746143772.652675:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88009ff6f480 x1830963594486528/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.652685:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6f480 with x1830963594486528 ext(3145728->4194303) 00000100:00100000:2.0:1746143772.652685:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1962:x1830963594487040:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11164us (13356us total) trans 0 rc 577536/577536 00002000:00010000:3.0:1746143772.652689:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6f480 00000100:00100000:2.0:1746143772.652697:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6692 00002000:00100000:2.0:1746143772.652702:0:8500:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88009ff6d500 x1830963594487040/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.652710:0:8500:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d500 with x1830963594487040 ext(4194304->4771839) 00002000:00010000:2.0:1746143772.652713:0:8500:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff6d500 00000100:00100000:2.0:1746143772.659365:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1963:x1830963594486784:12345-192.168.202.48@tcp:3:cat.0 Request processed in 21600us (21921us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.659375:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6690 00002000:00100000:2.0:1746143772.659384:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88009ff6d180 x1830963594486784/t0(0) o3->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.659393:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6d180 with x1830963594486784 ext(3145728->4194303) 00002000:00010000:2.0:1746143772.659399:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6d180 00000100:00100000:0.0:1746143772.672479:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.672517:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.672540:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.673045:0:14758:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594487424 00000100:00100000:3.0:1746143772.673053:0:14758:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594487424 00000100:00100000:3.0:1746143772.673090:0:14758:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 227 00000100:00100000:3.0:1746143772.673097:0:14758:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963594487424:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:3.0:1746143772.673182:0:14758:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1962:x1830963594487424:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 85us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143772.673188:0:14758:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 227 00000100:00100000:0.0:1746143772.673527:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.673556:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.673586:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.673798:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594487168 00000100:00100000:1.0:1746143772.673803:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594487168 00000100:00100000:1.0:1746143772.673828:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594487296 00000100:00100000:1.0:1746143772.673830:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594487296 00000100:00100000:1.0:1746143772.673841:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594487808 00000100:00100000:1.0:1746143772.673842:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594487808 00000100:00100000:1.0:1746143772.673855:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 390 00000100:00100000:1.0:1746143772.673860:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594487808:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143772.673891:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+11:1962:x1830963594487808:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.673896:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 390 00000100:00100000:1.0:1746143772.673906:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14113 00000100:00100000:1.0:1746143772.673910:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+29:1965:x1830963594487168:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.673918:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.673931:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8952 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.673948:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.673950:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143772.673956:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.673970:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 30 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.673979:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f20400, rc 0) 00000100:00100000:1.0:1746143772.673993:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594487168:12345-192.168.202.48@tcp:101:cat.0 Request processed in 83us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.673998:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14113 00000100:00100000:1.0:1746143772.674007:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14114 00000100:00100000:1.0:1746143772.674011:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594487296:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.674018:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.674025:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f20200/0xe984082ccd731904 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8959 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143772.674060:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594470400:192.168.202.48@tcp:106: 00000100:00100000:1.0:1746143772.674108:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.674154:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594487680 00000100:00100000:1.0:1746143772.674157:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594487680 00000100:00100000:1.0:1746143772.674174:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594487552 00000100:00100000:1.0:1746143772.674176:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594487552 00000100:00100000:1.0:1746143772.674188:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 240 00000100:00100000:1.0:1746143772.674193:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594487680:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143772.674218:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1962:x1830963594487680:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.674223:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 240 00000100:00100000:1.0:1746143772.674232:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 241 00000100:00100000:1.0:1746143772.674236:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1962:x1830963594487552:12345-192.168.202.48@tcp:400:kworker.0 00000100:00100000:1.0:1746143772.674254:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:1962:x1830963594487552:12345-192.168.202.48@tcp:400:kworker.0 Request processed in 18us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.674259:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 241 00002000:00010000:1.0:1746143772.678460:0:4582:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143772.678466:0:4582:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143772.678468:0:4582:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime: 1746143771 -> 1746143772 00000100:00100000:1.0:1746143772.678487:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594470400:192.168.202.48@tcp:106: 00010000:00010000:1.0:1746143772.678513:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f20200/0xe984082ccd731904 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8959 expref: 41 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.678524:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f20200/0xe984082ccd731904 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8959 expref: 41 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143772.678548:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f20200, rc 0) 00000100:00100000:1.0:1746143772.678594:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1965:x1830963594487296:12345-192.168.202.48@tcp:101:cat.0 Request processed in 4581us (6052us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143772.678601:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14114 00000100:00100000:0.0:1746143772.687367:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.688647:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594488064 00000100:00100000:2.0:1746143772.688654:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594488064 00002000:00100000:2.0:1746143772.688691:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012f185500 x1830963594488064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.688707:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185500 with x1830963594488064 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.688712:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185500 00000100:00100000:2.0:1746143772.688743:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6693 00000100:00100000:2.0:1746143772.688750:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594488064:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.698416:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:1964:x1830963594488064:12345-192.168.202.48@tcp:3:cat.0 Request processed in 9659us (11047us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.698426:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6693 00002000:00100000:2.0:1746143772.698435:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x357:0x0] (1048576->2097151) req@ffff88012f185500 x1830963594488064/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.698444:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185500 with x1830963594488064 ext(1048576->2097151) 00002000:00010000:2.0:1746143772.698448:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185500 00000100:00100000:2.0:1746143772.712403:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.712445:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594488320 00000100:00100000:0.0:1746143772.712454:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594488320 00002000:00100000:0.0:1746143772.712489:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a5c21c00 x1830963594488320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143772.712497:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21c00 with x1830963594488320 ext(2097152->3145727) 00002000:00010000:0.0:1746143772.712501:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21c00 00000100:00100000:0.0:1746143772.712521:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6694 00000100:00100000:0.0:1746143772.712528:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594488320:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.722754:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594488320:12345-192.168.202.48@tcp:3:cat.0 Request processed in 10218us (10350us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.722763:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6694 00002000:00100000:2.0:1746143772.722773:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x354:0x0] (2097152->3145727) req@ffff8800a5c21c00 x1830963594488320/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.722781:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5c21c00 with x1830963594488320 ext(2097152->3145727) 00002000:00010000:2.0:1746143772.722785:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5c21c00 00000100:00100000:0.0:1746143772.727476:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143772.727538:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594488448 00000100:00100000:1.0:1746143772.727545:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594488448 00000100:00100000:1.0:1746143772.727594:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14115 00000100:00100000:1.0:1746143772.727600:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+40:31669:x1830963594488448:12345-192.168.202.48@tcp:101:cat.0 00010000:00010000:1.0:1746143772.727616:0:4582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143772.727629:0:4582:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8960 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.727652:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.727658:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.727659:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143772.727662:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 41 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.727682:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 20 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.727691:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 20 pid: 8497 timeout: 951 lvb_type: 0 00000100:00100000:1.0:1746143772.727706:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594470528:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143772.727794:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a61a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143772.730085:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594470528:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143772.730109:0:4582:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 41 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143772.730133:0:4582:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f20800, rc 0) 00000100:00100000:1.0:1746143772.730193:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:31669:x1830963594488448:12345-192.168.202.48@tcp:101:cat.0 Request processed in 2592us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143772.730200:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14115 00000100:00100000:0.0:1746143772.730655:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.730782:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594488576 00000100:00100000:3.0:1746143772.730787:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594488576 00002000:00100000:3.0:1746143772.730816:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2392063) req@ffff88012f185180 x1830963594488576/t0(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.730824:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963594488576 ext(2097152->2392063) 00010000:00010000:3.0:1746143772.730829:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 21 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.730839:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 21 pid: 8497 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.730846:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f185180 00000100:00100000:3.0:1746143772.730858:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 1887 00000100:00100000:3.0:1746143772.730864:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+21:1964:x1830963594488576:12345-192.168.202.48@tcp:4:cat.0 00000100:00100000:3.0:1746143772.735622:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594488576:12345-192.168.202.48@tcp:4:cat.0 Request processed in 4751us (4960us total) trans 17179873247 rc 0/0 00000100:00100000:3.0:1746143772.735632:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 1887 00002000:00100000:3.0:1746143772.735642:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->2392063) req@ffff88012f185180 x1830963594488576/t17179873247(0) o4->d4afc09e-f58f-4113-b34a-e1dfb75458bd@192.168.202.48@tcp:168/0 lens 488/448 e 0 to 0 dl 1746143783 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.735650:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185180 with x1830963594488576 ext(2097152->2392063) 00010000:00010000:3.0:1746143772.735658:0:15923:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 23 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:3.0:1746143772.735672:0:15923:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 23 pid: 8497 timeout: 951 lvb_type: 0 00002000:00010000:3.0:1746143772.735679:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f185180 00000100:00100000:0.0:1746143772.743075:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.743221:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594488704 00000100:00100000:2.0:1746143772.743230:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594488704 00010000:00010000:2.0:1746143772.743384:0:9890:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 23 pid: 8497 timeout: 951 lvb_type: 0 00000100:00100000:2.0:1746143772.743431:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7562 00000100:00100000:2.0:1746143772.743439:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+23:1964:x1830963594488704:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143772.743450:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143772.743469:0:9890:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 23 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.743479:0:9890:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 23 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.743495:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e42200/0xe984082ccd7318f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2392063) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a894b expref: 23 pid: 8497 timeout: 951 lvb_type: 0 00010000:00010000:2.0:1746143772.743524:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.743525:0:9890:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143772.743531:0:9890:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 40 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.743537:0:9890:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 40 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143772.743561:0:9890:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 40 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143772.743571:0:9890:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594470656:192.168.202.48@tcp:105: 00000100:00100000:2.0:1746143772.743635:0:9890:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143772.747383:0:9890:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9890:1830963594470656:192.168.202.48@tcp:105: 00010000:00010000:2.0:1746143772.747403:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143772.747439:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5970050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1964:x1830963594488704:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 4000us (4372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143772.747449:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7562 00000100:00100000:0.0:1746143772.755809:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.755849:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143772.757071:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143772.757231:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594489088 00000100:00100000:3.0:1746143772.757238:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594489088 00002000:00100000:3.0:1746143772.757274:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012f185880 x1830963594489088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.757282:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185880 with x1830963594489088 ext(3145728->4194303) 00002000:00010000:3.0:1746143772.757286:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185880 00000100:00100000:3.0:1746143772.757298:0:15923:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594488960 00000100:00100000:3.0:1746143772.757304:0:15923:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594488960 00002000:00100000:3.0:1746143772.757311:0:15923:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012f187480 x1830963594488960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.757316:0:15923:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963594488960 ext(2097152->3145727) 00002000:00010000:3.0:1746143772.757318:0:15923:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187480 00000100:00100000:3.0:1746143772.757329:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594489472 00000100:00100000:3.0:1746143772.757331:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594489472 00002000:00100000:3.0:1746143772.757340:0:26145:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012f185c00 x1830963594489472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143772.757346:0:26145:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963594489472 ext(3145728->4194303) 00002000:00010000:3.0:1746143772.757348:0:26145:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:0.0:1746143772.758563:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6695 00000100:00100000:0.0:1746143772.758613:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594489088:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.758811:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6696 00000100:00100000:2.0:1746143772.758820:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+42:1965:x1830963594488960:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.760543:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6697 00000100:00100000:2.0:1746143772.760552:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594489472:12345-192.168.202.48@tcp:3:cat.0 00000100:00100000:2.0:1746143772.770020:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+43:1965:x1830963594489088:12345-192.168.202.48@tcp:3:cat.0 Request processed in 11439us (14207us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.770031:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6695 00002000:00100000:2.0:1746143772.770043:0:8501:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x358:0x0] (3145728->4194303) req@ffff88012f185880 x1830963594489088/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.770052:0:8501:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185880 with x1830963594489088 ext(3145728->4194303) 00002000:00010000:2.0:1746143772.770057:0:8501:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f185880 00000100:00100000:0.0:1746143772.773054:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+41:1965:x1830963594488960:12345-192.168.202.48@tcp:3:cat.0 Request processed in 14228us (17196us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143772.773064:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6696 00002000:00100000:0.0:1746143772.773072:0:25544:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x358:0x0] (2097152->3145727) req@ffff88012f187480 x1830963594488960/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143772.773081:0:25544:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f187480 with x1830963594488960 ext(2097152->3145727) 00002000:00010000:0.0:1746143772.773085:0:25544:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f187480 00000100:00100000:2.0:1746143772.775662:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1965:x1830963594489472:12345-192.168.202.48@tcp:3:cat.0 Request processed in 15106us (18586us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143772.775670:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6697 00002000:00100000:2.0:1746143772.775677:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (3145728->4194303) req@ffff88012f185c00 x1830963594489472/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.775685:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185c00 with x1830963594489472 ext(3145728->4194303) 00002000:00010000:2.0:1746143772.775688:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185c00 00000100:00100000:0.0:1746143772.785016:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143772.785085:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594489728 00000100:00100000:2.0:1746143772.785093:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594489728 00002000:00100000:2.0:1746143772.785167:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012f185f80 x1830963594489728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/0 e 0 to 0 dl 1746143783 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.785177:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185f80 with x1830963594489728 ext(4194304->4771839) 00002000:00010000:2.0:1746143772.785181:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185f80 00000100:00100000:2.0:1746143772.785200:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6698 00000100:00100000:2.0:1746143772.785206:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594489728:12345-192.168.202.48@tcp:3:cat.0 00010000:00010000:3.0:1746143772.791855:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143772.792220:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+30:1964:x1830963594489728:12345-192.168.202.48@tcp:3:cat.0 Request processed in 7007us (7204us total) trans 0 rc 577536/577536 00000100:00100000:2.0:1746143772.792228:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6698 00002000:00100000:2.0:1746143772.792237:0:3269:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x354:0x0] (4194304->4771839) req@ffff88012f185f80 x1830963594489728/t0(0) o3->20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054@192.168.202.48@tcp:168/0 lens 488/440 e 0 to 0 dl 1746143783 ref 1 fl Complete:/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143772.792245:0:3269:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f185f80 with x1830963594489728 ext(4194304->4771839) 00002000:00010000:2.0:1746143772.792249:0:3269:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f185f80 00000001:00080000:2.0:1746143773.186772:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840566 is committed 00000001:00080000:2.0:1746143773.186810:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840527 is committed 00000001:00080000:2.0:1746143773.186817:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840516 is committed 00000001:00080000:2.0:1746143773.186834:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840493 is committed 00000001:00080000:2.0:1746143773.186848:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840568 is committed 00000001:00080000:2.0:1746143773.186858:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840550 is committed 00000001:00080000:2.0:1746143773.186913:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840575 is committed 00000001:00080000:2.0:1746143773.186920:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840574 is committed 00000001:00080000:2.0:1746143773.186968:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840576 is committed 00000001:00080000:2.0:1746143773.186999:0:411:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840528 is committed 00000100:00100000:0.0:1746143773.294369:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594470784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143773.294430:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.294726:0:8498:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470784 00000100:00100000:2.0:1746143773.294734:0:8498:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470784 00000100:00100000:2.0:1746143773.294782:0:8498:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1746143773.294789:0:8498:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1830963594470784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746143773.294821:0:8498:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 623837184 pending 0 free 3852468224 avail 3850371072 00000100:00100000:2.0:1746143773.294954:0:8498:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1830963594470784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.294958:0:3292:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840568 gen 2 00000100:00100000:2.0:1746143773.294960:0:8498:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000004:00080000:0.0:1746143773.294963:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe6c700, transno 21474840482 00000004:00080000:0.0:1746143773.294978:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093805500, transno 21474840483 00000004:00080000:0.0:1746143773.294980:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe6ca80, transno 21474840484 00000004:00080000:0.0:1746143773.294982:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe6c000, transno 21474840485 00000004:00080000:0.0:1746143773.294985:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe6ce00, transno 21474840486 00000004:00080000:0.0:1746143773.294987:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe6c380, transno 21474840487 00000004:00080000:0.0:1746143773.294989:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fe6d180, transno 21474840488 00000004:00080000:0.0:1746143773.294991:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093804a80, transno 21474840489 00000004:00080000:0.0:1746143773.294995:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a0e00, transno 21474840490 00000004:00080000:0.0:1746143773.294997:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878700, transno 21474840494 00000004:00080000:0.0:1746143773.294999:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0879c00, transno 21474840495 00000004:00080000:0.0:1746143773.295001:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a087b480, transno 21474840496 00000004:00080000:0.0:1746143773.295002:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093805880, transno 21474840497 00000004:00080000:0.0:1746143773.295004:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093806d80, transno 21474840498 00000004:00080000:0.0:1746143773.295006:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878e00, transno 21474840499 00000004:00080000:0.0:1746143773.295008:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a087aa00, transno 21474840500 00000004:00080000:0.0:1746143773.295010:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0879180, transno 21474840501 00000004:00080000:0.0:1746143773.295012:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a087b800, transno 21474840502 00000004:00080000:0.0:1746143773.295015:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5ce300, transno 21474840506 00000004:00080000:0.0:1746143773.295017:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5ced80, transno 21474840507 00000004:00080000:0.0:1746143773.295018:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cea00, transno 21474840508 00000004:00080000:0.0:1746143773.295020:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cdf80, transno 21474840509 00000004:00080000:0.0:1746143773.295021:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cfb80, transno 21474840510 00000004:00080000:0.0:1746143773.295023:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cd880, transno 21474840511 00000004:00080000:0.0:1746143773.295026:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cc000, transno 21474840512 00000004:00080000:0.0:1746143773.295028:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cc380, transno 21474840513 00000004:00080000:0.0:1746143773.295029:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e5cf800, transno 21474840514 00000004:00080000:0.0:1746143773.295031:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459500, transno 21474840517 00000004:00080000:0.0:1746143773.295033:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445bb80, transno 21474840518 00000004:00080000:0.0:1746143773.295034:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459c00, transno 21474840519 00000004:00080000:0.0:1746143773.295036:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094458000, transno 21474840520 00000004:00080000:0.0:1746143773.295038:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094458380, transno 21474840521 00000004:00080000:0.0:1746143773.295039:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459880, transno 21474840522 00000004:00080000:0.0:1746143773.295041:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445aa00, transno 21474840523 00000004:00080000:0.0:1746143773.295042:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445b480, transno 21474840524 00000004:00080000:0.0:1746143773.295044:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093806680, transno 21474840525 00000004:00080000:0.0:1746143773.295046:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c10000, transno 21474840529 00000004:00080000:0.0:1746143773.295048:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c11c00, transno 21474840530 00000004:00080000:0.0:1746143773.295050:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c11f80, transno 21474840531 00000004:00080000:0.0:1746143773.295052:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c13800, transno 21474840532 00000004:00080000:0.0:1746143773.295054:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c10380, transno 21474840533 00000004:00080000:0.0:1746143773.295055:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c13100, transno 21474840534 00000004:00080000:0.0:1746143773.295057:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f533b80, transno 21474840535 00000004:00080000:0.0:1746143773.295059:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531f80, transno 21474840536 00000004:00080000:0.0:1746143773.295061:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c11180, transno 21474840537 00000004:00080000:0.0:1746143773.295062:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093806a00, transno 21474840538 00000004:00080000:0.0:1746143773.295064:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094458e00, transno 21474840539 00000004:00080000:0.0:1746143773.295066:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691b480, transno 21474840540 00000004:00080000:0.0:1746143773.295067:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094c12680, transno 21474840541 00000004:00080000:0.0:1746143773.295069:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094761c00, transno 21474840542 00000004:00080000:0.0:1746143773.295071:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093806300, transno 21474840543 00000004:00080000:0.0:1746143773.295072:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094459180, transno 21474840544 00000004:00080000:0.0:1746143773.295074:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009445ad80, transno 21474840545 00000004:00080000:0.0:1746143773.295076:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a087a300, transno 21474840546 00000004:00080000:0.0:1746143773.295077:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efadf80, transno 21474840551 00000004:00080000:0.0:1746143773.295079:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efad880, transno 21474840552 00000004:00080000:0.0:1746143773.295080:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efac700, transno 21474840553 00000004:00080000:0.0:1746143773.295082:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efafb80, transno 21474840554 00000004:00080000:0.0:1746143773.295083:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efae680, transno 21474840555 00000004:00080000:0.0:1746143773.295085:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efad180, transno 21474840556 00000004:00080000:0.0:1746143773.295086:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efadc00, transno 21474840557 00000004:00080000:0.0:1746143773.295088:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008efaca80, transno 21474840558 00000004:00080000:0.0:1746143773.295090:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130fd7480, transno 21474840559 00000004:00080000:0.0:1746143773.295092:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3b80, transno 21474840560 00000004:00080000:0.0:1746143773.295093:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a1f80, transno 21474840561 00000004:00080000:0.0:1746143773.295095:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a0700, transno 21474840562 00000004:00080000:0.0:1746143773.295096:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3800, transno 21474840563 00000004:00080000:0.0:1746143773.295098:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a0a80, transno 21474840564 00000004:00080000:0.0:1746143773.295100:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0878380, transno 21474840565 00000004:00080000:0.0:1746143773.295102:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a3100, transno 21474840566 00000004:00080000:0.0:1746143773.295104:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a63a1180, transno 21474840567 00000004:00080000:0.0:1746143773.295105:0:3292:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b79f800, transno 21474840568 00000100:00100000:0.0:1746143773.295125:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594470784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1746143773.295157:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746143773.295585:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 62 in progress, 0 in flight, 10 done 00000004:00080000:1.0:1746143773.295809:0:14800:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 62 done 00000100:00100000:2.0:1746143773.309571:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963594471040:0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.309612:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963594470912:0@lo:400:kworker.0 00000100:00100000:2.0:1746143773.309628:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143773.309690:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594471296:0@lo:400:kworker.0 00000100:00100000:3.0:1746143773.309739:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471040 00000100:00100000:3.0:1746143773.309745:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471040 00000100:00100000:3.0:1746143773.309786:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1746143773.309792:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963594471040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.309836:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.309857:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143773.309859:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963594471424:0@lo:400:kworker.0 00000100:00100000:2.0:1746143773.309864:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963594471168:0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.309876:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.309884:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.309900:0:14761:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594470912 00000100:00100000:1.0:1746143773.309902:0:14761:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594470912 00000100:00100000:2.0:1746143773.309909:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471424 00000100:00100000:2.0:1746143773.309913:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471424 00000100:00100000:1.0:1746143773.309920:0:14761:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1746143773.309925:0:14761:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963594470912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143773.309928:0:14763:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471168 00000100:00100000:2.0:1746143773.309930:0:14763:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471168 00000100:00100000:2.0:1746143773.309944:0:14763:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1746143773.309949:0:14763:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963594471424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.309949:0:14761:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136474c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b20e2be-dc58-49ff-81b7-9c0574412294+18:3293:x1830963594470912:12345-0@lo:400:kworker.0 Request processed in 23us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.309954:0:14761:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1746143773.309976:0:14763:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1830963594471424:12345-0@lo:400:kworker.0 Request processed in 27us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.309981:0:14763:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1746143773.309985:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1746143773.309991:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963594471168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.310014:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1830963594471168:12345-0@lo:400:kworker.0 Request processed in 24us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.310018:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1746143773.310030:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3294:1830963594471168:0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.310035:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b20e2be-dc58-49ff-81b7-9c0574412294:3293:1830963594470912:0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.310042:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3293:1830963594471424:0@lo:400:kworker.0 00000100:00100000:0.0:1746143773.310091:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143773.310121:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143773.310248:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1830963594471040:12345-0@lo:400:kworker.0 Request processed in 456us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.310254:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1746143773.310304:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3294:1830963594471040:0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.310394:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471296 00000100:00100000:1.0:1746143773.310397:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471296 00000100:00080000:0.0:1746143773.310445:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143773.310463:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1746143773.310467:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3292:x1830963594471296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143773.310497:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3292:x1830963594471296:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.310501:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1746143773.310549:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594471296:0@lo:400:kworker.0 00000100:00100000:0.0:1746143773.318719:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.318898:0:14765:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594489984 00000100:00100000:3.0:1746143773.318906:0:14765:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594489984 00000100:00100000:3.0:1746143773.318945:0:14765:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4047 00000100:00100000:3.0:1746143773.318951:0:14765:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+27:31691:x1830963594489984:12345-192.168.202.48@tcp:35:umount.0 00000100:00100000:3.0:1746143773.319201:0:14765:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31691:x1830963594489984:12345-192.168.202.48@tcp:35:umount.0 Request processed in 248us (488us total) trans 8589943707 rc 0/0 00000100:00100000:3.0:1746143773.319207:0:14765:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4047 00000100:00100000:0.0:1746143773.324489:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.324666:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594490240 00000100:00100000:2.0:1746143773.324673:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594490240 00000100:00100000:2.0:1746143773.324757:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4048 00000100:00100000:2.0:1746143773.324764:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:31691:x1830963594490240:12345-192.168.202.48@tcp:35:umount.0 00000100:00100000:3.0:1746143773.325212:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143773.325223:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594471552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746143773.325253:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143773.325276:0:8499:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594471552 00000100:00100000:3.0:1746143773.325278:0:8499:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594471552 00000100:00100000:3.0:1746143773.325296:0:8499:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1746143773.325300:0:8499:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3295:x1830963594471552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746143773.325320:0:8499:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 644153344 pending 28966912 free 3853516800 avail 3851419648 00000100:00100000:3.0:1746143773.325341:0:8499:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3295:x1830963594471552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.325346:0:8499:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1746143773.325373:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594471552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143773.325815:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:31691:x1830963594490240:12345-192.168.202.48@tcp:35:umount.0 Request processed in 1051us (1334us total) trans 8589943708 rc 0/0 00000100:00100000:2.0:1746143773.325821:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4048 00000100:00100000:0.0:1746143773.328733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.328834:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594490496 00000100:00100000:2.0:1746143773.328841:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594490496 00000100:00100000:2.0:1746143773.329111:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 759 00000100:00100000:2.0:1746143773.329127:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1965:x1830963594490496:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.329179:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.329195:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5805c00/0xe984082ccd72706a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a23ee expref: 15 pid: 14761 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.329208:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.329248:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+14:1965:x1830963594490496:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 122us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.329255:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 759 00000100:00100000:0.0:1746143773.329472:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.330042:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.330265:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594490752 00000100:00100000:3.0:1746143773.330269:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594490752 00000100:00100000:3.0:1746143773.330299:0:9890:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594490880 00000100:00100000:3.0:1746143773.330301:0:9890:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594490880 00000100:00100000:3.0:1746143773.330317:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 760 00000100:00100000:3.0:1746143773.330322:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+15:1964:x1830963594490752:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.330329:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.330338:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5804400/0xe984082ccd727071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2418 expref: 15 pid: 14761 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.330353:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.330372:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+14:1964:x1830963594490752:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 49us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.330377:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 760 00000100:00100000:3.0:1746143773.330387:0:9890:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 761 00000100:00100000:3.0:1746143773.330391:0:9890:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+13:1965:x1830963594490880:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.330396:0:9890:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.330403:0:9890:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5805e00/0xe984082ccd727078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a241f expref: 13 pid: 14758 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.330409:0:9890:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.330421:0:9890:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008efad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f57a9f-bfb8-4cdc-bf57-fb307e561160+12:1965:x1830963594490880:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.330426:0:9890:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 761 00000100:00100000:0.0:1746143773.331327:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.331467:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594491136 00000100:00100000:1.0:1746143773.331471:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594491136 00000100:00100000:1.0:1746143773.331506:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14116 00000100:00100000:1.0:1746143773.331511:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+22:1961:x1830963594491136:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:1.0:1746143773.331531:0:4582:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd72708d 00000020:00010000:1.0:1746143773.331536:0:4582:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880094a81000: total 0 00000100:00080000:1.0:1746143773.331539:0:4582:0:(import.c:66:import_set_state_nolock()) ffff880094a84800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143773.331682:0:4582:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873247 00000100:00100000:1.0:1746143773.331844:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+20:1961:x1830963594491136:12345-192.168.202.48@tcp:9:umount.0 Request processed in 331us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.331849:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14116 00000020:00010000:3.0:1746143773.331959:0:9889:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880094a81000: total 0 00010000:00010000:3.0:1746143773.331982:0:9889:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880094a81000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746143773.332017:0:9889:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800930b0e00/0xe984082ccd731863 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88fe expref: 19 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.332037:0:9889:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d93200/0xe984082ccd7271ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a24f8 expref: 18 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.332053:0:9889:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6800/0xe984082ccd73185c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f7 expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.332060:0:9889:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880094a81000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746143773.332069:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143773.332071:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143773.332072:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143773.348716:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.349469:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594491648 00000100:00100000:2.0:1746143773.349478:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594491648 00000100:00100000:2.0:1746143773.349530:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14117 00000100:00100000:2.0:1746143773.349536:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+8:1961:x1830963594491648:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:2.0:1746143773.349562:0:4582:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd727086 00000020:00010000:2.0:1746143773.349568:0:4582:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880094a81800: total 0 00000100:00080000:2.0:1746143773.349571:0:4582:0:(import.c:66:import_set_state_nolock()) ffff880094a84000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746143773.349611:0:4582:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840576 00000100:00100000:2.0:1746143773.349820:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d4afc09e-f58f-4113-b34a-e1dfb75458bd+6:1961:x1830963594491648:12345-192.168.202.48@tcp:9:umount.0 Request processed in 283us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.349826:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14117 00000020:00010000:0.0:1746143773.350010:0:7152:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880094a81800: total 0 00010000:00010000:0.0:1746143773.350014:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143773.350036:0:7152:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880094a81800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1746143773.350074:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f21e00/0xe984082ccd7318ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8944 expref: 5 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.350101:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b7200/0xe984082ccd731840 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88db expref: 4 pid: 8497 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746143773.350124:0:7152:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746143773.350132:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f046800/0xe984082ccd731871 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a890c expref: 3 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.350167:0:7152:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880094a81800, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1746143773.350176:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143773.350177:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143773.350179:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143773.359733:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.360665:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594492032 00000100:00100000:3.0:1746143773.360674:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594492032 00000100:00100000:3.0:1746143773.360720:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9344 00000100:00100000:3.0:1746143773.360726:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+29:1961:x1830963594492032:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:3.0:1746143773.360753:0:20509:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd72707f 00000020:00010000:3.0:1746143773.360760:0:20509:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880094a85800: total 0 00000100:00080000:3.0:1746143773.360765:0:20509:0:(import.c:66:import_set_state_nolock()) ffff880094a87000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143773.360797:0:20509:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943708 00000020:00010000:2.0:1746143773.361174:0:7153:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880094a85800: total 0 00010000:00010000:2.0:1746143773.361214:0:7153:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880094a85800, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1746143773.361238:0:7153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143773.361241:0:7153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143773.361247:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368a3a00/0xe984082ccd731506 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86d5 expref: 28 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.361280:0:7153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143773.361282:0:7153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143773.361285:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800930b0400/0xe984082ccd73182b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88d4 expref: 27 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.361297:0:7153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143773.361299:0:7153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143773.361301:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7c00/0xe984082ccd731514 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86e3 expref: 26 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.361314:0:7153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143773.361316:0:7153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143773.361319:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6346e00/0xe984082ccd7315a7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8761 expref: 25 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.361329:0:7153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:2.0:1746143773.361331:0:7153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746143773.361334:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0xe984082ccd727143 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a24c7 expref: 24 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.361345:0:7153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143773.361346:0:7153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143773.361350:0:7153:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594d000/0xe984082ccd731824 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88cd expref: 23 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.361358:0:7153:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880094a85800, canceled 6 locks, left on hash table 0. 00010000:00010000:2.0:1746143773.361368:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143773.361370:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143773.361371:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143773.362458:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d4afc09e-f58f-4113-b34a-e1dfb75458bd+28:1961:x1830963594492032:12345-192.168.202.48@tcp:39:umount.0 Request processed in 334us (1334us total) trans 8589943709 rc 0/0 00000100:00100000:3.0:1746143773.362470:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9344 00000001:00080000:2.0:1746143773.693291:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873237 is committed 00000001:00080000:2.0:1746143773.693317:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873200 is committed 00000001:00080000:2.0:1746143773.693324:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873169 is committed 00000001:00100000:2.0:1746143773.693333:0:2149:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d4afc09e-f58f-4113-b34a-e1dfb75458bd 00000001:00080000:2.0:1746143773.693350:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873224 is committed 00000001:00080000:2.0:1746143773.693357:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873219 is committed 00000001:00080000:2.0:1746143773.693384:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873245 is committed 00000001:00080000:2.0:1746143773.693391:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873244 is committed 00000001:00080000:2.0:1746143773.693407:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873240 is committed 00000001:00080000:2.0:1746143773.693447:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873247 is committed 00000001:00080000:2.0:1746143773.693452:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873246 is committed 00000020:00000080:2.0:1746143773.693478:0:2149:0:(genops.c:904:class_export_put()) final put ffff880094a81000/d4afc09e-f58f-4113-b34a-e1dfb75458bd 00000001:00080000:2.0:1746143773.693497:0:2149:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873201 is committed 00000020:00000080:3.0:1746143773.693555:0:19617:0:(genops.c:863:class_export_destroy()) destroying export ffff880094a81000/d4afc09e-f58f-4113-b34a-e1dfb75458bd for lustre-OST0001 00000020:00000080:3.0:1746143773.693595:0:19617:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880094a84800 for lustre-OST0001 00000100:00100000:0.0:1746143773.774461:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.774500:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.774530:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.774578:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.774614:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594492160 00000100:00100000:0.0:1746143773.774621:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594492160 00000100:00100000:0.0:1746143773.774657:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594492416 00000100:00100000:0.0:1746143773.774659:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594492416 00000100:00100000:3.0:1746143773.774665:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594492544 00000100:00100000:3.0:1746143773.774669:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594492544 00000100:00100000:0.0:1746143773.774671:0:7151:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594492288 00000100:00100000:0.0:1746143773.774673:0:7151:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594492288 00000100:00100000:0.0:1746143773.774685:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 762 00000100:00100000:3.0:1746143773.774690:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14118 00000100:00100000:0.0:1746143773.774691:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+14:1962:x1830963594492160:12345-192.168.202.48@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143773.774695:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1961:x1830963594492544:12345-192.168.202.48@tcp:9:umount.0 00010000:00010000:0.0:1746143773.774702:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1746143773.774717:0:12618:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd7270b7 00010000:00010000:0.0:1746143773.774718:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800950d0400/0xe984082ccd727094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2449 expref: 14 pid: 14758 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143773.774723:0:12618:0:(import.c:66:import_set_state_nolock()) ffff88012e88c000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1746143773.774733:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1746143773.774745:0:12618:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179873247 00000100:00100000:0.0:1746143773.774767:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+13:1962:x1830963594492160:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 76us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.774773:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 762 00000100:00100000:0.0:1746143773.774788:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 763 00000100:00100000:0.0:1746143773.774792:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+12:1962:x1830963594492416:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143773.774797:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143773.774803:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012b144e00/0xe984082ccd7270a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a247a expref: 12 pid: 14758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.774810:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143773.774820:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+11:1962:x1830963594492416:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.774824:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 763 00000100:00100000:0.0:1746143773.774830:0:7151:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 764 00000100:00100000:0.0:1746143773.774833:0:7151:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+10:1962:x1830963594492288:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143773.774837:0:7151:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143773.774842:0:7151:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012b145200/0xe984082ccd72709b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a2473 expref: 10 pid: 14758 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.774847:0:7151:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143773.774855:0:7151:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013691a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f57a9f-bfb8-4cdc-bf57-fb307e561160+9:1962:x1830963594492288:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 21us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143773.774859:0:7151:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 764 00000100:00100000:3.0:1746143773.774936:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+2:1961:x1830963594492544:12345-192.168.202.48@tcp:9:umount.0 Request processed in 240us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.774941:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14118 00010000:00010000:3.0:1746143773.774957:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143773.781438:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.781569:0:4582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594492672 00000100:00100000:3.0:1746143773.781578:0:4582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594492672 00000100:00100000:3.0:1746143773.781625:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14119 00000100:00100000:3.0:1746143773.781632:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+5:1961:x1830963594492672:12345-192.168.202.48@tcp:9:umount.0 00000020:00000080:3.0:1746143773.781658:0:4582:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd7270b0 00000100:00080000:3.0:1746143773.781665:0:4582:0:(import.c:66:import_set_state_nolock()) ffff880094a80800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143773.781712:0:4582:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474840576 00010000:00010000:2.0:1746143773.781748:0:9889:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143773.782018:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+2:1961:x1830963594492672:12345-192.168.202.48@tcp:9:umount.0 Request processed in 382us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.782025:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14119 00000100:00100000:0.0:1746143773.791949:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.792036:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594492928 00000100:00100000:3.0:1746143773.792043:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594492928 00000100:00100000:3.0:1746143773.792091:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9345 00000100:00100000:3.0:1746143773.792098:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+8:1961:x1830963594492928:12345-192.168.202.48@tcp:39:umount.0 00000020:00000080:3.0:1746143773.792134:0:20509:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xe984082ccd7270a9 00000020:00010000:3.0:1746143773.792166:0:20509:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008ec4a800: total 0 00000100:00080000:3.0:1746143773.792170:0:20509:0:(import.c:66:import_set_state_nolock()) ffff88008ec4b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143773.792184:0:20509:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589943709 00000020:00010000:0.0:1746143773.792247:0:7152:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008ec4a800: total 0 00010000:00010000:0.0:1746143773.792281:0:7152:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008ec4a800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746143773.792305:0:7152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800939cd500) 00010000:00010000:0.0:1746143773.792309:0:7152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746143773.792315:0:7152:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093369200/0xe984082ccd7270c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a24a4 expref: 7 pid: 21713 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.792328:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84b8b890-8fbc-4d51-8d7e-7b3d585fe88e+6:1961:x1830963594492928:12345-192.168.202.48@tcp:39:umount.0 Request processed in 230us (385us total) trans 8589943710 rc 0/0 00000100:00100000:3.0:1746143773.792334:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9345 00010000:00010000:0.0:1746143773.792335:0:7152:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008ec4a800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746143773.792343:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143773.792344:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143773.792346:0:7152:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143773.793493:0:7153:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143773.823885:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.823972:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594493184 00000100:00100000:2.0:1746143773.823979:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594493184 00000100:00100000:2.0:1746143773.824026:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4049 00000100:00100000:2.0:1746143773.824033:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b3a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+256:31713:x1830963594493184:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:2.0:1746143773.824716:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b3a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31713:x1830963594493184:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 681us (837us total) trans 8589943711 rc 0/0 00000100:00100000:2.0:1746143773.824723:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4049 00000100:00100000:0.0:1746143773.826735:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.827683:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594493440 00000100:00100000:3.0:1746143773.827691:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594493440 00000100:00100000:3.0:1746143773.827854:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9346 00000100:00100000:3.0:1746143773.827862:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31713:x1830963594493440:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143773.827880:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.827882:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746143773.827904:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f046e00/0xe984082ccd731886 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2d9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a891a expref: 257 pid: 2976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.827922:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a594c800/0xe984082ccd7317e5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88a3 expref: 256 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.827930:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143773.827933:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143773.827941:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135181400/0xe984082ccd731912 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8967 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.828015:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135180000/0xe984082ccd731919 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143773.828024:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135180000/0xe984082ccd731919 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143773.828031:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135180000/0xe984082ccd731919 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:3.0:1746143773.828039:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00010000:00010000:3.0:1746143773.828152:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135181400/0xe984082ccd731912 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8967 expref: 258 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.828164:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135180000/0xe984082ccd731919 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8967 expref: 257 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.828170:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143773.828172:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143773.828175:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135180000, rc 0) 00000100:00100000:3.0:1746143773.828859:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31713:x1830963594493440:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 996us (2131us total) trans 8589943712 rc 0/0 00000100:00100000:3.0:1746143773.828865:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9346 00000100:00100000:0.0:1746143773.831036:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.831357:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.831370:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.831605:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.831746:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.831767:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594493568 00000100:00100000:1.0:1746143773.831775:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594493568 00000100:00100000:1.0:1746143773.831807:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594493696 00000100:00100000:1.0:1746143773.831810:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594493696 00000100:00100000:1.0:1746143773.831819:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594493824 00000100:00100000:1.0:1746143773.831821:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594493824 00000100:00100000:1.0:1746143773.831829:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594493952 00000100:00100000:1.0:1746143773.831830:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594493952 00000100:00100000:1.0:1746143773.831844:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14120 00000100:00100000:1.0:1746143773.831850:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594493568:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143773.831890:0:12618:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.831964:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14121 00000100:00100000:3.0:1746143773.831968:0:4582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14122 00000100:00100000:2.0:1746143773.831971:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594493696:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:3.0:1746143773.831974:0:4582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1962:x1830963594493824:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:3.0:1746143773.831987:0:4582:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.831987:0:8497:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.831996:0:4582:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.831996:0:8497:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.832003:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.832003:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.832004:0:4582:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.832004:0:8497:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.832007:0:4582:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.832007:0:8497:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.832027:0:4582:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 22 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.832027:0:8497:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 22 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.832038:0:4582:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 22 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:2.0:1746143773.832038:0:8497:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 22 pid: 8497 timeout: 952 lvb_type: 0 00000100:00100000:3.0:1746143773.832048:0:4582:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594471808:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143773.832048:0:8497:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594471680:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143773.832190:0:4582:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0480 going to sleep for 11 seconds 00010000:00010000:1.0:1746143773.832192:0:12618:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 17 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.832198:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.832199:0:12618:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.832201:0:12618:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.832202:0:8495:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494080 00000100:00100000:3.0:1746143773.832204:0:8495:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494080 00010000:00010000:1.0:1746143773.832216:0:12618:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 18 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.832221:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14123 00010000:00010000:1.0:1746143773.832223:0:12618:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 18 pid: 8497 timeout: 952 lvb_type: 0 00000100:00100000:3.0:1746143773.832225:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594493952:12345-192.168.202.48@tcp:1:lfs.0 00000100:00100000:1.0:1746143773.832232:0:12618:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594471936:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143773.832238:0:8495:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.832246:0:8495:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.832250:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.832251:0:8495:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.832253:0:8495:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.832265:0:8495:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 18 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.832272:0:8495:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 18 pid: 4582 timeout: 952 lvb_type: 0 00000100:00100000:3.0:1746143773.832279:0:8495:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594472064:192.168.202.48@tcp:104: 00000100:00100000:3.0:1746143773.832304:0:8495:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800955d0600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.832305:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14124 00000100:00100000:2.0:1746143773.832311:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594494080:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:2.0:1746143773.832325:0:21542:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.832334:0:21542:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.832344:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.832345:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.832347:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.832360:0:21542:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 18 pid: 4582 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.832368:0:21542:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 18 pid: 4582 timeout: 952 lvb_type: 1 00000100:00100000:2.0:1746143773.832381:0:21542:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594472192:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.832382:0:12618:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.832399:0:21542:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f42540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143773.832406:0:8497:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.832501:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.832626:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494208 00000100:00100000:1.0:1746143773.832630:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494208 00000100:00100000:1.0:1746143773.832659:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14125 00000100:00100000:1.0:1746143773.832664:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594494208:12345-192.168.202.48@tcp:1:lfs.0 00010000:00010000:1.0:1746143773.832679:0:4581:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.832687:0:4581:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.832693:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.832694:0:4581:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.832696:0:4581:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.832708:0:4581:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 23 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.832715:0:4581:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 23 pid: 4582 timeout: 952 lvb_type: 0 00000100:00100000:1.0:1746143773.832723:0:4581:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594472320:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.832755:0:4581:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.834312:0:4582:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093502d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4582:1830963594471808:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143773.834330:0:4582:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.834613:0:12618:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12618:1830963594471936:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143773.834626:0:12618:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.834700:0:8497:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8497:1830963594471680:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143773.834710:0:8497:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.834790:0:21542:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21542:1830963594472192:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143773.834799:0:21542:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.834870:0:8495:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8495:1830963594472064:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143773.834879:0:8495:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.839350:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.839377:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.839401:0:4581:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4581:1830963594472320:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143773.839420:0:4581:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.839866:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.839975:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.839988:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494464 00000100:00100000:2.0:1746143773.839994:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494464 00010000:00010000:2.0:1746143773.840021:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 24 pid: 8497 timeout: 952 lvb_type: 0 00000100:00100000:2.0:1746143773.840042:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494592 00000100:00100000:2.0:1746143773.840044:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494592 00010000:00010000:2.0:1746143773.840055:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 19 pid: 4582 timeout: 952 lvb_type: 0 00000100:00100000:3.0:1746143773.840178:0:11106:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494720 00000100:00100000:3.0:1746143773.840181:0:11106:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494720 00010000:00010000:3.0:1746143773.840195:0:11106:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 20 pid: 8497 timeout: 952 lvb_type: 0 00000100:00100000:0.0:1746143773.840462:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.840476:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494336 00000100:00100000:2.0:1746143773.840479:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494336 00010000:00010000:2.0:1746143773.840491:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 25 pid: 4582 timeout: 952 lvb_type: 1 00000100:00100000:2.0:1746143773.840506:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7563 00000100:00100000:2.0:1746143773.840511:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1963:x1830963594494464:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.840522:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.840539:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 25 pid: 8497 timeout: 952 lvb_type: 0 00010000:00010000:2.0:1746143773.840548:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 25 pid: 8497 timeout: 952 lvb_type: 0 00010000:00010000:2.0:1746143773.840565:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5b6000/0xe984082ccd731855 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88f0 expref: 25 pid: 8497 timeout: 952 lvb_type: 0 00010000:00010000:2.0:1746143773.840580:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.840582:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.840585:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.840597:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.840618:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.840648:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1963:x1830963594494464:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 136us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.840653:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7563 00000100:00100000:2.0:1746143773.840687:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7564 00000100:00100000:2.0:1746143773.840691:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963594494592:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143773.840697:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.840708:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 20 pid: 4582 timeout: 952 lvb_type: 0 00010000:00010000:2.0:1746143773.840716:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 20 pid: 4582 timeout: 952 lvb_type: 0 00010000:00010000:2.0:1746143773.840727:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f046200/0xe984082ccd73186a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8905 expref: 20 pid: 4582 timeout: 952 lvb_type: 0 00010000:00010000:2.0:1746143773.840735:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.840736:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.840739:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.840744:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.840761:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143773.840817:0:23335:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7565 00000100:00100000:1.0:1746143773.840824:0:23335:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594494720:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.840831:0:23335:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.840840:0:23335:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 19 pid: 8497 timeout: 952 lvb_type: 0 00010000:00010000:1.0:1746143773.840847:0:23335:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 19 pid: 8497 timeout: 952 lvb_type: 0 00010000:00010000:1.0:1746143773.840856:0:23335:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5b6a00/0xe984082ccd731808 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a88bf expref: 19 pid: 8497 timeout: 952 lvb_type: 0 00010000:00010000:1.0:1746143773.840867:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.840869:0:23335:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.840871:0:23335:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.840876:0:23335:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.840887:0:23335:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.841013:0:11106:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7566 00000100:00100000:3.0:1746143773.841021:0:11106:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594494336:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.841028:0:11106:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143773.841035:0:11106:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:3.0:1746143773.841039:0:11106:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 23 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.841046:0:11106:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 23 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.841055:0:11106:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f046a00/0xe984082ccd731878 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8913 expref: 23 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.841071:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.841072:0:11106:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.841074:0:11106:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841080:0:11106:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841090:0:11106:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143773.841413:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1963:x1830963594494592:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 720us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.841413:0:23335:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594494720:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 589us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.841418:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7564 00000100:00100000:1.0:1746143773.841420:0:23335:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7565 00000100:00100000:2.0:1746143773.841427:0:7150:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494848 00000100:00100000:2.0:1746143773.841430:0:7150:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494848 00010000:00010000:2.0:1746143773.841438:0:7150:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 17 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:1.0:1746143773.841448:0:12618:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.841449:0:7150:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7567 00000100:00100000:2.0:1746143773.841453:0:7150:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1962:x1830963594494848:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143773.841455:0:12618:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841458:0:7150:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143773.841465:0:7150:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 17 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:2.0:1746143773.841471:0:7150:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 17 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:1.0:1746143773.841471:0:12618:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.841478:0:12618:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841480:0:7150:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f20400/0xe984082ccd7318fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8952 expref: 17 pid: 4582 timeout: 952 lvb_type: 1 00010000:00010000:1.0:1746143773.841484:0:12618:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841487:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.841488:0:7150:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.841489:0:12618:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f21400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143773.841491:0:7150:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.841492:0:12618:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.841499:0:12618:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841500:0:7150:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.841506:0:12618:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841510:0:7150:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143773.841515:0:12618:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f21400/0xe984082ccd731927 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12618 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.841522:0:7150:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594494848:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 69us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.841526:0:7150:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7567 00010000:00010000:2.0:1746143773.841542:0:21542:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.841545:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1962:x1830963594493568:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 9695us (10513us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143773.841548:0:21542:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.841550:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14120 00010000:00010000:2.0:1746143773.841558:0:21542:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841564:0:21542:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841569:0:21542:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841573:0:21542:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bb7400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143773.841576:0:21542:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841585:0:21542:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841592:0:21542:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841597:0:21542:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bb7400/0xe984082ccd731943 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.841629:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+14:1962:x1830963594494080:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 9318us (9883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.841634:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14124 00010000:00010000:2.0:1746143773.841652:0:8497:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.841662:0:8497:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.841691:0:11106:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594494336:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 673us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.841696:0:11106:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7566 00010000:00010000:3.0:1746143773.841712:0:8495:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841717:0:8495:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841728:0:8495:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.841733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143773.841734:0:8495:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841739:0:8495:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841749:0:8495:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d5f2000 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143773.841751:0:8495:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841757:0:8495:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841765:0:8495:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841769:0:8495:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d5f2000/0xe984082ccd73193c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.841795:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+13:1962:x1830963594493952:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 9569us (10190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.841800:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14123 00000100:00100000:3.0:1746143773.841814:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594494976 00000100:00100000:3.0:1746143773.841816:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594494976 00010000:00010000:3.0:1746143773.841826:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 22 pid: 4582 timeout: 952 lvb_type: 0 00000100:00100000:3.0:1746143773.841844:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7568 00000100:00100000:3.0:1746143773.841849:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594494976:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.841855:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.841866:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 22 pid: 4582 timeout: 952 lvb_type: 0 00010000:00010000:3.0:1746143773.841874:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 22 pid: 4582 timeout: 952 lvb_type: 0 00010000:00010000:3.0:1746143773.841883:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f20800/0xe984082ccd73190b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8960 expref: 22 pid: 4582 timeout: 952 lvb_type: 0 00010000:00010000:3.0:1746143773.841890:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.841892:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.841894:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841899:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841924:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.841952:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1965:x1830963594494976:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.841961:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7568 00010000:00010000:3.0:1746143773.841980:0:4582:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841986:0:4582:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.841999:0:4582:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.842008:0:4582:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.842014:0:4582:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.842018:0:4582:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135180a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143773.842021:0:4582:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.842026:0:4582:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.842034:0:4582:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.842040:0:4582:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135180a00/0xe984082ccd73192e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4582 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.842062:0:8497:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.842068:0:8497:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.842072:0:4582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1962:x1830963594493824:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10098us (10701us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143773.842074:0:8497:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.842077:0:4582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14122 00010000:00010000:2.0:1746143773.842083:0:8497:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e8b600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143773.842085:0:8497:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.842090:0:8497:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.842098:0:8497:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.842104:0:8497:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e8b600/0xe984082ccd731935 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.842154:0:4581:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.842157:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1962:x1830963594493696:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 10187us (10800us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143773.842160:0:4581:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.842162:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14121 00010000:00010000:1.0:1746143773.842171:0:4581:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.842176:0:4581:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.842181:0:4581:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.842186:0:4581:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f20a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143773.842192:0:4581:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.842198:0:4581:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.842206:0:4581:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.842212:0:4581:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f20a00/0xe984082ccd73194a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4581 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.842239:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1962:x1830963594494208:12345-192.168.202.48@tcp:1:lfs.0 Request processed in 9574us (9738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.842245:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14125 00000100:00100000:0.0:1746143773.847918:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.848012:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594495232 00000100:00100000:3.0:1746143773.848019:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594495232 00000100:00100000:3.0:1746143773.848066:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9347 00000100:00100000:3.0:1746143773.848072:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+257:31713:x1830963594495232:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:3.0:1746143773.848125:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746143773.848172:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347200/0xe984082ccd7315d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a876f expref: 257 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.848189:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6347000/0xe984082ccd73150d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a86dc expref: 256 pid: 14763 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.848197:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143773.848201:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143773.848224:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143773.848233:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:3.0:1746143773.848240:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000040:00080000:3.0:1746143773.848777:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2786, 88 off235712 00000004:00080000:3.0:1746143773.848784:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852858644274ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.848836:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2791, 88 off236328 00000004:00080000:3.0:1746143773.848841:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852858701216ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143773.848859:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2792, 88 off236416 00000004:00080000:3.0:1746143773.848862:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852858722011ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143773.848869:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2787, 88 off235800 00000004:00080000:3.0:1746143773.848871:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852858731634ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.848879:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2788, 88 off235888 00000004:00080000:3.0:1746143773.848882:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852858742268ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.848889:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2793, 88 off236504 00000004:00080000:3.0:1746143773.848892:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852858752536ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143773.848898:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2794, 88 off236592 00000004:00080000:3.0:1746143773.848901:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852858761771ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143773.849826:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2795, 88 off236680 00000004:00080000:3.0:1746143773.849832:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852859691831ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143773.849919:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2789, 88 off235976 00000004:00080000:3.0:1746143773.849923:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852859783061ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.850019:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2796, 88 off236768 00000004:00080000:3.0:1746143773.850023:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852859883231ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143773.850032:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2790, 88 off236064 00000004:00080000:3.0:1746143773.850034:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852859894404ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.850040:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2797, 88 off236856 00000004:00080000:3.0:1746143773.850043:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852859902843ns, next at 833304778357ns, rc = 0 00000040:00080000:3.0:1746143773.850048:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2791, 88 off236152 00000004:00080000:3.0:1746143773.850051:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852859911103ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.850056:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2792, 88 off236240 00000004:00080000:3.0:1746143773.850059:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852859919111ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.850065:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2793, 88 off236328 00000004:00080000:3.0:1746143773.850067:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852859927601ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.850073:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2794, 88 off236416 00000004:00080000:3.0:1746143773.850076:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 852859935957ns, next at 788202887869ns, rc = 0 00000040:00080000:3.0:1746143773.850081:0:20509:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2798, 88 off236944 00000004:00080000:3.0:1746143773.850084:0:20509:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 852859944078ns, next at 833304778357ns, rc = 0 00000001:00080000:0.0:1746143773.873711:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943705 is committed 00000001:00080000:0.0:1746143773.873722:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943688 is committed 00000001:00080000:0.0:1746143773.873730:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943711 is committed 00000001:00080000:0.0:1746143773.873734:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943708 is committed 00000001:00080000:0.0:1746143773.873756:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943693 is committed 00000001:00080000:0.0:1746143773.873783:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943713 is committed 00000004:00080000:0.0:1746143773.873786:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2133 committed 00000004:00080000:0.0:1746143773.873793:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2129 committed 00000004:00080000:0.0:1746143773.873797:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2128 committed 00000004:00010000:2.0:1746143773.873798:0:20509:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880090767b80 reply state ffff88012f00dc00 transno 8589943713 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00080000:0.0:1746143773.873800:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2127 committed 00000004:00080000:0.0:1746143773.873801:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2126 committed 00000004:00080000:0.0:1746143773.873802:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2132 committed 00000004:00080000:0.0:1746143773.873804:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2125 committed 00000004:00080000:0.0:1746143773.873805:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2131 committed 00000004:00080000:0.0:1746143773.873806:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2124 committed 00000004:00080000:0.0:1746143773.873808:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2130 committed 00000004:00080000:0.0:1746143773.873809:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2129 committed 00000004:00080000:0.0:1746143773.873810:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2128 committed 00000004:00080000:0.0:1746143773.873812:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2123 committed 00000004:00080000:0.0:1746143773.873814:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2122 committed 00000004:00080000:0.0:1746143773.873815:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2127 committed 00000004:00080000:0.0:1746143773.873816:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2126 committed 00000004:00080000:0.0:1746143773.873818:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2121 committed 00000001:00100000:0.0:1746143773.873823:0:14831:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84b8b890-8fbc-4d51-8d7e-7b3d585fe88e 00000001:00080000:0.0:1746143773.873827:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943710 is committed 00000020:00000080:0.0:1746143773.873829:0:14831:0:(genops.c:904:class_export_put()) final put ffff88008ec4a800/84b8b890-8fbc-4d51-8d7e-7b3d585fe88e 00000001:00100000:0.0:1746143773.873838:0:14831:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d4afc09e-f58f-4113-b34a-e1dfb75458bd 00000001:00080000:0.0:1746143773.873843:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943709 is committed 00000020:00000080:0.0:1746143773.873851:0:14831:0:(genops.c:904:class_export_put()) final put ffff880094a85800/d4afc09e-f58f-4113-b34a-e1dfb75458bd 00000100:00100000:2.0:1746143773.873857:0:20509:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143773.873943:0:20509:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143773.873957:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31713:x1830963594495232:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 25881us (26042us total) trans 8589943713 rc 0/0 00000100:00100000:2.0:1746143773.873964:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9347 00010000:00010000:2.0:1746143773.873991:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.874002:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.874007:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.874012:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d5f3600 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143773.874015:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.874020:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00000020:00000080:3.0:1746143773.874025:0:30469:0:(genops.c:863:class_export_destroy()) destroying export ffff88008ec4a800/84b8b890-8fbc-4d51-8d7e-7b3d585fe88e for lustre-MDT0000 00010000:00010000:2.0:1746143773.874031:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143773.874033:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143773.874036:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.874040:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d5f3600/0xe984082ccd731951 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000020:00000080:3.0:1746143773.874063:0:30469:0:(genops.c:863:class_export_destroy()) destroying export ffff880094a85800/d4afc09e-f58f-4113-b34a-e1dfb75458bd for lustre-MDT0000 00000100:00100000:1.0:1746143773.874299:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594472704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143773.874339:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874377:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143773.874392:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874402:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143773.874415:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874435:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594474240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143773.874450:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874465:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746143773.874469:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594472576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143773.874483:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874493:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143773.874503:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874512:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143773.874526:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874540:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594474112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143773.874554:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143773.874578:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472704 00000100:00100000:1.0:1746143773.874584:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472704 00000100:00100000:1.0:1746143773.874608:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473216 00000100:00100000:1.0:1746143773.874610:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473216 00000100:00100000:1.0:1746143773.874620:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473728 00000100:00100000:1.0:1746143773.874622:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473728 00000100:00100000:1.0:1746143773.874631:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474240 00000100:00100000:1.0:1746143773.874633:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474240 00000100:00100000:1.0:1746143773.874642:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472576 00000100:00100000:1.0:1746143773.874644:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472576 00000100:00100000:1.0:1746143773.874650:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473088 00000100:00100000:1.0:1746143773.874651:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473088 00000100:00100000:1.0:1746143773.874656:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473600 00000100:00100000:1.0:1746143773.874657:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473600 00000100:00100000:1.0:1746143773.874663:0:4581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474112 00000100:00100000:1.0:1746143773.874664:0:4581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474112 00000100:00100000:1.0:1746143773.874672:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14126 00000100:00100000:1.0:1746143773.874678:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3293:x1830963594472704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143773.874800:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594472448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143773.874822:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874832:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594472960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143773.874844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874850:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143773.874863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874869:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008eface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143773.874881:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874889:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746143773.874893:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594472832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143773.874905:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874912:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143773.874923:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874930:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143773.874941:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874948:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594474368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143773.874960:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.874977:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472448 00000100:00100000:2.0:1746143773.874980:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472448 00000100:00100000:2.0:1746143773.874992:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472960 00000100:00100000:2.0:1746143773.874993:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472960 00000100:00100000:2.0:1746143773.874999:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473472 00000100:00100000:2.0:1746143773.875001:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473472 00000100:00100000:2.0:1746143773.875006:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473984 00000100:00100000:2.0:1746143773.875007:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473984 00000100:00100000:2.0:1746143773.875012:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594472832 00000100:00100000:2.0:1746143773.875014:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594472832 00000100:00100000:2.0:1746143773.875019:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473344 00000100:00100000:2.0:1746143773.875020:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473344 00000100:00100000:2.0:1746143773.875026:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594473856 00000100:00100000:2.0:1746143773.875028:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594473856 00000100:00100000:2.0:1746143773.875032:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474368 00000100:00100000:2.0:1746143773.875033:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474368 00000100:00100000:2.0:1746143773.875040:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14127 00000100:00100000:2.0:1746143773.875045:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594473216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143773.875205:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594473216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (811us total) trans 17179873248 rc 0/0 00000100:00100000:2.0:1746143773.875211:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14127 00000100:00100000:2.0:1746143773.875222:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14128 00000100:00100000:2.0:1746143773.875227:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594473728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143773.875369:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594473728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (952us total) trans 21474840577 rc 0/0 00000100:00100000:2.0:1746143773.875375:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14128 00000100:00100000:2.0:1746143773.875383:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14129 00000100:00100000:2.0:1746143773.875387:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594474240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143773.875457:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594474240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (1006us total) trans 21474840578 rc 0/0 00000100:00100000:2.0:1746143773.875462:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14129 00000100:00100000:2.0:1746143773.875471:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14130 00000100:00100000:2.0:1746143773.875475:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594472576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143773.875560:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594472576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1076us total) trans 17179873249 rc 0/0 00000100:00100000:2.0:1746143773.875565:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14130 00000100:00100000:2.0:1746143773.875574:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14131 00000100:00100000:2.0:1746143773.875577:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594473088:12345-0@lo:2:osp-syn-1-0.0 00000020:00000080:3.0:1746143773.875685:0:30469:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88008ec4b000 for lustre-MDT0000 00000020:00000080:3.0:1746143773.875689:0:30469:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880094a87000 for lustre-MDT0000 00000100:00100000:3.0:1746143773.875709:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14132 00000100:00100000:3.0:1746143773.875714:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3293:x1830963594473600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143773.875817:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594473600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (1289us total) trans 21474840579 rc 0/0 00000100:00100000:0.0:1746143773.875918:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14133 00000100:00100000:3.0:1746143773.875924:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14132 00000100:00100000:0.0:1746143773.875926:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594474112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143773.875935:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14134 00000100:00100000:3.0:1746143773.875940:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594472448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143773.876021:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594474112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1465us total) trans 21474840580 rc 0/0 00000100:00100000:0.0:1746143773.876027:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14133 00000100:00100000:3.0:1746143773.876033:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594472448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (1209us total) trans 17179873250 rc 0/0 00000100:00100000:3.0:1746143773.876038:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14134 00000100:00100000:0.0:1746143773.876120:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14135 00000100:00100000:0.0:1746143773.876127:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594472960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143773.876158:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3293:x1830963594472704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1479us (1818us total) trans 17179873251 rc 0/0 00000100:00100000:1.0:1746143773.876164:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14126 00000100:00100000:1.0:1746143773.876174:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14136 00000100:00100000:1.0:1746143773.876179:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594473472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143773.876224:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594472960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (1378us total) trans 17179873252 rc 0/0 00000100:00100000:0.0:1746143773.876229:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14135 00000100:00100000:0.0:1746143773.876240:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14137 00000100:00100000:0.0:1746143773.876244:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594473984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143773.876275:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594473472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1410us total) trans 21474840581 rc 0/0 00000100:00100000:1.0:1746143773.876280:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14136 00000100:00100000:3.0:1746143773.876319:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14138 00000100:00100000:0.0:1746143773.876319:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594473984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1436us total) trans 21474840582 rc 0/0 00000100:00100000:3.0:1746143773.876324:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594472832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143773.876324:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14137 00000100:00100000:0.0:1746143773.876334:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14139 00000100:00100000:0.0:1746143773.876338:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830963594473344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143773.876387:0:8495:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746143773.876390:0:8495:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143773.876392:0:8495:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143773.876394:0:8495:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:3.0:1746143773.876396:0:8495:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746143773.876415:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594472832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1509us total) trans 17179873253 rc 0/0 00000100:00100000:0.0:1746143773.876415:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594473344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1490us total) trans 17179873254 rc 0/0 00000100:00100000:3.0:1746143773.876420:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14138 00000100:00100000:0.0:1746143773.876432:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14139 00000100:00100000:3.0:1746143773.876435:0:8495:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14140 00000100:00100000:3.0:1746143773.876439:0:8495:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594473856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143773.876515:0:8495:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594473856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1572us total) trans 21474840583 rc 0/0 00000100:00100000:3.0:1746143773.876519:0:8495:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14140 00000100:00100000:1.0:1746143773.876817:0:4581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14141 00000100:00100000:1.0:1746143773.876822:0:4581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830963594474368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143773.876898:0:4581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3295:x1830963594474368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1936us total) trans 21474840584 rc 0/0 00000100:00100000:1.0:1746143773.876902:0:4581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14141 00000100:00100000:0.0:1746143773.876939:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.877178:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3293:x1830963594473088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1599us (2673us total) trans 17179873255 rc 0/0 00000100:00100000:2.0:1746143773.877183:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14131 00000100:00100000:2.0:1746143773.877239:0:3293:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873240 gen 2 00000004:00080000:2.0:1746143773.877243:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c274e00, transno 17179873170 00000004:00080000:2.0:1746143773.877249:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c275f80, transno 17179873171 00000004:00080000:2.0:1746143773.877252:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c275180, transno 17179873172 00000004:00080000:2.0:1746143773.877254:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca6c700, transno 17179873173 00000004:00080000:2.0:1746143773.877256:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c274000, transno 17179873174 00000004:00080000:2.0:1746143773.877258:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca6d500, transno 17179873175 00000004:00080000:2.0:1746143773.877260:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c274700, transno 17179873176 00000004:00080000:2.0:1746143773.877262:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fc27100, transno 17179873177 00000004:00080000:2.0:1746143773.877264:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c276300, transno 17179873181 00000004:00080000:2.0:1746143773.877266:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814e00, transno 17179873182 00000004:00080000:2.0:1746143773.877267:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c275c00, transno 17179873183 00000004:00080000:2.0:1746143773.877269:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0815180, transno 17179873184 00000004:00080000:2.0:1746143773.877272:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a1880, transno 17179873185 00000004:00080000:2.0:1746143773.877274:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814380, transno 17179873186 00000004:00080000:2.0:1746143773.877276:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800935a2300, transno 17179873187 00000004:00080000:2.0:1746143773.877277:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0815f80, transno 17179873188 00000004:00080000:2.0:1746143773.877280:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cea00, transno 17179873191 00000004:00080000:2.0:1746143773.877281:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cd880, transno 17179873192 00000004:00080000:2.0:1746143773.877283:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ee300, transno 17179873193 00000004:00080000:2.0:1746143773.877285:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1efb80, transno 17179873194 00000004:00080000:2.0:1746143773.877288:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ce680, transno 17179873195 00000004:00080000:2.0:1746143773.877290:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7cc380, transno 17179873196 00000004:00080000:2.0:1746143773.877292:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ec700, transno 17179873197 00000004:00080000:2.0:1746143773.877294:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b7ced80, transno 17179873198 00000004:00080000:2.0:1746143773.877296:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094762a00, transno 17179873202 00000004:00080000:2.0:1746143773.877297:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136919180, transno 17179873203 00000004:00080000:2.0:1746143773.877299:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136918380, transno 17179873204 00000004:00080000:2.0:1746143773.877301:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691b100, transno 17179873205 00000004:00080000:2.0:1746143773.877303:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ec380, transno 17179873206 00000004:00080000:2.0:1746143773.877304:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013691bb80, transno 17179873207 00000004:00080000:2.0:1746143773.877306:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136918e00, transno 17179873208 00000004:00080000:2.0:1746143773.877308:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f1ee680, transno 17179873209 00000004:00080000:2.0:1746143773.877311:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531180, transno 17179873210 00000004:00080000:2.0:1746143773.877312:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f533100, transno 17179873211 00000004:00080000:2.0:1746143773.877315:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530380, transno 17179873212 00000004:00080000:2.0:1746143773.877317:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530000, transno 17179873213 00000004:00080000:2.0:1746143773.877319:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530700, transno 17179873214 00000004:00080000:2.0:1746143773.877321:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f532300, transno 17179873215 00000004:00080000:2.0:1746143773.877323:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f530e00, transno 17179873216 00000004:00080000:2.0:1746143773.877325:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f531880, transno 17179873217 00000004:00080000:2.0:1746143773.877327:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83b80, transno 17179873225 00000004:00080000:2.0:1746143773.877329:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d81880, transno 17179873226 00000004:00080000:2.0:1746143773.877330:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83800, transno 17179873227 00000004:00080000:2.0:1746143773.877332:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80a80, transno 17179873228 00000004:00080000:2.0:1746143773.877334:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d81f80, transno 17179873229 00000004:00080000:2.0:1746143773.877336:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80700, transno 17179873230 00000004:00080000:2.0:1746143773.877338:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d82300, transno 17179873231 00000004:00080000:2.0:1746143773.877339:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d81180, transno 17179873232 00000004:00080000:2.0:1746143773.877341:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3ca300, transno 17179873233 00000004:00080000:2.0:1746143773.877344:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0817100, transno 17179873234 00000004:00080000:2.0:1746143773.877345:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0817800, transno 17179873235 00000004:00080000:2.0:1746143773.877347:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814a80, transno 17179873236 00000004:00080000:2.0:1746143773.877350:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0814700, transno 17179873237 00000004:00080000:2.0:1746143773.877352:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0815880, transno 17179873238 00000004:00080000:2.0:1746143773.877354:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3c9180, transno 17179873239 00000004:00080000:2.0:1746143773.877356:0:3293:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0816d80, transno 17179873240 00000100:00100000:2.0:1746143773.877361:0:3293:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008efac700 x1830963594472576/t17179873249(17179873249) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143789 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746143773.877369:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efac700/2, rc 0, transno 17179873249 00000100:00100000:2.0:1746143773.877372:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594472576:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877381:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efaca80/2, rc 0, transno 17179873255 00000100:00100000:2.0:1746143773.877384:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473088:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877394:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efaf480/2, rc 0, transno 21474840579 00000100:00100000:2.0:1746143773.877400:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473600:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143773.877406:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0380/2, rc 0, transno 21474840580 00000100:00100000:2.0:1746143773.877409:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594474112:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143773.877415:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efae680/2, rc 0, transno 17179873251 00000100:00100000:2.0:1746143773.877417:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594472704:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877424:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efae300/2, rc 0, transno 17179873248 00000100:00100000:2.0:1746143773.877426:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473216:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877432:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efaed80/2, rc 0, transno 21474840577 00000100:00100000:2.0:1746143773.877434:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594473728:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143773.877440:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe2d80/2, rc 0, transno 21474840578 00000100:00100000:2.0:1746143773.877443:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594474240:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143773.877460:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efad180/2, rc 0, transno 17179873253 00000100:00100000:2.0:1746143773.877463:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594472832:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877468:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efaf100/2, rc 0, transno 17179873254 00000100:00100000:2.0:1746143773.877470:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473344:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877476:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efaf800/2, rc 0, transno 21474840583 00000100:00100000:2.0:1746143773.877478:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473856:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143773.877483:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe0e00/2, rc 0, transno 21474840584 00000100:00100000:2.0:1746143773.877486:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594474368:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143773.877492:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efafb80/2, rc 0, transno 17179873250 00000100:00100000:2.0:1746143773.877494:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594472448:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877501:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efadc00/2, rc 0, transno 17179873252 00000100:00100000:2.0:1746143773.877504:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594472960:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143773.877509:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008efad880/2, rc 0, transno 21474840581 00000100:00100000:2.0:1746143773.877511:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008efad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143773.877516:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008eface00/2, rc 0, transno 21474840582 00000100:00100000:2.0:1746143773.877519:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008eface00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594473984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143773.877675:0:14804:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 56 done 00000100:00100000:1.0:1746143773.878326:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594495360 00000100:00100000:1.0:1746143773.878331:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594495360 00000100:00100000:1.0:1746143773.878365:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9348 00000100:00100000:1.0:1746143773.878370:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31713:x1830963594495360:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.878382:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.878394:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a896e expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.878439:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.878452:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 242 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.878467:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143773.878470:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143773.878472:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d8800, rc 0) 00000100:00100000:3.0:1746143773.878482:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143773.878492:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594474496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143773.878512:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31713:x1830963594495360:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 139us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.878516:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9348 00000100:00100000:3.0:1746143773.878520:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143773.878643:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594474496 00000100:00100000:2.0:1746143773.878647:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594474496 00000100:00100000:2.0:1746143773.878676:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14142 00000100:00100000:2.0:1746143773.878682:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3294:x1830963594474496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143773.878838:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3294:x1830963594474496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (316us total) trans 21474840585 rc 0/0 00000100:00100000:2.0:1746143773.878843:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14142 00000004:00080000:3.0:1746143773.878916:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bfe3b80/2, rc 0, transno 21474840585 00000100:00100000:3.0:1746143773.878920:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bfe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594474496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143773.882515:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.882578:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594495488 00000100:00100000:1.0:1746143773.882584:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594495488 00000100:00100000:1.0:1746143773.882627:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9349 00000100:00100000:1.0:1746143773.882634:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31713:x1830963594495488:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.882650:0:20509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.882664:0:20509:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd73195f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8975 expref: -99 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.882730:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd731966 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143773.882751:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd731966 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143773.882760:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd731966 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00200000:1.0:1746143773.882786:0:20509:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x2d9:0x0]: returning size 8965856 00000004:00200000:1.0:1746143773.882789:0:20509:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746143773.882800:0:20509:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd731966 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143773.882820:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8600/0xe984082ccd73195f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8975 expref: 244 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.882833:0:20509:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd731966 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8975 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.882840:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143773.882842:0:20509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143773.882845:0:20509:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d8200, rc 0) 00000100:00100000:1.0:1746143773.882890:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31713:x1830963594495488:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 256us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.882896:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9349 00000100:00100000:0.0:1746143773.884874:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.884983:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594495616 00000100:00100000:2.0:1746143773.884989:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594495616 00000100:00100000:2.0:1746143773.885028:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14143 00000100:00100000:2.0:1746143773.885034:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+13:1963:x1830963594495616:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143773.885045:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.885057:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a897c expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143773.885260:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x351:0x0] initial LVB size: 1048576, mtime: 0x68140a1b, atime: 0x68140a1b, ctime: 0x68140a1b, blocks: 0x80f 00010000:00010000:2.0:1746143773.885276:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.885277:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.885284:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.885297:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 14 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.885306:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5546c00, rc 0) 00000100:00100000:2.0:1746143773.885335:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+14:1963:x1830963594495616:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 302us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.885341:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14143 00000100:00100000:0.0:1746143773.885529:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.885598:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.885609:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594495744 00000100:00100000:3.0:1746143773.885614:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594495744 00000100:00100000:3.0:1746143773.885632:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594495872 00000100:00100000:3.0:1746143773.885634:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594495872 00000100:00100000:3.0:1746143773.885668:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14144 00000100:00100000:3.0:1746143773.885673:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594495744:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:2.0:1746143773.885674:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14145 00000100:00100000:2.0:1746143773.885680:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1963:x1830963594495872:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143773.885681:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143773.885686:0:25369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.885691:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8983 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.885694:0:25369:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a898a expref: -99 pid: 25369 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143773.885704:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x356:0x0] initial LVB size: 2097152, mtime: 0x68140a1c, atime: 0x68140a1b, ctime: 0x68140a1b, blocks: 0x821 00002000:00010000:2.0:1746143773.885706:0:25369:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x357:0x0] initial LVB size: 2097152, mtime: 0x68140a1c, atime: 0x68140a1b, ctime: 0x68140a1c, blocks: 0x821 00010000:00010000:2.0:1746143773.885713:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.885714:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.885715:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.885715:0:25369:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.885719:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.885719:0:25369:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.885729:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 21 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.885729:0:25369:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 21 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143773.885735:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff96600, rc 0) 00010000:00010000:2.0:1746143773.885736:0:25369:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5547400, rc 0) 00000100:00100000:3.0:1746143773.885756:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594495744:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.885763:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594495872:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.885764:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14144 00000100:00100000:1.0:1746143773.885766:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.885771:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14145 00000100:00100000:3.0:1746143773.885775:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594496000 00000100:00100000:3.0:1746143773.885777:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594496000 00000100:00100000:3.0:1746143773.885789:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14146 00000100:00100000:1.0:1746143773.885792:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.885793:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+14:1963:x1830963594496000:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:3.0:1746143773.885799:0:15784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143773.885801:0:21542:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594496128 00000100:00100000:2.0:1746143773.885804:0:21542:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594496128 00010000:00010000:3.0:1746143773.885805:0:15784:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8991 expref: -99 pid: 15784 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.885821:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14147 00002000:00010000:3.0:1746143773.885822:0:15784:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x353:0x0] initial LVB size: 2097152, mtime: 0x68140a1c, atime: 0x68140a1b, ctime: 0x68140a1c, blocks: 0x821 00000100:00100000:2.0:1746143773.885825:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+15:1962:x1830963594496128:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:1.0:1746143773.885828:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00010000:00010000:3.0:1746143773.885829:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.885830:0:15784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.885830:0:21542:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143773.885835:0:15784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143773.885837:0:21542:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a8998 expref: -99 pid: 21542 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.885843:0:15784:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 16 pid: 15784 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143773.885843:0:9527:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594496256 00000100:00100000:1.0:1746143773.885846:0:9527:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594496256 00002000:00010000:2.0:1746143773.885847:0:21542:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x354:0x0] initial LVB size: 4771552, mtime: 0x68140a1c, atime: 0x68140a1c, ctime: 0x68140a1c, blocks: 0x14a9 00010000:00010000:3.0:1746143773.885850:0:15784:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff97800, rc 0) 00010000:00010000:2.0:1746143773.885854:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.885855:0:21542:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.885858:0:21542:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143773.885862:0:9527:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14148 00010000:00010000:2.0:1746143773.885865:0:21542:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143773.885867:0:9527:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1963:x1830963594496256:12345-192.168.202.48@tcp:101:lfs.0 00000100:00100000:3.0:1746143773.885869:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1963:x1830963594496000:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 75us (103us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143773.885870:0:21542:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136bb6200, rc 0) 00010000:00010000:1.0:1746143773.885873:0:9527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143773.885874:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14146 00010000:00010000:1.0:1746143773.885881:0:9527:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a899f expref: -99 pid: 9527 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.885886:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1962:x1830963594496128:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 60us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143773.885890:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14147 00002000:00010000:1.0:1746143773.885892:0:9527:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x358:0x0] initial LVB size: 4194304, mtime: 0x68140a1c, atime: 0x68140a1c, ctime: 0x68140a1c, blocks: 0x1029 00010000:00010000:1.0:1746143773.885899:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.885900:0:9527:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.885905:0:9527:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 21 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.885914:0:9527:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 21 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.885920:0:9527:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941d8e00, rc 0) 00000100:00100000:1.0:1746143773.886019:0:9527:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1963:x1830963594496256:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 150us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.886024:0:9527:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14148 00000100:00100000:0.0:1746143773.895509:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.895636:0:3269:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594496512 00000100:00100000:2.0:1746143773.895644:0:3269:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594496512 00000100:00100000:2.0:1746143773.895707:0:3269:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6699 00000100:00100000:2.0:1746143773.895714:0:3269:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594496512:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143773.895749:0:3269:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.895762:0:3269:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.895763:0:3269:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.895768:0:3269:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.895779:0:3269:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.900185:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.900212:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.900224:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.900250:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.900328:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594496768 00000100:00100000:1.0:1746143773.900336:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594496768 00000100:00100000:1.0:1746143773.900378:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594496896 00000100:00100000:1.0:1746143773.900379:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594496896 00000100:00100000:1.0:1746143773.900392:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594497280 00000100:00100000:1.0:1746143773.900394:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594497280 00000100:00100000:1.0:1746143773.900405:0:8500:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594497408 00000100:00100000:1.0:1746143773.900407:0:8500:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594497408 00000100:00100000:1.0:1746143773.900421:0:8500:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6700 00000100:00100000:1.0:1746143773.900427:0:8500:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594496768:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143773.900455:0:8500:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.900467:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.900468:0:8500:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.900472:0:8500:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.900483:0:8500:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.900592:0:31338:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6701 00000100:00100000:0.0:1746143773.900599:0:31338:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594496896:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:0.0:1746143773.900614:0:31338:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.900622:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.900624:0:31338:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143773.900626:0:31338:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.900635:0:31338:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.900689:0:31339:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6702 00000100:00100000:1.0:1746143773.900695:0:31339:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594497280:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143773.900709:0:31339:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.900716:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.900717:0:31339:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.900719:0:31339:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.900727:0:31339:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.901869:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.901889:0:26145:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594497792 00000100:00100000:3.0:1746143773.901893:0:26145:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594497792 00000100:00100000:3.0:1746143773.901920:0:26145:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6703 00000100:00100000:3.0:1746143773.901925:0:26145:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1964:x1830963594497408:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:3.0:1746143773.901942:0:26145:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.901949:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.901950:0:26145:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.901954:0:26145:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.901961:0:26145:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.902713:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143773.902733:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143773.902803:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594498176 00000100:00100000:2.0:1746143773.902807:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594498176 00000100:00100000:2.0:1746143773.902826:0:8501:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594498304 00000100:00100000:2.0:1746143773.902828:0:8501:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594498304 00000100:00100000:2.0:1746143773.902839:0:8501:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6704 00000100:00100000:2.0:1746143773.902844:0:8501:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594497792:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143773.902858:0:8501:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.902866:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.902867:0:8501:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.902870:0:8501:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.902879:0:8501:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.903016:0:25544:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6705 00000100:00100000:1.0:1746143773.903024:0:25544:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1964:x1830963594498176:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:1.0:1746143773.903040:0:25544:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.903047:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.903048:0:25544:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.903051:0:25544:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.903059:0:25544:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.903353:0:15923:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 6706 00000100:00100000:2.0:1746143773.903359:0:15923:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594498304:12345-192.168.202.48@tcp:3:lfs.0 00010000:00010000:2.0:1746143773.903372:0:15923:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.903380:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.903381:0:15923:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143773.903384:0:15923:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.903391:0:15923:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.916096:0:3269:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.916125:0:3269:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.916133:0:3269:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.916155:0:3269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bb6400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143773.916159:0:3269:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.916167:0:3269:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.916183:0:3269:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.916189:0:3269:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bb6400/0xe984082ccd731997 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3269 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.916284:0:3269:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594496512:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 20566us (20776us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.916293:0:3269:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6699 00010000:00010000:3.0:1746143773.924231:0:26145:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.924245:0:26145:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.924253:0:26145:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.924259:0:26145:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff96c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:3.0:1746143773.924263:0:26145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.924270:0:26145:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.924285:0:26145:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.924296:0:26145:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff96c00/0xe984082ccd7319b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26145 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.924370:0:26145:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+20:1964:x1830963594497408:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 22441us (24116us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143773.924379:0:26145:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6703 00010000:00010000:2.0:1746143773.924542:0:31338:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.924550:0:31338:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.924555:0:31338:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.924559:0:31338:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095133c00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:2.0:1746143773.924561:0:31338:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.924566:0:31338:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.924574:0:31338:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143773.924579:0:31338:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095133c00/0xe984082ccd7319a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143773.924631:0:31338:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+27:1964:x1830963594496896:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 24033us (24418us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143773.924637:0:31338:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6701 00010000:00010000:1.0:1746143773.927099:0:8501:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.927122:0:8501:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.927129:0:8501:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.927134:0:8501:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bb7400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143773.927137:0:8501:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.927177:0:8501:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.927189:0:8501:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.927193:0:8501:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136bb7400/0xe984082ccd7319ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.927248:0:8501:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+25:1965:x1830963594497792:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 24401us (25380us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.927253:0:8501:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6704 00010000:00010000:0.0:1746143773.935383:0:15923:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.935398:0:15923:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.935406:0:15923:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.935411:0:15923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bb7a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143773.935415:0:15923:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.935421:0:15923:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.935437:0:15923:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.935448:0:15923:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bb7a00/0xe984082ccd7319c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15923 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.935522:0:15923:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1964:x1830963594498304:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 32159us (32784us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143773.935530:0:15923:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6706 00010000:00010000:1.0:1746143773.939768:0:31339:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.939783:0:31339:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.939791:0:31339:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.939796:0:31339:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d9a00 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143773.939800:0:31339:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.939807:0:31339:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.939823:0:31339:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.939834:0:31339:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941d9a00/0xe984082ccd7319ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31339 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.939905:0:31339:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594497280:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 39206us (39675us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.939913:0:31339:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6702 00010000:00010000:0.0:1746143773.944183:0:8500:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.944472:0:8500:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.944479:0:8500:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.944485:0:8500:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800941d8600 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:0.0:1746143773.944488:0:8500:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.944496:0:8500:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.944513:0:8500:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143773.944519:0:8500:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941d8600/0xe984082ccd73199e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143773.944595:0:8500:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594496768:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 44163us (44414us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143773.944604:0:8500:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6700 00010000:00010000:1.0:1746143773.947504:0:25544:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947516:0:25544:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947523:0:25544:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947529:0:25544:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880000061400 already unused, calling callback (ffffffffa0870d70) 00010000:00010000:1.0:1746143773.947532:0:25544:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947539:0:25544:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947552:0:25544:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.947558:0:25544:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880000061400/0xe984082ccd7319c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25544 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143773.947623:0:25544:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594498176:12345-192.168.202.48@tcp:3:lfs.0 Request processed in 44597us (44907us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143773.947631:0:25544:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 6705 00000100:00100000:0.0:1746143773.957363:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.957434:0:20509:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594498560 00000100:00100000:1.0:1746143773.957441:0:20509:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594498560 00000100:00100000:1.0:1746143773.957478:0:20509:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9350 00000100:00100000:1.0:1746143773.957485:0:20509:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31713:x1830963594498560:12345-192.168.202.48@tcp:36:lfs.0 00010000:00010000:1.0:1746143773.957526:0:20509:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143773.957546:0:20509:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8200/0xe984082ccd731966 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8975 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.957575:0:20509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143773.957579:0:20509:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143773.957607:0:20509:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143773.957616:0:20509:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:1.0:1746143773.957624:0:20509:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000004:00010000:1.0:1746143773.957757:0:20509:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094459500 reply state ffff88009caad000 transno 8589943714 ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20509 initiator: MDT0 00000100:00100000:1.0:1746143773.957763:0:20509:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746143773.957819:0:20509:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:31713:x1830963594498560:12345-192.168.202.48@tcp:36:lfs.0 Request processed in 334us (462us total) trans 8589943714 rc 0/0 00000100:00100000:1.0:1746143773.957827:0:20509:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9350 00010000:00010000:2.0:1746143773.959378:0:3279:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.959387:0:3279:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.959392:0:3279:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.959397:0:3279:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880000061000 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143773.959400:0:3279:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.959406:0:3279:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.959416:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143773.959418:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143773.959420:0:3279:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00010000:00010000:2.0:1746143773.959425:0:3279:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880000061000/0xe984082ccd7319cf lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20509 initiator: MDT0 00000100:00100000:0.0:1746143773.960782:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.961253:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594498688 00000100:00100000:1.0:1746143773.961259:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594498688 00000100:00100000:1.0:1746143773.961295:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14149 00000100:00100000:1.0:1746143773.961302:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31713:x1830963594498688:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.961315:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.961333:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7319d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a89a6 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.961355:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.961371:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.961373:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.961376:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7319d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89a6 expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.961402:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.961412:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00000100:00100000:1.0:1746143773.961423:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594474624:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.961498:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.965255:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594474624:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143773.965281:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7319d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89a6 expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.965293:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c200, rc 0) 00000100:00100000:1.0:1746143773.965337:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31713:x1830963594498688:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 4035us (4560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.965344:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14149 00000100:00100000:0.0:1746143773.965460:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.965694:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594498816 00000100:00100000:3.0:1746143773.965700:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594498816 00010000:00010000:3.0:1746143773.965721:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00000100:00100000:3.0:1746143773.965738:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7569 00000100:00100000:3.0:1746143773.965743:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594498816:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.965752:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.965769:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.965778:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.965796:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5546c00/0xe984082ccd73196d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a897c expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.966363:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.966366:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.966374:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7319d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89a6 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.966382:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7319d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89a6 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.966408:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e5c200/0xe984082ccd7319d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89a6 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.966418:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594474752:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143773.966478:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.968212:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594474752:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143773.968226:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143773.968348:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.968525:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594498816:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2780us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.968533:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7569 00000100:00100000:1.0:1746143773.968587:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594498944 00000100:00100000:1.0:1746143773.968592:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594498944 00000100:00100000:1.0:1746143773.968837:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14150 00000100:00100000:1.0:1746143773.968844:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31713:x1830963594498944:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.968857:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.968869:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7319dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a89ad expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.968888:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.968894:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.968895:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.968898:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7319dd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89ad expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.968918:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 22 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.968928:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 22 pid: 15784 timeout: 952 lvb_type: 1 00000100:00100000:1.0:1746143773.968937:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594474880:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.968983:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.970656:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594474880:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143773.970673:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7319dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89ad expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.970684:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e5c000, rc 0) 00000100:00100000:1.0:1746143773.970737:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31713:x1830963594498944:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1892us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.970743:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14150 00000100:00100000:0.0:1746143773.971689:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.971774:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499072 00000100:00100000:3.0:1746143773.971779:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499072 00010000:00010000:3.0:1746143773.971801:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 22 pid: 15784 timeout: 952 lvb_type: 1 00000100:00100000:3.0:1746143773.971819:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7570 00000100:00100000:3.0:1746143773.971824:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1964:x1830963594499072:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.971834:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.971851:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 22 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.971864:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 22 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.971879:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96600/0xe984082ccd731974 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8983 expref: 22 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.972030:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.972032:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.972037:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7319dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89ad expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.972044:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7319dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89ad expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.972066:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e5c000/0xe984082ccd7319dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89ad expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.972075:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594475008:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143773.972526:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.975689:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.975722:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594475008:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143773.975739:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.975775:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594499072:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3950us (4087us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.975783:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7570 00000100:00100000:1.0:1746143773.975886:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499200 00000100:00100000:1.0:1746143773.975892:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499200 00000100:00100000:1.0:1746143773.975933:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14151 00000100:00100000:1.0:1746143773.975940:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31713:x1830963594499200:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.975954:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.975966:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880000061000/0xe984082ccd7319e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a89b4 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.975988:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 22 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.975995:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.975996:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.975999:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880000061000/0xe984082ccd7319e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89b4 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.976027:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 22 pid: 25369 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.976037:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 22 pid: 25369 timeout: 952 lvb_type: 1 00000100:00100000:1.0:1746143773.976046:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594475136:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.976097:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.978685:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.978778:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499328 00000100:00100000:3.0:1746143773.978784:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499328 00010000:00010000:3.0:1746143773.978810:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 23 pid: 25369 timeout: 952 lvb_type: 1 00000100:00100000:3.0:1746143773.978831:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7571 00000100:00100000:3.0:1746143773.978837:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1962:x1830963594499328:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.978847:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.978863:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 23 pid: 25369 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.978872:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 23 pid: 25369 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.978890:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.978892:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.978898:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880000061000/0xe984082ccd7319e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89b4 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.978905:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880000061000/0xe984082ccd7319e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89b4 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.978929:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880000061000/0xe984082ccd7319e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89b4 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.978939:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594475264:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143773.979006:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00010000:00010000:1.0:1746143773.979174:0:2839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5547400/0xe984082ccd73197b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a898a expref: 23 pid: 25369 timeout: 952 lvb_type: 1 00000100:00100000:1.0:1746143773.979200:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594475136:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143773.979219:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880000061000/0xe984082ccd7319e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89b4 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.979226:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880000061000, rc 0) 00000100:00100000:1.0:1746143773.979255:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:31713:x1830963594499200:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3316us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.979261:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14151 00000100:00100000:3.0:1746143773.980441:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594475264:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143773.980451:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.980471:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1962:x1830963594499328:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 1634us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.980478:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7571 00000100:00100000:0.0:1746143773.981229:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.981299:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499456 00000100:00100000:1.0:1746143773.981304:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499456 00000100:00100000:1.0:1746143773.981346:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14152 00000100:00100000:1.0:1746143773.981353:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31713:x1830963594499456:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.981365:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.981378:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880000061400/0xe984082ccd7319eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a89bb expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.981398:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.981404:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.981406:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.981409:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880000061400/0xe984082ccd7319eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89bb expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.981427:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 17 pid: 15784 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.981436:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00000100:00100000:1.0:1746143773.981444:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594475392:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.981504:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.983496:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594475392:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143773.983520:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880000061400/0xe984082ccd7319eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89bb expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.983537:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880000061400, rc 0) 00000100:00100000:1.0:1746143773.983568:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31713:x1830963594499456:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 2215us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.983574:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14152 00000100:00100000:0.0:1746143773.984358:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.985188:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499584 00000100:00100000:3.0:1746143773.985198:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499584 00010000:00010000:3.0:1746143773.985227:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00000100:00100000:3.0:1746143773.985262:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7572 00000100:00100000:3.0:1746143773.985268:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594499584:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.985278:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.985296:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.985307:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.985325:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff97800/0xe984082ccd731982 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8991 expref: 17 pid: 15784 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.985348:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.985350:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.985356:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880000061400/0xe984082ccd7319eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89bb expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.985366:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880000061400/0xe984082ccd7319eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89bb expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.985392:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880000061400/0xe984082ccd7319eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89bb expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.985403:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594475520:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143773.985462:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143773.987787:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594475520:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143773.987806:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143773.987849:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594499584:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 2580us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.987858:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7572 00000100:00100000:0.0:1746143773.988453:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.988872:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499712 00000100:00100000:1.0:1746143773.988878:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499712 00000100:00100000:1.0:1746143773.989471:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14153 00000100:00100000:1.0:1746143773.989482:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:31713:x1830963594499712:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.989496:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.989508:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129dc0a00/0xe984082ccd7319f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a89c2 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.989529:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.989536:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.989538:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.989540:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dc0a00/0xe984082ccd7319f2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c2 expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.989568:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.989578:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 952 lvb_type: 1 00000100:00100000:1.0:1746143773.989588:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594475648:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.989656:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143773.990972:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:2839:1830963594475648:192.168.202.48@tcp:104: 00010000:00010000:1.0:1746143773.990991:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129dc0a00/0xe984082ccd7319f2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c2 expref: 17 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.991006:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0a00, rc 0) 00000100:00100000:1.0:1746143773.991262:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:31713:x1830963594499712:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 1782us (2809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.991268:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14153 00000100:00100000:2.0:1746143773.991730:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.992029:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499840 00000100:00100000:3.0:1746143773.992035:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499840 00010000:00010000:3.0:1746143773.992057:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 952 lvb_type: 1 00000100:00100000:3.0:1746143773.992078:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7573 00000100:00100000:3.0:1746143773.992083:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1964:x1830963594499840:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.992093:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143773.992126:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.992136:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.992179:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136bb6200/0xe984082ccd731989 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8998 expref: 17 pid: 21542 timeout: 952 lvb_type: 1 00010000:00010000:3.0:1746143773.992203:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.992205:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.992210:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129dc0a00/0xe984082ccd7319f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c2 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.992218:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129dc0a00/0xe984082ccd7319f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c2 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.992244:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129dc0a00/0xe984082ccd7319f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c2 expref: 16 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.992255:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594475776:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143773.992317:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.995264:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:1.0:1746143773.995423:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594499968 00000100:00100000:1.0:1746143773.995434:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594499968 00000100:00100000:1.0:1746143773.995524:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14154 00000100:00100000:1.0:1746143773.995531:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:31713:x1830963594499968:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:1.0:1746143773.995546:0:2839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143773.995559:0:2839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd7319f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a89c9 expref: -99 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.995563:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7149:1830963594475776:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143773.995579:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143773.995582:0:2839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143773.995589:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.995591:0:2839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143773.995594:0:2839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd7319f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c9 expref: 22 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.995715:0:2839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 22 pid: 9527 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143773.995729:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1964:x1830963594499840:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3644us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143773.995741:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7573 00010000:00010000:1.0:1746143773.995882:0:2839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 22 pid: 9527 timeout: 953 lvb_type: 1 00000100:00100000:1.0:1746143773.995898:0:2839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594475904:192.168.202.48@tcp:104: 00000100:00100000:1.0:1746143773.995952:0:2839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129cc7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143773.998176:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143773.998478:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594500096 00000100:00100000:3.0:1746143773.998485:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594500096 00000100:00100000:1.0:1746143773.998508:0:2839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:2839:1830963594475904:192.168.202.48@tcp:104: 00010000:00010000:3.0:1746143773.998513:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 23 pid: 9527 timeout: 953 lvb_type: 1 00010000:00010000:1.0:1746143773.998528:0:2839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd7319f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c9 expref: 23 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143773.998540:0:2839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129dc0000, rc 0) 00000100:00100000:3.0:1746143773.998541:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7574 00000100:00100000:3.0:1746143773.998548:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1964:x1830963594500096:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143773.998558:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143773.998569:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:31713:x1830963594499968:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 3040us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143773.998575:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14154 00010000:00010000:3.0:1746143773.998577:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 23 pid: 9527 timeout: 953 lvb_type: 1 00010000:00010000:3.0:1746143773.998748:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 22 pid: 9527 timeout: 953 lvb_type: 1 00010000:00010000:3.0:1746143773.998767:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941d8e00/0xe984082ccd731990 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a899f expref: 22 pid: 9527 timeout: 953 lvb_type: 1 00010000:00010000:3.0:1746143773.998790:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.998792:0:7149:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143773.998797:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd7319f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c9 expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.998804:0:7149:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd7319f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c9 expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143773.998826:0:7149:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129dc0000/0xe984082ccd7319f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89c9 expref: 21 pid: 2839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143773.998837:0:7149:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594476032:192.168.202.48@tcp:105: 00000100:00100000:3.0:1746143773.998883:0:7149:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800934f5540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143774.001947:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143774.001962:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143774.002095:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143774.002220:0:7149:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093503100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7149:1830963594476032:192.168.202.48@tcp:105: 00010000:00010000:3.0:1746143774.002236:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.002274:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+21:1964:x1830963594500096:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 3726us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.002282:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7574 00000100:00100000:1.0:1746143774.002409:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594500352 00000100:00100000:1.0:1746143774.002414:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594500352 00000100:00080000:1.0:1746143774.002435:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143774.002461:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594500608 00000100:00100000:1.0:1746143774.002463:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594500608 00000100:00080000:1.0:1746143774.002472:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143774.002484:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594500864 00000100:00100000:1.0:1746143774.002485:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594500864 00000100:00100000:1.0:1746143774.002499:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14155 00000100:00100000:1.0:1746143774.002505:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594500352:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143774.002662:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143774.002665:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.002667:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143774.002669:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143771 -> 1746143773 00002000:00010000:1.0:1746143774.002670:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143774.002688:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594500352:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 182us (747us total) trans 17179873256 rc 0/0 00000100:00100000:1.0:1746143774.002693:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14155 00000100:00100000:1.0:1746143774.002703:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14156 00000100:00100000:1.0:1746143774.002708:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+16:1965:x1830963594500608:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143774.002789:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143774.002791:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.002793:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143771 -> 1746143772 00002000:00010000:1.0:1746143774.002795:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143772 -> 1746143773 00002000:00010000:1.0:1746143774.002796:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746143774.002810:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+17:1965:x1830963594500608:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 102us (847us total) trans 21474840586 rc 0/0 00000100:00100000:1.0:1746143774.002816:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14156 00000100:00100000:1.0:1746143774.002825:0:21542:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14157 00000100:00100000:1.0:1746143774.002829:0:21542:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+22:1965:x1830963594500864:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:1.0:1746143774.002887:0:21542:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143774.002889:0:21542:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.002891:0:21542:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.002892:0:21542:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143772 -> 1746143773 00002000:00010000:1.0:1746143774.002894:0:21542:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143774.002909:0:21542:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594500864:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 79us (814us total) trans 17179873257 rc 0/0 00000100:00100000:1.0:1746143774.002914:0:21542:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14157 00000100:00100000:0.0:1746143774.003128:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143774.003162:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143774.003199:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143774.003308:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594500224 00000100:00100000:3.0:1746143774.003311:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594500224 00000100:00100000:3.0:1746143774.003324:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594500480 00000100:00100000:3.0:1746143774.003326:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594500480 00000100:00100000:3.0:1746143774.003334:0:25369:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594500736 00000100:00100000:3.0:1746143774.003335:0:25369:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594500736 00000100:00100000:3.0:1746143774.003346:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14158 00000100:00100000:3.0:1746143774.003350:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594500224:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143774.003428:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143774.003431:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143771 -> 1746143772 00002000:00010000:3.0:1746143774.003432:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143771 -> 1746143772 00002000:00010000:3.0:1746143774.003434:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143771 -> 1746143773 00002000:00010000:3.0:1746143774.003436:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:3.0:1746143774.003455:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594500224:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 104us (327us total) trans 21474840587 rc 0/0 00000100:00100000:3.0:1746143774.003459:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14158 00000100:00100000:3.0:1746143774.003468:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14159 00000100:00100000:3.0:1746143774.003471:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+23:1965:x1830963594500480:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143774.003530:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143774.003533:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:3.0:1746143774.003534:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143771 -> 1746143772 00002000:00010000:3.0:1746143774.003536:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143772 -> 1746143773 00002000:00010000:3.0:1746143774.003538:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746143774.003552:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+24:1965:x1830963594500480:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 80us (389us total) trans 17179873258 rc 0/0 00000100:00100000:3.0:1746143774.003557:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14159 00000100:00100000:3.0:1746143774.003565:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 14160 00000100:00100000:3.0:1746143774.003570:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+18:1965:x1830963594500736:12345-192.168.202.48@tcp:2:lfs.0 00002000:00010000:3.0:1746143774.003626:0:25369:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:3.0:1746143774.003628:0:25369:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:3.0:1746143774.003630:0:25369:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:3.0:1746143774.003631:0:25369:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143772 -> 1746143773 00002000:00010000:3.0:1746143774.003633:0:25369:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:3.0:1746143774.003646:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+19:1965:x1830963594500736:12345-192.168.202.48@tcp:2:lfs.0 Request processed in 76us (447us total) trans 21474840588 rc 0/0 00000100:00100000:3.0:1746143774.003651:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 14160 00000100:00100000:0.0:1746143774.006762:0:3285:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143774.007168:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594501120 00000100:00100000:2.0:1746143774.007176:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594501120 00000100:00080000:1.0:1746143774.007224:0:7160:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143774.007226:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9351 00000100:00100000:2.0:1746143774.007233:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31713:x1830963594501120:12345-192.168.202.48@tcp:55:lfs.0 00010000:00010000:2.0:1746143774.007282:0:14762:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007293:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007304:0:14762:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007324:0:14762:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007329:0:14762:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007333:0:14762:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007338:0:14762:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bb6200 already unused, calling callback (ffffffffa1387690) 00010000:00010000:2.0:1746143774.007341:0:14762:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007347:0:14762:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007356:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:2.0:1746143774.007358:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1746143774.007442:0:14762:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00010000:00010000:2.0:1746143774.007446:0:14762:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6200/0xe984082ccd731a00 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14762 initiator: MDT0 00000100:00100000:2.0:1746143774.007504:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009445aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31713:x1830963594501120:12345-192.168.202.48@tcp:55:lfs.0 Request processed in 271us (747us total) trans 0 rc -22/-22 00000100:00100000:2.0:1746143774.007510:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9351 00000100:00100000:0.0:1746143774.009499:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:2.0:1746143774.010096:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594501376 00000100:00100000:2.0:1746143774.010103:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594501376 00000100:00100000:2.0:1746143774.010179:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4050 00000100:00100000:2.0:1746143774.010185:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31713:x1830963594501376:12345-192.168.202.48@tcp:35:lfs.0 00000004:00010000:2.0:1746143774.010224:0:28880:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x2d9:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135180000/0xe984082ccd731919 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8967 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.010259:0:28880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28880 initiator: MDT0 00010000:00010000:2.0:1746143774.010267:0:28880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.010273:0:28880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28880 initiator: MDT0 00010000:00010000:2.0:1746143774.010297:0:28880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.010307:0:28880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 243 pid: 20509 timeout: 953 lvb_type: 0 00000100:00100000:2.0:1746143774.010317:0:28880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:28880:1830963594476160:192.168.202.48@tcp:104: 00000100:00100000:2.0:1746143774.010392:0:28880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143774.012338:0:28880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5c20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:28880:1830963594476160:192.168.202.48@tcp:104: 00010000:00010000:2.0:1746143774.012355:0:28880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000100:00100000:0.0:1746143774.012985:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143774.013689:0:7149:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594501504 00000100:00100000:3.0:1746143774.013695:0:7149:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594501504 00010000:00010000:3.0:1746143774.013723:0:7149:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 244 pid: 20509 timeout: 953 lvb_type: 0 00000100:00100000:3.0:1746143774.013751:0:7149:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 7575 00000100:00100000:3.0:1746143774.013758:0:7149:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+244:1965:x1830963594501504:12345-192.168.202.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143774.013768:0:7149:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143774.013773:0:7149:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 244 pid: 20509 timeout: 953 lvb_type: 0 00010000:00010000:3.0:1746143774.013785:0:7149:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 244 pid: 20509 timeout: 953 lvb_type: 0 00010000:00010000:3.0:1746143774.013800:0:7149:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941d8800/0xe984082ccd731958 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.48@tcp remote: 0x4472ae46120a896e expref: 244 pid: 20509 timeout: 953 lvb_type: 0 00010000:00010000:3.0:1746143774.014196:0:7149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143774.014201:0:7149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143774.014208:0:7149:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143774.014214:0:7149:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 28880 initiator: MDT0 00010000:00010000:3.0:1746143774.014238:0:7149:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143774.014275:0:7149:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:1965:x1830963594501504:12345-192.168.202.48@tcp:103:ldlm_bl.0 Request processed in 517us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143774.014281:0:7149:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 7575 00010000:00010000:2.0:1746143774.014504:0:28880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00010000:00010000:2.0:1746143774.014510:0:28880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000040:00080000:2.0:1746143774.015125:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2795, 88 off236504 00000004:00080000:2.0:1746143774.015132:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853024992433ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015192:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2799, 88 off237032 00000004:00080000:2.0:1746143774.015197:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025057400ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143774.015208:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2800, 88 off237120 00000004:00080000:2.0:1746143774.015210:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025070573ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143774.015217:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2796, 88 off236592 00000004:00080000:2.0:1746143774.015220:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025080695ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015226:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2797, 88 off236680 00000004:00080000:2.0:1746143774.015228:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025088115ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015233:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2801, 88 off237208 00000004:00080000:2.0:1746143774.015235:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025095795ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143774.015241:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2802, 88 off237296 00000004:00080000:2.0:1746143774.015244:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025104001ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143774.015249:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2803, 88 off237384 00000004:00080000:2.0:1746143774.015251:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025111675ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143774.015257:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2798, 88 off236768 00000004:00080000:2.0:1746143774.015259:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025119476ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015265:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2804, 88 off237472 00000004:00080000:2.0:1746143774.015267:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025127662ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143774.015273:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2799, 88 off236856 00000004:00080000:2.0:1746143774.015275:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025135311ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015303:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2806, 88 off237656 00000004:00080000:2.0:1746143774.015306:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025166135ns, next at 833304778357ns, rc = 0 00000040:00080000:2.0:1746143774.015313:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2800, 88 off236944 00000004:00080000:2.0:1746143774.015315:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025175713ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015321:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2801, 88 off237032 00000004:00080000:2.0:1746143774.015324:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025184047ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015329:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2802, 88 off237120 00000004:00080000:2.0:1746143774.015332:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025192325ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015337:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].2803, 88 off237208 00000004:00080000:2.0:1746143774.015340:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 853025200320ns, next at 788202887869ns, rc = 0 00000040:00080000:2.0:1746143774.015346:0:28880:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].2807, 88 off237744 00000004:00080000:2.0:1746143774.015348:0:28880:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 853025208723ns, next at 833304778357ns, rc = 0 00000004:00010000:3.0:1746143774.049501:0:28880:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094458e00 reply state ffff88012ef54c00 transno 8589943715 ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28880 initiator: MDT0 00000100:00100000:3.0:1746143774.049514:0:28880:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746143774.049523:0:28880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:3.0:1746143774.049525:0:28880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143774.049533:0:28880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135180000/0xe984082ccd731919 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a8967 expref: 243 pid: 20509 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143774.049627:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+243:31713:x1830963594501376:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 39441us (40130us total) trans 8589943715 rc 0/0 00000100:00100000:3.0:1746143774.049636:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4050 00000001:00080000:0.0:1746143774.049867:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943714 is committed 00000001:00080000:0.0:1746143774.049880:0:14831:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589943715 is committed 00000004:00080000:0.0:1746143774.049884:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2141 committed 00000004:00080000:0.0:1746143774.049889:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2138 committed 00000004:00080000:0.0:1746143774.049893:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2137 committed 00000004:00080000:0.0:1746143774.049894:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2136 committed 00000004:00080000:0.0:1746143774.049896:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2135 committed 00000004:00080000:0.0:1746143774.049897:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2140 committed 00000004:00080000:0.0:1746143774.049899:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2134 committed 00000004:00080000:0.0:1746143774.049900:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2139 committed 00000004:00080000:0.0:1746143774.049901:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2133 committed 00000004:00080000:0.0:1746143774.049902:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2138 committed 00000004:00080000:0.0:1746143774.049903:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2137 committed 00000004:00080000:0.0:1746143774.049904:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2136 committed 00000004:00080000:0.0:1746143774.049906:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2132 committed 00000004:00080000:0.0:1746143774.049907:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2131 committed 00000004:00080000:0.0:1746143774.049908:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2135 committed 00000004:00080000:0.0:1746143774.049909:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2134 committed 00000004:00080000:0.0:1746143774.049911:0:14831:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2130 committed 00000100:00100000:0.0:1746143774.050028:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050068:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050104:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050124:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050136:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143774.050156:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009445b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050168:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050182:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050193:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050208:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594476672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050218:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050226:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594477184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050237:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050248:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143774.050251:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594476544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050265:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050275:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594477056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.050287:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143774.050306:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476288 00000100:00100000:0.0:1746143774.050311:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476288 00000100:00100000:0.0:1746143774.050333:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476800 00000100:00100000:0.0:1746143774.050335:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476800 00000100:00100000:0.0:1746143774.050342:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476416 00000100:00100000:0.0:1746143774.050343:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476416 00000100:00100000:0.0:1746143774.050351:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476928 00000100:00100000:0.0:1746143774.050352:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476928 00000100:00100000:0.0:1746143774.050359:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476672 00000100:00100000:0.0:1746143774.050360:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476672 00000100:00100000:0.0:1746143774.050364:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477184 00000100:00100000:0.0:1746143774.050365:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477184 00000100:00100000:0.0:1746143774.050370:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594476544 00000100:00100000:0.0:1746143774.050371:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594476544 00000100:00100000:0.0:1746143774.050376:0:8497:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477056 00000100:00100000:0.0:1746143774.050377:0:8497:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477056 00000100:00100000:0.0:1746143774.050383:0:8497:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14161 00000100:00100000:0.0:1746143774.050387:0:8497:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963594476288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.051469:0:25369:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14162 00000100:00100000:3.0:1746143774.051478:0:25369:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963594476800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143774.051567:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14163 00000100:00100000:3.0:1746143774.051573:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963594476416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143774.051674:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143774.051677:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:3.0:1746143774.051679:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:3.0:1746143774.051680:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00002000:00010000:3.0:1746143774.051683:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x357:0x0] updating lvb blocks from disk: 2081 -> 2081 00010000:00010000:1.0:1746143774.051875:0:3278:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143774.051885:0:3278:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143774.051891:0:3278:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143774.051896:0:3278:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136bb6a00 already unused, calling callback (ffffffffa1387690) 00010000:00010000:1.0:1746143774.051900:0:3278:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143774.051907:0:3278:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143774.051919:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800a5691e00) 00010000:00010000:1.0:1746143774.051928:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143774.051931:0:3278:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28880 initiator: MDT0 00010000:00010000:1.0:1746143774.051936:0:3278:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136bb6a00/0xe984082ccd731a07 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28880 initiator: MDT0 00000100:00100000:3.0:1746143774.052213:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594476416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 639us (2042us total) trans 17179873259 rc 0/0 00000100:00100000:3.0:1746143774.052219:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14163 00000100:00100000:2.0:1746143774.052219:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.052246:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.052248:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14164 00000100:00100000:3.0:1746143774.052253:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3292:x1830963594476928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143774.052399:0:2839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477312 00000100:00100000:1.0:1746143774.052403:0:2839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477312 00000100:00100000:1.0:1746143774.052419:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14165 00000100:00100000:1.0:1746143774.052424:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594476672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143774.052497:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746143774.052500:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb mtime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143774.052502:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb atime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143774.052504:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb ctime from disk: 1746143711 -> 1746143711 00002000:00010000:1.0:1746143774.052506:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x355:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746143774.052528:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594476672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (2309us total) trans 17179873260 rc 0/0 00000100:00100000:1.0:1746143774.052533:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14165 00000100:00100000:1.0:1746143774.052544:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14166 00000100:00100000:1.0:1746143774.052548:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594477184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143774.052617:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594477184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (2379us total) trans 17179873261 rc 0/0 00000100:00100000:1.0:1746143774.052622:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14166 00000100:00100000:1.0:1746143774.052631:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14167 00000100:00100000:1.0:1746143774.052635:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594476544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143774.052700:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143774.052703:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.052704:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.052706:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00002000:00010000:1.0:1746143774.052708:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x358:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746143774.052727:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594476544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (2460us total) trans 17179873262 rc 0/0 00000100:00100000:1.0:1746143774.052732:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14167 00000100:00100000:1.0:1746143774.052742:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14168 00000100:00100000:1.0:1746143774.052746:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3295:x1830963594477056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143774.052816:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830963594477056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (2527us total) trans 17179873263 rc 0/0 00000100:00100000:1.0:1746143774.052821:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14168 00000100:00100000:1.0:1746143774.052830:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14169 00000100:00100000:1.0:1746143774.052834:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3292:x1830963594477312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143774.052918:0:2839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143774.052920:0:2839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.052922:0:2839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:1.0:1746143774.052924:0:2839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00002000:00010000:1.0:1746143774.052926:0:2839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x351:0x0] updating lvb blocks from disk: 2063 -> 2063 00000100:00100000:1.0:1746143774.052944:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3292:x1830963594477312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (697us total) trans 21474840589 rc 0/0 00000100:00100000:1.0:1746143774.052949:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14169 00000004:00080000:2.0:1746143774.053077:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009445b100/2, rc 0, transno 17179873259 00000100:00100000:2.0:1746143774.053082:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009445b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143774.053092:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053122:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143774.053165:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274e00/2, rc 0, transno 21474840589 00000100:00100000:2.0:1746143774.053171:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053177:0:3292:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143774.053180:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053199:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.053210:0:3292:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053222:0:3292:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.053238:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477824 00000100:00100000:2.0:1746143774.053240:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477824 00000100:00100000:2.0:1746143774.053254:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477440 00000100:00100000:2.0:1746143774.053256:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477440 00000100:00100000:2.0:1746143774.053262:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477952 00000100:00100000:2.0:1746143774.053263:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477952 00000100:00100000:2.0:1746143774.053270:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14170 00000100:00100000:2.0:1746143774.053274:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594477824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.053275:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594476928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1022us (3080us total) trans 17179873264 rc 0/0 00000100:00100000:3.0:1746143774.053280:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14164 00000100:00100000:3.0:1746143774.053292:0:6929:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14171 00000100:00100000:3.0:1746143774.053296:0:6929:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1830963594477440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143774.053353:0:6929:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143774.053355:0:6929:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00000100:00100000:2.0:1746143774.053355:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3292:x1830963594477824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (232us total) trans 21474840590 rc 0/0 00002000:00010000:3.0:1746143774.053357:0:6929:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:3.0:1746143774.053360:0:6929:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00000100:00100000:2.0:1746143774.053360:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14170 00002000:00010000:3.0:1746143774.053361:0:6929:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x353:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746143774.053368:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14172 00000100:00100000:2.0:1746143774.053372:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594477952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.053375:0:6929:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594477440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (175us total) trans 21474840591 rc 0/0 00000100:00100000:3.0:1746143774.053379:0:6929:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14171 00000100:00100000:3.0:1746143774.053395:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594477568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.053412:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143774.053422:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594478080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.053434:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.053440:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3292:x1830963594477952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (216us total) trans 21474840592 rc 0/0 00000100:00100000:3.0:1746143774.053443:0:3294:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143774.053444:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14172 00000100:00100000:3.0:1746143774.053447:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594477696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053451:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477568 00000100:00100000:2.0:1746143774.053453:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477568 00000100:00100000:3.0:1746143774.053458:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.053460:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478080 00000100:00100000:2.0:1746143774.053461:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478080 00000100:00100000:3.0:1746143774.053465:0:3294:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594478208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053465:0:8496:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594477696 00000100:00100000:2.0:1746143774.053467:0:8496:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594477696 00000100:00100000:2.0:1746143774.053473:0:8496:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14173 00000100:00100000:3.0:1746143774.053475:0:3294:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.053477:0:8496:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3294:x1830963594477568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.053487:0:15784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478208 00000100:00100000:3.0:1746143774.053489:0:15784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478208 00000100:00100000:3.0:1746143774.053499:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14174 00000100:00100000:3.0:1746143774.053502:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3294:x1830963594478080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053538:0:2839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14175 00000100:00100000:2.0:1746143774.053542:0:2839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963594477696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143774.053575:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963594478080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (140us total) trans 21474840594 rc 0/0 00000100:00100000:3.0:1746143774.053580:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14174 00000100:00100000:3.0:1746143774.053588:0:15784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14176 00000100:00100000:3.0:1746143774.053592:0:15784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963594478208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053607:0:2839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3294:x1830963594477696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (147us total) trans 21474840595 rc 0/0 00000100:00100000:2.0:1746143774.053611:0:2839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14175 00002000:00010000:2.0:1746143774.053634:0:8496:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb size from disk: 4771552 -> 4771552 00002000:00010000:2.0:1746143774.053636:0:8496:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:2.0:1746143774.053638:0:8496:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:2.0:1746143774.053639:0:8496:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00002000:00010000:2.0:1746143774.053641:0:8496:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x354:0x0] updating lvb blocks from disk: 5289 -> 5289 00000100:00100000:2.0:1746143774.053657:0:8496:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963594477568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (244us total) trans 21474840593 rc 0/0 00000100:00100000:3.0:1746143774.053661:0:25369:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594476800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2186us (3537us total) trans 17179873265 rc 0/0 00000100:00100000:2.0:1746143774.053662:0:8496:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14173 00000100:00100000:3.0:1746143774.053668:0:25369:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14162 00000004:00080000:3.0:1746143774.053688:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274000/2, rc 0, transno 21474840595 00000100:00100000:3.0:1746143774.053692:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594477696:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.053698:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c275180/2, rc 0, transno 21474840593 00000100:00100000:3.0:1746143774.053700:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594477568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.053705:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c275c00/2, rc 0, transno 21474840594 00000100:00100000:3.0:1746143774.053707:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594478080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.053710:0:15784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3294:x1830963594478208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (233us total) trans 21474840596 rc 0/0 00000004:00080000:3.0:1746143774.053713:0:3294:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274380/2, rc 0, transno 21474840596 00000100:00100000:2.0:1746143774.053714:0:15784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14176 00000100:00100000:3.0:1746143774.053715:0:3294:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3294:1830963594478208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143774.053729:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c275f80/2, rc 0, transno 21474840591 00000100:00100000:2.0:1746143774.053732:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c275f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477440:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143774.053737:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c276300/2, rc 0, transno 21474840592 00000100:00100000:2.0:1746143774.053739:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477952:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143774.053744:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c274700/2, rc 0, transno 21474840590 00000100:00100000:2.0:1746143774.053746:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594477824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143774.053753:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dfb80/2, rc 0, transno 17179873264 00000100:00100000:2.0:1746143774.053755:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476928:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143774.053761:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dc700/2, rc 0, transno 17179873265 00000100:00100000:2.0:1746143774.053763:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476800:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143774.053927:0:8497:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143774.053930:0:8497:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1746143772 -> 1746143772 00002000:00010000:0.0:1746143774.053932:0:8497:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1746143772 -> 1746143772 00002000:00010000:0.0:1746143774.053934:0:8497:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1746143773 -> 1746143773 00002000:00010000:0.0:1746143774.053936:0:8497:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746143774.053974:0:8497:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800930dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1830963594476288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3586us (3905us total) trans 17179873266 rc 0/0 00000100:00100000:0.0:1746143774.053979:0:8497:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14161 00000004:00080000:0.0:1746143774.054021:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459c00/2, rc 0, transno 17179873262 00000100:00100000:0.0:1746143774.054024:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594476544:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.054031:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930df100/2, rc 0, transno 17179873263 00000100:00100000:0.0:1746143774.054034:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594477056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.054040:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930de300/2, rc 0, transno 17179873260 00000100:00100000:0.0:1746143774.054042:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594476672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143774.054048:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dc380/2, rc 0, transno 17179873261 00000100:00100000:0.0:1746143774.054051:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3295:1830963594477184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143774.054184:0:3287:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:0.0:1746143774.054189:0:3293:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143774.054194:0:3293:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594478336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143774.054201:0:14762:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594501632 00000100:00100000:2.0:1746143774.054203:0:14762:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594501632 00000100:00100000:0.0:1746143774.054213:0:3293:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143774.054222:0:14762:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 9352 00000100:00100000:2.0:1746143774.054226:0:14762:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+240:31713:x1830963594501632:12345-192.168.202.48@tcp:101:lfs.0 00010000:00010000:2.0:1746143774.054238:0:14762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143774.054241:0:12618:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594478336 00000100:00100000:0.0:1746143774.054244:0:12618:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594478336 00010000:00010000:2.0:1746143774.054250:0:14762:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96000/0xe984082ccd731a0e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4472ae46120a89d0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143774.054256:0:12618:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14177 00000100:00100000:0.0:1746143774.054260:0:12618:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3293:x1830963594478336:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143774.054290:0:14762:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96000/0xe984082ccd731a0e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89d0 expref: 241 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.054301:0:14762:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff96000/0xe984082ccd731a0e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.48@tcp remote: 0x4472ae46120a89d0 expref: 241 pid: 14762 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143774.054314:0:14762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2d9:0x0].0x0 (ffff8800939cda00) 00010000:00010000:2.0:1746143774.054317:0:14762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143774.054319:0:14762:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff96000, rc 0) 00000100:00100000:2.0:1746143774.054342:0:14762:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31713:x1830963594501632:12345-192.168.202.48@tcp:101:lfs.0 Request processed in 116us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143774.054343:0:12618:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3293:x1830963594478336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (128us total) trans 21474840597 rc 0/0 00000100:00100000:2.0:1746143774.054348:0:14762:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 9352 00000100:00100000:0.0:1746143774.054348:0:12618:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14177 00000004:00080000:0.0:1746143774.054365:0:3293:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800930dea00/2, rc 0, transno 21474840597 00000100:00100000:0.0:1746143774.054368:0:3293:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800930dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3293:1830963594478336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143774.054954:0:3292:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094459f80/2, rc 0, transno 17179873266 00000100:00100000:3.0:1746143774.054958:0:3292:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3292:1830963594476288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143774.056414:0:3286:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.48@tcp (source: 12345-192.168.202.48@tcp) 00000100:00100000:3.0:1746143774.056556:0:28880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963594501888 00000100:00100000:3.0:1746143774.056560:0:28880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963594501888 00000100:00100000:3.0:1746143774.056586:0:28880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.48@tcp, seq: 4051 00000100:00100000:3.0:1746143774.056591:0:28880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+241:31713:x1830963594501888:12345-192.168.202.48@tcp:35:lfs.0 00000100:00100000:3.0:1746143774.056765:0:28880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:20ac2d0d-0afc-4ad2-98ac-11e8a5ecc054+242:31713:x1830963594501888:12345-192.168.202.48@tcp:35:lfs.0 Request processed in 172us (353us total) trans 8589943716 rc 0/0 00000100:00100000:3.0:1746143774.056771:0:28880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.48@tcp, seq: 4051 00000001:02000400:1.0:1746143774.744671:0:3570:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:3.0:1746143774.797375:0:14129:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69531 lines, 69531 kept, 0 dropped, 0 bad.